You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2015/04/10 17:43:11 UTC
[JENKINS] Lucene-Solr-NightlyTests-5.x - Build # 813 - Still
Failing
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/813/
1 tests failed.
REGRESSION: org.apache.lucene.analysis.core.TestRandomChains.testRandomChains
Error Message:
startOffset must be non-negative, and endOffset must be >= startOffset, startOffset=11,endOffset=10
Stack Trace:
java.lang.IllegalArgumentException: startOffset must be non-negative, and endOffset must be >= startOffset, startOffset=11,endOffset=10
at __randomizedtesting.SeedInfo.seed([E064DFCFBDF444E4:DD85F6AEFAE65924]:0)
at org.apache.lucene.analysis.tokenattributes.PackedTokenAttributeImpl.setOffset(PackedTokenAttributeImpl.java:107)
at org.apache.lucene.analysis.shingle.ShingleFilter.incrementToken(ShingleFilter.java:345)
at org.apache.lucene.analysis.ValidatingTokenFilter.incrementToken(ValidatingTokenFilter.java:68)
at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkAnalysisConsistency(BaseTokenStreamTestCase.java:700)
at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:611)
at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:509)
at org.apache.lucene.analysis.core.TestRandomChains.testRandomChains(TestRandomChains.java:909)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 2968 lines...]
[junit4] Suite: org.apache.lucene.analysis.core.TestRandomChains
[junit4] 2> TEST FAIL: useCharFilter=false text='h\u030a\ue4c1\u5b0f&\udba4\ude2cS \ud7f4\ud7c2\ud7bc\ud7d3\ud7b9 \"&'
[junit4] 2> Exception from random analyzer:
[junit4] 2> charfilters=
[junit4] 2> org.apache.lucene.analysis.charfilter.MappingCharFilter(org.apache.lucene.analysis.charfilter.NormalizeCharMap@34c2d068, java.io.StringReader@620076e7)
[junit4] 2> tokenizer=
[junit4] 2> org.apache.lucene.analysis.standard.UAX29URLEmailTokenizer(org.apache.lucene.util.AttributeFactory$1@4d143cb7)
[junit4] 2> filters=
[junit4] 2> org.apache.lucene.analysis.miscellaneous.ASCIIFoldingFilter(ValidatingTokenFilter@4b75f7fd term=,bytes=[],startOffset=0,endOffset=0,positionIncrement=1,positionLength=1,type=word,flags=0,payload=null, true)
[junit4] 2> org.apache.lucene.analysis.de.GermanMinimalStemFilter(ValidatingTokenFilter@6ba8d226 term=,bytes=[],startOffset=0,endOffset=0,positionIncrement=1,positionLength=1,type=word,flags=0,payload=null,keyword=false)
[junit4] 2> org.apache.lucene.analysis.cjk.CJKBigramFilter(ValidatingTokenFilter@3377bbdd term=,bytes=[],startOffset=0,endOffset=0,positionIncrement=1,positionLength=1,type=word,flags=0,payload=null,keyword=false, -3, true)
[junit4] 2> org.apache.lucene.analysis.shingle.ShingleFilter(ValidatingTokenFilter@75cb0869 term=,bytes=[],startOffset=0,endOffset=0,positionIncrement=1,positionLength=1,type=word,flags=0,payload=null,keyword=false, 4, 8)
[junit4] 2> offsetsAreCorrect=false
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestRandomChains -Dtests.method=testRandomChains -Dtests.seed=E064DFCFBDF444E4 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=hu_HU -Dtests.timezone=Africa/Algiers -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 66.9s J0 | TestRandomChains.testRandomChains <<<
[junit4] > Throwable #1: java.lang.IllegalArgumentException: startOffset must be non-negative, and endOffset must be >= startOffset, startOffset=11,endOffset=10
[junit4] > at __randomizedtesting.SeedInfo.seed([E064DFCFBDF444E4:DD85F6AEFAE65924]:0)
[junit4] > at org.apache.lucene.analysis.tokenattributes.PackedTokenAttributeImpl.setOffset(PackedTokenAttributeImpl.java:107)
[junit4] > at org.apache.lucene.analysis.shingle.ShingleFilter.incrementToken(ShingleFilter.java:345)
[junit4] > at org.apache.lucene.analysis.ValidatingTokenFilter.incrementToken(ValidatingTokenFilter.java:68)
[junit4] > at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkAnalysisConsistency(BaseTokenStreamTestCase.java:700)
[junit4] > at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:611)
[junit4] > at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:509)
[junit4] > at org.apache.lucene.analysis.core.TestRandomChains.testRandomChains(TestRandomChains.java:909)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> NOTE: leaving temporary files on disk at: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/build/analysis/common/test/J0/temp/lucene.analysis.core.TestRandomChains E064DFCFBDF444E4-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene50): {dummy=Lucene50(blocksize=128)}, docValues:{}, sim=DefaultSimilarity, locale=hu_HU, timezone=Africa/Algiers
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_65 (64-bit)/cpus=16,threads=1,free=96506288,total=273678336
[junit4] 2> NOTE: All tests run in this JVM: [TestFactories, TestItalianLightStemFilterFactory, TestCharArraySet, TestTrimFilterFactory, TestGermanNormalizationFilter, TestFrenchMinimalStemFilterFactory, TestCommonGramsQueryFilterFactory, TestDutchAnalyzer, TestPortugueseMinimalStemFilter, TestMorph, TestKeywordAnalyzer, TestReverseStringFilter, Test64kAffixes, TestCaseSensitive, TestLatvianStemmer, TestTurkishLowerCaseFilter, TestCaseInsensitive, TestBugInSomething, TestHyphenationCompoundWordTokenFilterFactory, TestUAX29URLEmailAnalyzer, TestCollationKeyAnalyzer, TestPorterStemFilterFactory, TestIrishLowerCaseFilter, TestPathHierarchyTokenizer, TestFlagNum, TestStemmerOverrideFilterFactory, TestScandinavianNormalizationFilter, TestIndonesianStemmer, TestArmenianAnalyzer, TestBulgarianAnalyzer, QueryAutoStopWordAnalyzerTest, TestBrazilianAnalyzer, TestPatternCaptureGroupTokenFilter, TestSnowball, TestRandomChains]
[junit4] Completed [135/271] on J0 in 106.66s, 2 tests, 1 error <<< FAILURES!
[...truncated 414 lines...]
BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:543: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:484: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:61: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/extra-targets.xml:39: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/build.xml:457: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:2230: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/analysis/build.xml:106: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/analysis/build.xml:38: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/module-build.xml:58: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1434: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:991: There were test failures: 271 suites, 1425 tests, 1 error, 1 ignored
Total time: 95 minutes 28 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-NightlyTests-5.x #716
Archived 5 artifacts
Archive block size is 32768
Received 0 blocks and 1728310 bytes
Compression is 0.0%
Took 0.58 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-NightlyTests-5.x - Build # 816 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/816/
4 tests failed.
REGRESSION: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=4821, name=collection3, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=4821, name=collection3, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:27346: Could not find collection : awholynewstresscollection_collection3_1
at __randomizedtesting.SeedInfo.seed([336CA9E425036561]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:557)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:370)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1068)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:840)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:783)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:884)
REGRESSION: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test
Error Message:
expected:<1> but was:<3>
Stack Trace:
java.lang.AssertionError: expected:<1> but was:<3>
at __randomizedtesting.SeedInfo.seed([336CA9E425036561:BB38963E8BFF0899]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testDeleteByIdCompositeRouterWithRouterField(FullSolrCloudDistribCmdsTest.java:397)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test(FullSolrCloudDistribCmdsTest.java:146)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
REGRESSION: org.apache.solr.request.TestWriterPerf.testPerf
Error Message:
Stack Trace:
java.lang.NullPointerException
at __randomizedtesting.SeedInfo.seed([336CA9E425036561:125B48634D8D4E50]:0)
at org.apache.solr.highlight.DefaultSolrHighlighter.doHighlightingByHighlighter(DefaultSolrHighlighter.java:452)
at org.apache.solr.highlight.DefaultSolrHighlighter.doHighlighting(DefaultSolrHighlighter.java:395)
at org.apache.solr.handler.component.HighlightComponent.process(HighlightComponent.java:143)
at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:253)
at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:143)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1988)
at org.apache.solr.request.TestWriterPerf.getResponse(TestWriterPerf.java:96)
at org.apache.solr.request.TestWriterPerf.doPerf(TestWriterPerf.java:105)
at org.apache.solr.request.TestWriterPerf.testPerf(TestWriterPerf.java:178)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
FAILED: junit.framework.TestSuite.org.apache.solr.request.TestWriterPerf
Error Message:
1
Stack Trace:
java.lang.AssertionError: 1
at __randomizedtesting.SeedInfo.seed([336CA9E425036561]:0)
at org.apache.solr.core.CachingDirectoryFactory.close(CachingDirectoryFactory.java:201)
at org.apache.solr.core.SolrCore.close(SolrCore.java:1176)
at org.apache.solr.core.SolrCores.close(SolrCores.java:117)
at org.apache.solr.core.CoreContainer.shutdown(CoreContainer.java:378)
at org.apache.solr.util.TestHarness.close(TestHarness.java:359)
at org.apache.solr.SolrTestCaseJ4.deleteCore(SolrTestCaseJ4.java:704)
at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:230)
at sun.reflect.GeneratedMethodAccessor32.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:799)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 10695 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/init-core-data-001
[junit4] 2> 1254319 T4324 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (true)
[junit4] 2> 1254319 T4324 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 1254325 T4324 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 1254325 T4325 oasc.ZkTestServer$2$1.setClientPort client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1254326 T4325 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1254426 T4324 oasc.ZkTestServer.run start zk server on port:63380
[junit4] 2> 1254427 T4324 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1254433 T4324 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1254440 T4332 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@780cc69a name:ZooKeeperConnection Watcher:127.0.0.1:63380 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1254441 T4324 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1254441 T4324 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1254442 T4324 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1254445 T4324 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1254447 T4324 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1254448 T4335 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f806a6c name:ZooKeeperConnection Watcher:127.0.0.1:63380/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1254448 T4324 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1254448 T4324 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1254449 T4324 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 1254450 T4324 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 1254451 T4324 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 1254453 T4324 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 1254454 T4324 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1254454 T4324 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1254456 T4324 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 1254457 T4324 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 1254559 T4324 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1254560 T4324 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1254562 T4324 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1254562 T4324 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1254564 T4324 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1254565 T4324 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 1254566 T4324 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1254567 T4324 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 1254569 T4324 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1254569 T4324 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1254572 T4324 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1254572 T4324 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1254574 T4324 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1254574 T4324 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1254577 T4324 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1254577 T4324 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1254579 T4324 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1254580 T4324 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1254582 T4324 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1254582 T4324 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1254584 T4338 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@208189a6 name:ZooKeeperConnection Watcher:127.0.0.1:63380 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1254584 T4324 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1254585 T4324 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1254585 T4324 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1254587 T4324 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1254587 T4324 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1254588 T4341 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3ad5db99 name:ZooKeeperConnection Watcher:127.0.0.1:63380/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1254589 T4324 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1254589 T4324 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1254591 T4324 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf2/solrconfig.xml
[junit4] 2> 1254592 T4324 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.xml
[junit4] 2> 1254594 T4324 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
[junit4] 2> 1254595 T4324 oascc.SolrZkClient.makePath makePath: /configs/conf2/schema.xml
[junit4] 2> 1254696 T4324 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf2/enumsConfig.xml
[junit4] 2> 1254697 T4324 oascc.SolrZkClient.makePath makePath: /configs/conf2/enumsConfig.xml
[junit4] 2> 1254699 T4324 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1254699 T4324 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1254700 T4324 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
[junit4] 2> 1254701 T4324 oascc.SolrZkClient.makePath makePath: /configs/conf2/stopwords.txt
[junit4] 2> 1254702 T4324 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
[junit4] 2> 1254703 T4324 oascc.SolrZkClient.makePath makePath: /configs/conf2/protwords.txt
[junit4] 2> 1254704 T4324 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
[junit4] 2> 1254705 T4324 oascc.SolrZkClient.makePath makePath: /configs/conf2/currency.xml
[junit4] 2> 1254706 T4324 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
[junit4] 2> 1254707 T4324 oascc.SolrZkClient.makePath makePath: /configs/conf2/open-exchange-rates.json
[junit4] 2> 1254708 T4324 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 1254708 T4324 oascc.SolrZkClient.makePath makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 1254710 T4324 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
[junit4] 2> 1254710 T4324 oascc.SolrZkClient.makePath makePath: /configs/conf2/old_synonyms.txt
[junit4] 2> 1254711 T4324 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
[junit4] 2> 1254712 T4324 oascc.SolrZkClient.makePath makePath: /configs/conf2/synonyms.txt
[junit4] 2> 1254713 T4324 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
[junit4] 2> 1254714 T4324 oascc.SolrZkClient.makePath makePath: /configs/conf2/elevate.xml
[junit4] 2> 1255700 T4324 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/control-001/cores/collection1
[junit4] 2> 1255703 T4324 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1255707 T4324 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:63147
[junit4] 2> 1255708 T4324 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {coreRootDirectory=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/control-001/cores, hostContext=/, hostPort=63147}
[junit4] 2> 1255708 T4324 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@57bd06bf
[junit4] 2> 1255708 T4324 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/control-001/'
[junit4] 2> 1255738 T4324 oasc.SolrXmlConfig.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/control-001/solr.xml
[junit4] 2> 1255773 T4324 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/control-001/cores
[junit4] 2> 1255774 T4324 oasc.CoreContainer.<init> New CoreContainer 497224668
[junit4] 2> 1255774 T4324 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/control-001/]
[junit4] 2> 1255774 T4324 oasc.CoreContainer.load loading shared library: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/control-001/lib
[junit4] 2> 1255775 T4324 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/control-001/lib).
[junit4] 2> 1255784 T4324 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1255784 T4324 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1255784 T4324 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1255784 T4324 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1255785 T4324 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
[junit4] 2> 1255785 T4324 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1255785 T4324 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1255785 T4324 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1255785 T4324 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1255786 T4324 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1255786 T4324 oashc.HttpShardHandlerFactory.getParameter Setting useRetries to: false
[junit4] 2> 1255790 T4324 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1255791 T4324 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1255791 T4324 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1255791 T4324 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 1255792 T4324 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63380/solr
[junit4] 2> 1255792 T4324 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1255792 T4324 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1255793 T4324 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1255795 T4353 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3a03126b name:ZooKeeperConnection Watcher:127.0.0.1:63380 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1255796 T4324 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1255797 T4324 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1255799 T4324 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1255800 T4356 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4a9d3a48 name:ZooKeeperConnection Watcher:127.0.0.1:63380/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1255800 T4324 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1255802 T4324 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1255804 T4324 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1255806 T4324 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 1255808 T4324 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 1255810 T4324 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 1255811 T4324 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1255813 T4324 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1255814 T4324 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1255815 T4324 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63147_
[junit4] 2> 1255816 T4324 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63147_
[junit4] 2> 1255817 T4324 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 1255819 T4324 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1255820 T4324 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 1255822 T4324 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:63147_
[junit4] 2> 1255822 T4324 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1255823 T4324 oasc.Overseer.start Overseer (id=93647043439362053-127.0.0.1:63147_-n_0000000000) starting
[junit4] 2> 1255825 T4324 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1255831 T4324 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 1255832 T4358 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1255832 T4324 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1255832 T4357 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1255836 T4324 N:127.0.0.1:63147_ oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/control-001/cores
[junit4] 2> 1255838 T4324 N:127.0.0.1:63147_ oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {collection=control_collection, absoluteInstDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/control-001/cores/collection1/, dataDir=data/, loadOnStartup=true, instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/control-001/cores/collection1, shard=, config=solrconfig.xml, schema=schema.xml, name=collection1, coreNodeName=, transient=false}
[junit4] 2> 1255839 T4324 N:127.0.0.1:63147_ oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/control-001/cores/collection1/
[junit4] 2> 1255839 T4324 N:127.0.0.1:63147_ oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1255840 T4360 N:127.0.0.1:63147_ C:control_collection c:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 1255840 T4360 N:127.0.0.1:63147_ C:control_collection c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1255841 T4356 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1255841 T4360 N:127.0.0.1:63147_ oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1255842 T4357 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "numShards":"1",
[junit4] 2> "core":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:63147",
[junit4] 2> "operation":"state",
[junit4] 2> "shard":null,
[junit4] 2> "node_name":"127.0.0.1:63147_",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down"} current state version: 0
[junit4] 2> 1255842 T4357 oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "numShards":"1",
[junit4] 2> "core":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:63147",
[junit4] 2> "operation":"state",
[junit4] 2> "shard":null,
[junit4] 2> "node_name":"127.0.0.1:63147_",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down"}
[junit4] 2> 1255842 T4357 oasco.ClusterStateMutator.createCollection building a new cName: control_collection
[junit4] 2> 1255843 T4357 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1255844 T4356 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1256841 T4360 N:127.0.0.1:63147_ oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1256842 T4360 N:127.0.0.1:63147_ oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 1256842 T4360 N:127.0.0.1:63147_ oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1256842 T4360 N:127.0.0.1:63147_ oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 1256843 T4360 N:127.0.0.1:63147_ oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1256843 T4360 N:127.0.0.1:63147_ oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/control-001/cores/collection1/'
[junit4] 2> 1256856 T4360 N:127.0.0.1:63147_ oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
[junit4] 2> 1256858 T4360 N:127.0.0.1:63147_ oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 1256866 T4360 N:127.0.0.1:63147_ oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 1256881 T4360 N:127.0.0.1:63147_ oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.2.0
[junit4] 2> 1256915 T4360 N:127.0.0.1:63147_ oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1257016 T4360 N:127.0.0.1:63147_ oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 1257023 T4360 N:127.0.0.1:63147_ oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1257302 T4360 N:127.0.0.1:63147_ oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1257312 T4360 N:127.0.0.1:63147_ oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1257314 T4360 N:127.0.0.1:63147_ oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1257323 T4360 N:127.0.0.1:63147_ oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1257327 T4360 N:127.0.0.1:63147_ oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1257330 T4360 N:127.0.0.1:63147_ oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1257331 T4360 N:127.0.0.1:63147_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1257331 T4360 N:127.0.0.1:63147_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1257331 T4360 N:127.0.0.1:63147_ oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1257332 T4360 N:127.0.0.1:63147_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1257332 T4360 N:127.0.0.1:63147_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1257332 T4360 N:127.0.0.1:63147_ oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 1257333 T4360 N:127.0.0.1:63147_ c:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1257333 T4360 N:127.0.0.1:63147_ c:collection1 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/control-001/cores/collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/control-001/cores/collection1/data/
[junit4] 2> 1257333 T4360 N:127.0.0.1:63147_ c:collection1 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2127155
[junit4] 2> 1257334 T4360 N:127.0.0.1:63147_ c:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/control-001/cores/collection1/data
[junit4] 2> 1257334 T4360 N:127.0.0.1:63147_ c:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/control-001/cores/collection1/data/index/
[junit4] 2> 1257334 T4360 N:127.0.0.1:63147_ c:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1257335 T4360 N:127.0.0.1:63147_ c:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/control-001/cores/collection1/data/index
[junit4] 2> 1257335 T4360 N:127.0.0.1:63147_ c:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=34, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8097364795430507]
[junit4] 2> 1257336 T4360 N:127.0.0.1:63147_ c:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@7b08645a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@63f48fd0; maxCacheMB=0.12109375 maxMergeSizeMB=0.826171875)),segFN=segments_1,generation=1}
[junit4] 2> 1257336 T4360 N:127.0.0.1:63147_ c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1257340 T4360 N:127.0.0.1:63147_ c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1257340 T4360 N:127.0.0.1:63147_ c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1257341 T4360 N:127.0.0.1:63147_ c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1257341 T4360 N:127.0.0.1:63147_ c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1257341 T4360 N:127.0.0.1:63147_ c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1257341 T4360 N:127.0.0.1:63147_ c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1257342 T4360 N:127.0.0.1:63147_ c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1257342 T4360 N:127.0.0.1:63147_ c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1257342 T4360 N:127.0.0.1:63147_ c:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1257357 T4360 N:127.0.0.1:63147_ c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1257359 T4360 N:127.0.0.1:63147_ c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1257360 T4360 N:127.0.0.1:63147_ c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1257362 T4360 N:127.0.0.1:63147_ c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1257365 T4360 N:127.0.0.1:63147_ c:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /admin/plugins,/update/csv,/admin/mbeans,/admin/properties,/schema,/update/json,/update/json/docs,/admin/threads,/admin/luke,/admin/file,/admin/segments,standard,/admin/system,/update,/admin/logging,/replication,/config,/admin/ping,/get
[junit4] 2> 1257367 T4360 N:127.0.0.1:63147_ c:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1257368 T4360 N:127.0.0.1:63147_ c:collection1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1257368 T4360 N:127.0.0.1:63147_ c:collection1 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
[junit4] 2> 1257369 T4360 N:127.0.0.1:63147_ c:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1257370 T4360 N:127.0.0.1:63147_ c:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1257370 T4360 N:127.0.0.1:63147_ c:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=11, maxMergedSegmentMB=51.904296875, floorSegmentMB=0.9609375, forceMergeDeletesPctAllowed=11.590078393234766, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6104978885513848
[junit4] 2> 1257371 T4360 N:127.0.0.1:63147_ c:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@7b08645a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@63f48fd0; maxCacheMB=0.12109375 maxMergeSizeMB=0.826171875)),segFN=segments_1,generation=1}
[junit4] 2> 1257371 T4360 N:127.0.0.1:63147_ c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1257371 T4360 N:127.0.0.1:63147_ c:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@4583e198[collection1] main
[junit4] 2> 1257371 T4360 N:127.0.0.1:63147_ c:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 1257372 T4360 N:127.0.0.1:63147_ c:collection1 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1257372 T4360 N:127.0.0.1:63147_ c:collection1 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1257373 T4360 N:127.0.0.1:63147_ c:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1257373 T4360 N:127.0.0.1:63147_ c:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 1257373 T4360 N:127.0.0.1:63147_ c:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1257374 T4360 N:127.0.0.1:63147_ c:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1257374 T4360 N:127.0.0.1:63147_ c:collection1 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1257374 T4360 N:127.0.0.1:63147_ c:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 1257374 T4360 N:127.0.0.1:63147_ c:collection1 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 1257375 T4360 N:127.0.0.1:63147_ c:collection1 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1257375 T4361 N:127.0.0.1:63147_ c:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4583e198[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1257375 T4364 N:127.0.0.1:63147_ C:control_collection S:shard1 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:63147 collection:control_collection shard:shard1
[junit4] 2> 1257376 T4324 N:127.0.0.1:63147_ oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
[junit4] 2> 1257376 T4324 N:127.0.0.1:63147_ oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1257376 T4364 N:127.0.0.1:63147_ C:control_collection S:shard1 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 1257379 T4324 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1257380 T4324 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1257381 T4367 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2c13f269 name:ZooKeeperConnection Watcher:127.0.0.1:63380/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1257382 T4364 N:127.0.0.1:63147_ C:control_collection S:shard1 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1257382 T4324 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1257382 T4324 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1257383 T4324 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1257383 T4356 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1257383 T4364 N:127.0.0.1:63147_ C:control_collection S:shard1 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1257383 T4364 N:127.0.0.1:63147_ C:control_collection S:shard1 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C562 name=collection1 org.apache.solr.core.SolrCore@5a946575 url=http://127.0.0.1:63147/collection1 node=127.0.0.1:63147_ C562_STATE=coll:control_collection core:collection1 props:{core=collection1, base_url=http://127.0.0.1:63147, node_name=127.0.0.1:63147_, state=down}
[junit4] 2> 1257384 T4364 N:127.0.0.1:63147_ C:control_collection S:shard1 C562 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:63147/collection1/
[junit4] 2> 1257384 T4357 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 1257384 T4364 N:127.0.0.1:63147_ C:control_collection S:shard1 C562 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1257384 T4364 N:127.0.0.1:63147_ C:control_collection S:shard1 C562 oasc.SyncStrategy.syncToMe http://127.0.0.1:63147/collection1/ has no replicas
[junit4] 2> 1257385 T4364 N:127.0.0.1:63147_ C:control_collection S:shard1 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:63147/collection1/ shard1
[junit4] 2> 1257385 T4364 N:127.0.0.1:63147_ C:control_collection S:shard1 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 1257385 T4324 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1257385 T4356 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1257385 T4367 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1257386 T4324 oasc.AbstractFullDistribZkTestBase.createJettys Creating collection1 with stateFormat=2
[junit4] 2> 1257388 T4324 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1257388 T4324 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1257390 T4370 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b1c1da3 name:ZooKeeperConnection Watcher:127.0.0.1:63380/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1257390 T4324 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1257391 T4356 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1257391 T4324 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1257391 T4357 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:63147",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 2
[junit4] 2> 1257394 T4357 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"create",
[junit4] 2> "name":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "stateFormat":"2"} current state version: 2
[junit4] 2> 1257394 T4357 oasco.ClusterStateMutator.createCollection building a new cName: collection1
[junit4] 2> 1257395 T4356 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1257395 T4367 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1257401 T4356 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1257402 T4357 oasco.ZkStateWriter.writePendingUpdates going to create_collection /collections/collection1/state.json
[junit4] 2> 1257403 T4356 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1257403 T4367 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1257441 T4364 N:127.0.0.1:63147_ C:control_collection S:shard1 oasc.ZkController.register We are http://127.0.0.1:63147/collection1/ and leader is http://127.0.0.1:63147/collection1/
[junit4] 2> 1257442 T4364 N:127.0.0.1:63147_ C:control_collection S:shard1 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:63147
[junit4] 2> 1257442 T4364 N:127.0.0.1:63147_ C:control_collection S:shard1 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1257442 T4364 N:127.0.0.1:63147_ C:control_collection S:shard1 c:collection1 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 1257442 T4364 N:127.0.0.1:63147_ C:control_collection S:shard1 c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1257444 T4356 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1257445 T4357 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "numShards":"2",
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "base_url":"http://127.0.0.1:63147",
[junit4] 2> "operation":"state",
[junit4] 2> "shard":"shard1",
[junit4] 2> "node_name":"127.0.0.1:63147_",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active"} current state version: 4
[junit4] 2> 1257445 T4357 oasco.ReplicaMutator.updateState Update state numShards=2 message={
[junit4] 2> "numShards":"2",
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "base_url":"http://127.0.0.1:63147",
[junit4] 2> "operation":"state",
[junit4] 2> "shard":"shard1",
[junit4] 2> "node_name":"127.0.0.1:63147_",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active"}
[junit4] 2> 1257548 T4356 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1257548 T4367 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1258760 T4324 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/shard-1-001/cores/collection1
[junit4] 2> 1258763 T4324 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1 in directory /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/shard-1-001
[junit4] 2> 1258763 T4324 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1258766 T4324 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:24440
[junit4] 2> 1258767 T4324 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostContext=/, coreRootDirectory=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/shard-1-001/cores, solrconfig=solrconfig.xml, hostPort=24440}
[junit4] 2> 1258767 T4324 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@57bd06bf
[junit4] 2> 1258767 T4324 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/shard-1-001/'
[junit4] 2> 1258800 T4324 oasc.SolrXmlConfig.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/shard-1-001/solr.xml
[junit4] 2> 1258851 T4324 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/shard-1-001/cores
[junit4] 2> 1258852 T4324 oasc.CoreContainer.<init> New CoreContainer 1513881805
[junit4] 2> 1258852 T4324 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/shard-1-001/]
[junit4] 2> 1258852 T4324 oasc.CoreContainer.load loading shared library: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/shard-1-001/lib
[junit4] 2> 1258853 T4324 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/shard-1-001/lib).
[junit4] 2> 1258862 T4324 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1258863 T4324 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1258863 T4324 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1258863 T4324 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1258863 T4324 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
[junit4] 2> 1258864 T4324 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1258864 T4324 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1258864 T4324 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1258864 T4324 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1258864 T4324 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1258865 T4324 oashc.HttpShardHandlerFactory.getParameter Setting useRetries to: false
[junit4] 2> 1258869 T4324 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1258870 T4324 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1258870 T4324 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1258870 T4324 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 1258871 T4324 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63380/solr
[junit4] 2> 1258871 T4324 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1258871 T4324 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1258872 T4324 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1258873 T4382 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5b06123f name:ZooKeeperConnection Watcher:127.0.0.1:63380 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1258874 T4324 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1258875 T4324 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1258876 T4324 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1258877 T4385 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3eb19aac name:ZooKeeperConnection Watcher:127.0.0.1:63380/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1258877 T4324 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1258880 T4324 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1259884 T4324 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:24440_
[junit4] 2> 1259885 T4324 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:24440_
[junit4] 2> 1259889 T4324 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 1259891 T4324 N:127.0.0.1:24440_ oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/shard-1-001/cores
[junit4] 2> 1259893 T4324 N:127.0.0.1:24440_ oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {dataDir=data/, shard=, transient=false, schema=schema.xml, loadOnStartup=true, name=collection1, coreNodeName=, instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/shard-1-001/cores/collection1, absoluteInstDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/shard-1-001/cores/collection1/, config=solrconfig.xml, collection=collection1}
[junit4] 2> 1259894 T4324 N:127.0.0.1:24440_ oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/shard-1-001/cores/collection1/
[junit4] 2> 1259894 T4324 N:127.0.0.1:24440_ oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1259896 T4386 N:127.0.0.1:24440_ C:collection1 c:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 1259896 T4386 N:127.0.0.1:24440_ C:collection1 c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1259897 T4356 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1259898 T4386 N:127.0.0.1:24440_ oasc.ZkController.preRegister Registering watch for external collection collection1
[junit4] 2> 1259898 T4386 N:127.0.0.1:24440_ oascc.ZkStateReader.addZkWatch addZkWatch collection1
[junit4] 2> 1259898 T4357 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "numShards":"2",
[junit4] 2> "core":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:24440",
[junit4] 2> "operation":"state",
[junit4] 2> "shard":null,
[junit4] 2> "node_name":"127.0.0.1:24440_",
[junit4] 2> "collection":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down"} current state version: 5
[junit4] 2> 1259898 T4386 N:127.0.0.1:24440_ oascc.ZkStateReader.addZkWatch Updating collection state at /collections/collection1/state.json from ZooKeeper...
[junit4] 2> 1259899 T4357 oasco.ReplicaMutator.updateState Update state numShards=2 message={
[junit4] 2> "numShards":"2",
[junit4] 2> "core":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:24440",
[junit4] 2> "operation":"state",
[junit4] 2> "shard":null,
[junit4] 2> "node_name":"127.0.0.1:24440_",
[junit4] 2> "collection":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"down"}
[junit4] 2> 1259899 T4357 oasco.ReplicaMutator.updateState Collection already exists with numShards=2
[junit4] 2> 1259899 T4357 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1259899 T4386 N:127.0.0.1:24440_ oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 0
[junit4] 2> 1259900 T4386 N:127.0.0.1:24440_ oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1259900 T4357 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 0
[junit4] 2> 1259901 T4385 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 2)
[junit4] 2> 1259901 T4385 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 1
[junit4] 2> 1260900 T4386 N:127.0.0.1:24440_ oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1260901 T4386 N:127.0.0.1:24440_ oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1260901 T4386 N:127.0.0.1:24440_ oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1260902 T4386 N:127.0.0.1:24440_ oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1260902 T4386 N:127.0.0.1:24440_ oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1260902 T4386 N:127.0.0.1:24440_ oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/shard-1-001/cores/collection1/'
[junit4] 2> 1260920 T4386 N:127.0.0.1:24440_ oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
[junit4] 2> 1260923 T4386 N:127.0.0.1:24440_ oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 1260933 T4386 N:127.0.0.1:24440_ oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 1260956 T4386 N:127.0.0.1:24440_ oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.2.0
[junit4] 2> 1261008 T4386 N:127.0.0.1:24440_ oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1261109 T4386 N:127.0.0.1:24440_ oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 1261120 T4386 N:127.0.0.1:24440_ oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1261567 T4386 N:127.0.0.1:24440_ oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1261583 T4386 N:127.0.0.1:24440_ oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1261586 T4386 N:127.0.0.1:24440_ oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1261597 T4386 N:127.0.0.1:24440_ oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1261602 T4386 N:127.0.0.1:24440_ oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1261606 T4386 N:127.0.0.1:24440_ oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1261607 T4386 N:127.0.0.1:24440_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1261607 T4386 N:127.0.0.1:24440_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1261607 T4386 N:127.0.0.1:24440_ oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1261608 T4386 N:127.0.0.1:24440_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1261608 T4386 N:127.0.0.1:24440_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1261608 T4386 N:127.0.0.1:24440_ oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 1261608 T4386 N:127.0.0.1:24440_ c:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1261609 T4386 N:127.0.0.1:24440_ c:collection1 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/shard-1-001/cores/collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/shard-1-001/cores/collection1/data/
[junit4] 2> 1261609 T4386 N:127.0.0.1:24440_ c:collection1 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2127155
[junit4] 2> 1261610 T4386 N:127.0.0.1:24440_ c:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/shard-1-001/cores/collection1/data
[junit4] 2> 1261610 T4386 N:127.0.0.1:24440_ c:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/shard-1-001/cores/collection1/data/index/
[junit4] 2> 1261611 T4386 N:127.0.0.1:24440_ c:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/shard-1-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1261611 T4386 N:127.0.0.1:24440_ c:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest 336CA9E425036561-001/shard-1-001/cores/collection1/data/index
[junit4] 2> 1261612 T4386 N:127.0.0.1:24440_ c:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=34, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8097364795430507]
[junit4] 2> 1261613 T4386 N:127.0.0.1:24440_ c:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@7c343fc1 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4a45d79b; maxCacheMB=0.12109375 maxMergeSizeMB=0.826171875)),segFN=segments_1,generation=1}
[junit4] 2> 1261613 T4386 N:127.0.0.1:24440_ c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1261620 T4386 N:127.0.0.1:24440_ c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1261620 T4386 N:127.0.0.1:24440_ c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1261621 T4386 N:127.0.0.1:24440_ c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1261621 T4386 N:127.0.0.1:24440_ c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1261621 T4386 N:127.0.0.1:24440_ c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1261621 T4386 N:127.0.0.1:24440_ c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1261622 T4386 N:127.0.0.1:24440_ c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1261622 T4386 N:127.0.0.1:24440_ c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1261622 T4386 N:127.0.0.1:24440_ c:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1261644 T4386 N:127.0.0.1:24440_ c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1261646 T4386 N:127.0.0.1:24440_ c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1261649 T4386 N:127.0.0.1:24440_ c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1261651 T4386 N:127.0.0.1:24440_ c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1261659 T4386 N:127.0.0.1:24440_ c:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /admin/plugins,/update/csv,/admin/mbeans,/admin/properties,/schema,/update/json,/update/json/docs,/admin/threads,/admin/luke,/admin/file,/admin/segments,standard,/admin/system,/update,/admin/logging,/replication,/config,/admin/ping,/get
[junit4] 2> 1261662 T4386 N:127.0.0.1:24440_ c:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1261663 T4386 N:127.0.0.1:24440_ c:collection1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1261663 T4386 N:127.0.0.1:24440_ c:collection1 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
[junit4] 2> 1261665 T4386 N:127.0.0.1:24440_ c:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1261666 T4386 N:127.0.0.1:24440_ c:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1261667 T4386 N:127.0.0.1:24440_ c:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=11, maxMergedSegmentMB=51.904296875, floorSegmentMB=0.9609375, forceMergeDeletesPctAllowed=11.590078393234766, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6104978885513848
[junit4] 2> 1261668 T4386 N:127.0.0.1:24440_ c:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@7c343fc1 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4a45d79b; maxCacheMB=0.12109375 maxMergeSizeMB=0.826171875)),segFN=segments_1,generation=1}
[junit4] 2> 1261668 T4386 N:127.0.0.1:24440_ c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1261668 T4386 N:127.0.0.1:24440_ c:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@6e548a6a[collection1] main
[junit4] 2> 1261669 T4386 N:127.0.0.1:24440_ c:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1261669 T4386 N:127.0.0.1:24440_ c:collection1 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1261670 T4386 N:127.0.0.1:24440_ c:collection1 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1261670 T4386 N:127.0.0.1:24440_ c:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1261670 T4386 N:127.0.0.1:24440_ c:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 1261670 T4386 N:127.0.0.1:24440_ c:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1261671 T4386 N:127.0.0.1:24440_ c:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1261671 T4386 N:127.0.0.1:24440_ c:collection1 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1261671 T4386 N:127.0.0.1:24440_ c:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 1261672 T4386 N:127.0.0.1:24440_ c:collection1 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 1261673 T4387 N:127.0.0.1:24440_ c:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6e548a6a[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1261673 T4386 N:127.0.0.1:24440_ c:collection1 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1261674 T4390 N:127.0.0.1:24440_ C:collection1 S:shard1 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:24440 collection:collection1 shard:shard1
[junit4] 2> 1261674 T4324 N:127.0.0.1:24440_ oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
[junit4] 2> 1261675 T4324 N:127.0.0.1:24440_ oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1261675 T4390 N:127.0.0.1:24440_ C:collection1 S:shard1 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1261678 T4390 N:127.0.0.1:24440_ C:collection1 S:shard1 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1261680 T4356 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1261680 T4390 N:127.0.0.1:24440_ C:collection1 S:shard1 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1261680 T4390 N:127.0.0.1:24440_ C:collection1 S:shard1 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C563 name=collection1 org.apache.solr.core.SolrCore@7ae6ebc3 url=http://127.0.0.1:24440/collection1 node=127.0.0.1:24440_ C563_STATE=coll:collection1 core:collection1 props:{core=collection1, base_url=http://127.0.0.1:24440, node_name=127.0.0.1:24440_, state=down}
[junit4] 2> 1261680 T4390 N:127.0.0.1:24440_ C:collection1 S:shard1 C563 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:24440/collection1/
[junit4] 2> 1261680 T4357 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1"} current state version: 5
[junit4] 2> 1261680 T4390 N:127.0.0.1:24440_ C:collection1 S:shard1 C563 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1261681 T4390 N:127.0.0.1:24440_ C:collection1 S:shard1 C563 oasc.SyncStrategy.syncToMe http://127.0.0.1:24440/collection1/ has no replicas
[junit4] 2> 1261681 T4390 N:127.0.0.1:24440_ C:collection1 S:shard1 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:24440/collection1/ shard1
[junit4] 2> 1261681 T4390 N:127.0.0.1:24440_ C:collection1 S:shard1 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 1261681 T4357 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 1
[junit4] 2> 1261682 T4385 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 2)
[junit4] 2> 1261682 T4385 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 2
[junit4] 2> 1261684 T4357 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:24440",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 5
[junit4] 2> 1261685 T4357 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 2
[junit4] 2> 1261685 T4385 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 2)
[junit4] 2> 1261686 T4385 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 3
[junit4] 2> 1261687 T4356 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1261734 T4390 N:127.0.0.1:24440_ C:collection1 S:shard1 oasc.ZkController.register We are http://127.0.0.1:24440/collection1/ and leader is http://127.0.0.1:24440/collection1/
[junit4] 2> 1261735 T4390 N:127.0.0.1:24440_ C:collection1 S:shard1 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:24440
[junit4] 2> 1261735 T4390 N:127.0.0.1:24440_ C:collection1 S:shard1 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1261735 T4390 N:127.0.0.1:24440_ C:collection1 S:shard1 c:collection1 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 1261735 T4390 N:127.0.0.1:24440_ C:collection1 S:shard1 c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1261737 T4356 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1261738 T4357 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "numShards":"2",
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "base_url":"http://127.0.0.1:24440",
[junit4] 2> "operation":"state",
[junit4] 2> "shard":"shard1",
[junit4] 2> "node_name":"127.0.0.1:24440_",
[junit4] 2> "collection":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "state":"active"} current state version: 5
[junit4] 2> 1261738 T4357 oasco.ReplicaMutator.updateState Update state numShards=2 message={
[junit4] 2>
[...truncated too long message...]
e.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 2073870 T35602 oasc.SolrException.log ERROR Error shutting down core:java.lang.AssertionError: 1
[junit4] 2> at org.apache.solr.core.CachingDirectoryFactory.close(CachingDirectoryFactory.java:201)
[junit4] 2> at org.apache.solr.core.SolrCore.close(SolrCore.java:1176)
[junit4] 2> at org.apache.solr.core.SolrCores.close(SolrCores.java:117)
[junit4] 2> at org.apache.solr.core.CoreContainer.shutdown(CoreContainer.java:378)
[junit4] 2> at org.apache.solr.util.TestHarness.close(TestHarness.java:359)
[junit4] 2> at org.apache.solr.SolrTestCaseJ4.deleteCore(SolrTestCaseJ4.java:704)
[junit4] 2> at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:230)
[junit4] 2> at sun.reflect.GeneratedMethodAccessor32.invoke(Unknown Source)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:606)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:799)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.request.TestWriterPerf 336CA9E425036561-001
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=DefaultSimilarity, locale=fr_LU, timezone=America/Noronha
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_65 (64-bit)/cpus=16,threads=1,free=145835304,total=308805632
[junit4] 2> NOTE: All tests run in this JVM: [SliceStateTest, TestFoldingMultitermQuery, BadComponentTest, DeleteInactiveReplicaTest, TestSolrQueryParser, URLClassifyProcessorTest, SynonymTokenizerTest, HardAutoCommitTest, TestSuggestSpellingConverter, TestReplicationHandler, TestReplicationHandlerBackup, TestFieldCollectionResource, TestCursorMarkWithoutUniqueKey, TestLazyCores, ChangedSchemaMergeTest, QueryEqualityTest, TestSolr4Spatial2, StatsComponentTest, TestRTGBase, TestBM25SimilarityFactory, DistributedFacetPivotLongTailTest, TestFastWriter, HdfsUnloadDistributedZkTest, TestRemoteStreaming, TestDistributedSearch, TestConfigOverlay, HdfsDirectoryFactoryTest, LukeRequestHandlerTest, TestManagedSynonymFilterFactory, SolrRequestParserTest, SpatialFilterTest, CacheHeaderTest, BlockCacheTest, HdfsWriteToMultipleCollectionsTest, DistributedQueueTest, MigrateRouteKeyTest, TestReversedWildcardFilterFactory, DocumentBuilderTest, InfoHandlerTest, TestConfigReload, ConnectionManagerTest, TestMaxScoreQueryParser, SyncSliceTest, TestFieldTypeResource, TestFieldResource, TestReload, SuggestComponentTest, EnumFieldTest, MergeStrategyTest, SolrIndexSplitterTest, TestBinaryField, TestPerFieldSimilarity, TestHdfsUpdateLog, SOLR749Test, SolrCoreCheckLockOnStartupTest, AnalyticsMergeStrategyTest, TestCSVResponseWriter, TestNRTOpen, IndexBasedSpellCheckerTest, TestWriterPerf]
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestWriterPerf -Dtests.seed=336CA9E425036561 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=fr_LU -Dtests.timezone=America/Noronha -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.00s J2 | TestWriterPerf (suite) <<<
[junit4] > Throwable #1: java.lang.AssertionError: 1
[junit4] > at __randomizedtesting.SeedInfo.seed([336CA9E425036561]:0)
[junit4] > at org.apache.solr.core.CachingDirectoryFactory.close(CachingDirectoryFactory.java:201)
[junit4] > at org.apache.solr.core.SolrCore.close(SolrCore.java:1176)
[junit4] > at org.apache.solr.core.SolrCores.close(SolrCores.java:117)
[junit4] > at org.apache.solr.core.CoreContainer.shutdown(CoreContainer.java:378)
[junit4] > at org.apache.solr.util.TestHarness.close(TestHarness.java:359)
[junit4] > at org.apache.solr.SolrTestCaseJ4.deleteCore(SolrTestCaseJ4.java:704)
[junit4] > at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:230)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] Completed [307/482] on J2 in 14.20s, 1 test, 1 failure, 1 error <<< FAILURES!
[...truncated 578 lines...]
BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:543: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:484: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:61: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/extra-targets.xml:39: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build.xml:229: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/common-build.xml:511: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1434: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:991: There were test failures: 482 suites, 1914 tests, 1 suite-level error, 2 errors, 1 failure, 60 ignored (10 assumptions)
Total time: 171 minutes 51 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-NightlyTests-5.x #716
Archived 5 artifacts
Archive block size is 32768
Received 0 blocks and 826111466 bytes
Compression is 0.0%
Took 2 min 32 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-NightlyTests-5.x - Build # 815 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/815/
1 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.handler.TestReplicationHandler
Error Message:
file handle leaks: [FileChannel(/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/index-NIOFSDirectory-010/replication.properties), FileChannel(/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/index-NIOFSDirectory-004/replication.properties)]
Stack Trace:
java.lang.RuntimeException: file handle leaks: [FileChannel(/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/index-NIOFSDirectory-010/replication.properties), FileChannel(/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/index-NIOFSDirectory-004/replication.properties)]
at __randomizedtesting.SeedInfo.seed([303C02B061F337C5]:0)
at org.apache.lucene.mockfile.LeakFS.onClose(LeakFS.java:64)
at org.apache.lucene.mockfile.FilterFileSystem.close(FilterFileSystem.java:78)
at org.apache.lucene.mockfile.FilterFileSystem.close(FilterFileSystem.java:79)
at org.apache.lucene.util.TestRuleTemporaryFilesCleanup.afterAlways(TestRuleTemporaryFilesCleanup.java:212)
at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterAlways(TestRuleAdapter.java:31)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.Exception
at org.apache.lucene.mockfile.LeakFS.onOpen(LeakFS.java:47)
at org.apache.lucene.mockfile.HandleTrackingFS.callOpenHook(HandleTrackingFS.java:84)
at org.apache.lucene.mockfile.HandleTrackingFS.newFileChannel(HandleTrackingFS.java:191)
at org.apache.lucene.mockfile.FilterFileSystemProvider.newFileChannel(FilterFileSystemProvider.java:204)
at org.apache.lucene.mockfile.HandleTrackingFS.newFileChannel(HandleTrackingFS.java:163)
at java.nio.channels.FileChannel.open(FileChannel.java:287)
at java.nio.channels.FileChannel.open(FileChannel.java:334)
at org.apache.lucene.store.NIOFSDirectory.openInput(NIOFSDirectory.java:82)
at org.apache.lucene.util.LuceneTestCase.slowFileExists(LuceneTestCase.java:2487)
at org.apache.lucene.store.MockDirectoryWrapper.openInput(MockDirectoryWrapper.java:639)
at org.apache.solr.handler.ReplicationHandler.loadReplicationProperties(ReplicationHandler.java:977)
at org.apache.solr.handler.IndexFetcher.logReplicationTimeAndConfFiles(IndexFetcher.java:605)
at org.apache.solr.handler.IndexFetcher.cleanup(IndexFetcher.java:528)
at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:518)
at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:253)
at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:379)
at org.apache.solr.handler.ReplicationHandler$2.run(ReplicationHandler.java:1027)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
... 1 more
Build Log:
[...truncated 11314 lines...]
[junit4] Suite: org.apache.solr.handler.TestReplicationHandler
[junit4] 2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/init-core-data-001
[junit4] 2> 1684375 T5460 oas.SolrTestCaseJ4.setUp ###Starting doTestReplicateAfterWrite2Slave
[junit4] 2> 1684377 T5460 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-001/collection1
[junit4] 2> 1684396 T5460 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1684400 T5460 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:45418
[junit4] 2> 1684803 T5460 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostPort=45418, solr.data.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-001/collection1/data, hostContext=/solr}
[junit4] 2> 1684804 T5460 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@5fb271f1
[junit4] 2> 1684805 T5460 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-001/'
[junit4] 2> 1684861 T5460 oasc.SolrXmlConfig.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-001/solr.xml
[junit4] 2> 1684934 T5460 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-001/.
[junit4] 2> 1684935 T5460 oasc.CoreContainer.<init> New CoreContainer 54381125
[junit4] 2> 1684935 T5460 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-001/]
[junit4] 2> 1684936 T5460 oasc.CoreContainer.load loading shared library: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-001/lib
[junit4] 2> 1684937 T5460 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-001/lib).
[junit4] 2> 1684952 T5460 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1684952 T5460 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1684952 T5460 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1684953 T5460 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1684953 T5460 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
[junit4] 2> 1684953 T5460 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1684954 T5460 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1684954 T5460 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1684954 T5460 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1684955 T5460 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1684955 T5460 oashc.HttpShardHandlerFactory.getParameter Setting useRetries to: false
[junit4] 2> 1684966 T5460 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1684968 T5460 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1684968 T5460 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1684969 T5460 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 1684971 T5460 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-001/.
[junit4] 2> 1684974 T5460 oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {loadOnStartup=true, schema=schema.xml, config=solrconfig.xml, absoluteInstDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-001/./collection1/, instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-001/./collection1, dataDir=data/, name=collection1, transient=false}
[junit4] 2> 1684975 T5460 oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-001/./collection1/
[junit4] 2> 1684976 T5460 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1684977 T5470 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-001/./collection1/'
[junit4] 2> 1685021 T5470 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 1685046 T5470 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.2.0
[junit4] 2> 1685101 T5470 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1685102 T5470 oass.IndexSchema.readSchema Reading Solr Schema from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-001/./collection1/conf/schema.xml
[junit4] 2> 1685111 T5470 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1685132 T5470 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1685133 T5470 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-001/./collection1/
[junit4] 2> 1685133 T5470 c:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1685134 T5470 c:collection1 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-001/./collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-001/./collection1/data/
[junit4] 2> 1685134 T5470 c:collection1 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 1685136 T5470 c:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-001/./collection1/data
[junit4] 2> 1685137 T5470 c:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-001/./collection1/data/index/
[junit4] 2> 1685137 T5470 c:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-001/./collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1685138 T5470 c:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-001/./collection1/data/index
[junit4] 2> 1685138 T5470 c:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=13, maxMergeAtOnceExplicit=11, maxMergedSegmentMB=74.5966796875, floorSegmentMB=2.1953125, forceMergeDeletesPctAllowed=2.047079338343283, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.830014422319695
[junit4] 2> 1685139 T5470 c:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=RawDirectoryWrapper(RAMDirectory@48309204 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6cc269a2),segFN=segments_1,generation=1}
[junit4] 2> 1685139 T5470 c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1685142 T5470 c:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1685165 T5470 c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1685168 T5470 c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1685170 T5470 c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1685173 T5470 c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1685206 T5470 c:collection1 oasc.PluginBag.createPlugin requestHandler : 'lazy' created with startup=lazy
[junit4] 2> 1685206 T5470 c:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /schema,/admin/luke,/config,defaults,/admin/segments,/update/csv,/update,/get,/update/json/docs,/admin/properties,standard,/admin/logging,/admin/threads,/admin/ping,/update/json,lazy,/admin/plugins,/admin/mbeans,/admin/file,/admin/system,/replication
[junit4] 2> 1685209 T5470 c:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1685210 T5470 c:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1685210 T5470 c:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1685211 T5470 c:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@2c9e55ad
[junit4] 2> 1685212 T5470 c:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=RawDirectoryWrapper(RAMDirectory@48309204 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6cc269a2),segFN=segments_1,generation=1}
[junit4] 2> 1685212 T5470 c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1685212 T5470 c:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@54f451d5[collection1] main
[junit4] 2> 1685213 T5470 c:collection1 oasr.ManagedResourceStorage$FileStorageIO.configure File-based storage initialized to use dir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-001/./collection1/conf
[junit4] 2> 1685213 T5470 c:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {storageDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-001/./collection1/conf}
[junit4] 2> 1685214 T5470 c:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using file:dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-001/./collection1/conf
[junit4] 2> 1685215 T5470 c:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 1685215 T5470 c:collection1 oash.ReplicationHandler.inform Replication enabled for following config files: schema.xml,xslt/dummy.xsl
[junit4] 2> 1685215 T5470 c:collection1 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 1685215 T5471 c:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@54f451d5[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1685216 T5470 c:collection1 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1685216 T5460 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0
[junit4] 2> 1685217 T5460 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1685220 T5460 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-002/collection1
[junit4] 2> 1685240 T5460 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1685243 T5460 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:45420
[junit4] 2> 1685243 T5460 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostContext=/solr, hostPort=45420, solr.data.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-002/collection1/data}
[junit4] 2> 1685244 T5460 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@5fb271f1
[junit4] 2> 1685244 T5460 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-002/'
[junit4] 2> 1685301 T5460 oasc.SolrXmlConfig.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-002/solr.xml
[junit4] 2> 1685369 T5460 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-002/.
[junit4] 2> 1685370 T5460 oasc.CoreContainer.<init> New CoreContainer 1570794517
[junit4] 2> 1685370 T5460 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-002/]
[junit4] 2> 1685371 T5460 oasc.CoreContainer.load loading shared library: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-002/lib
[junit4] 2> 1685372 T5460 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-002/lib).
[junit4] 2> 1685387 T5460 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1685387 T5460 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1685388 T5460 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1685388 T5460 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1685388 T5460 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
[junit4] 2> 1685389 T5460 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1685389 T5460 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1685389 T5460 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1685390 T5460 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1685390 T5460 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1685391 T5460 oashc.HttpShardHandlerFactory.getParameter Setting useRetries to: false
[junit4] 2> 1685399 T5460 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1685401 T5460 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1685401 T5460 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1685401 T5460 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 1685403 T5460 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-002/.
[junit4] 2> 1685407 T5460 oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-002/./collection1, absoluteInstDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-002/./collection1/, name=collection1, dataDir=data/, loadOnStartup=true, transient=false, schema=schema.xml, config=solrconfig.xml}
[junit4] 2> 1685407 T5460 oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-002/./collection1/
[junit4] 2> 1685408 T5460 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1685408 T5482 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-002/./collection1/'
[junit4] 2> 1685457 T5482 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 1685483 T5482 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.2.0
[junit4] 2> 1685542 T5482 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1685543 T5482 oass.IndexSchema.readSchema Reading Solr Schema from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-002/./collection1/conf/schema.xml
[junit4] 2> 1685552 T5482 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1685576 T5482 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1685578 T5482 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-002/./collection1/
[junit4] 2> 1685578 T5482 c:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1685579 T5482 c:collection1 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-002/./collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-002/./collection1/data/
[junit4] 2> 1685579 T5482 c:collection1 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 1685581 T5482 c:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-002/./collection1/data
[junit4] 2> 1685582 T5482 c:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-002/./collection1/data/index/
[junit4] 2> 1685583 T5482 c:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-002/./collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1685583 T5482 c:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-002/./collection1/data/index
[junit4] 2> 1685584 T5482 c:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=13, maxMergeAtOnceExplicit=11, maxMergedSegmentMB=74.5966796875, floorSegmentMB=2.1953125, forceMergeDeletesPctAllowed=2.047079338343283, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.830014422319695
[junit4] 2> 1685584 T5482 c:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=RawDirectoryWrapper(RAMDirectory@2574c523 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@153a900b),segFN=segments_1,generation=1}
[junit4] 2> 1685585 T5482 c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1685587 T5482 c:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1685617 T5482 c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1685620 T5482 c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1685623 T5482 c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1685626 T5482 c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1685629 T5482 c:collection1 oasc.PluginBag.createPlugin requestHandler : 'lazy' created with startup=lazy
[junit4] 2> 1685629 T5482 c:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /schema,/admin/luke,/config,defaults,/admin/segments,/update/csv,/update,/get,/update/json/docs,/admin/properties,standard,/admin/logging,/admin/threads,/admin/ping,/update/json,lazy,/admin/plugins,/admin/mbeans,/admin/file,/admin/system,/replication
[junit4] 2> 1685632 T5482 c:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1685633 T5482 c:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1685633 T5482 c:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1685634 T5482 c:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@139b5e16
[junit4] 2> 1685634 T5482 c:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=RawDirectoryWrapper(RAMDirectory@2574c523 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@153a900b),segFN=segments_1,generation=1}
[junit4] 2> 1685634 T5482 c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1685635 T5482 c:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@318ccb41[collection1] main
[junit4] 2> 1685636 T5482 c:collection1 oasr.ManagedResourceStorage$FileStorageIO.configure File-based storage initialized to use dir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-002/./collection1/conf
[junit4] 2> 1685636 T5482 c:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {storageDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-002/./collection1/conf}
[junit4] 2> 1685637 T5482 c:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using file:dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-002/./collection1/conf
[junit4] 2> 1685638 T5482 c:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 1685647 T5482 c:collection1 oash.ReplicationHandler.setupPolling Poll Scheduled at an interval of 1000ms
[junit4] 2> 1685647 T5483 c:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@318ccb41[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1685648 T5482 c:collection1 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1685648 T5460 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0
[junit4] 2> 1685649 T5460 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> ASYNC NEW_CORE C1009 name=collection1 org.apache.solr.core.SolrCore@754e94a5
[junit4] 2> 1685653 T5469 c:collection1 C1009 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={q=*:*&sort=id+desc&wt=javabin&version=2} hits=0 status=0 QTime=1
[junit4] 2> 1685658 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[0]} 0 1
[junit4] 2> 1685661 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[1]} 0 0
[junit4] 2> 1685664 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[2]} 0 0
[junit4] 2> 1685667 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[3]} 0 0
[junit4] 2> 1685671 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[4]} 0 0
[junit4] 2> 1685674 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[5]} 0 0
[junit4] 2> 1685677 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[6]} 0 0
[junit4] 2> 1685680 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[7]} 0 0
[junit4] 2> 1685684 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[8]} 0 0
[junit4] 2> 1685688 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[9]} 0 0
[junit4] 2> 1685691 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[10]} 0 0
[junit4] 2> 1685695 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[11]} 0 0
[junit4] 2> 1685698 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[12]} 0 0
[junit4] 2> 1685701 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[13]} 0 0
[junit4] 2> 1685704 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[14]} 0 0
[junit4] 2> 1685707 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[15]} 0 0
[junit4] 2> 1685710 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[16]} 0 0
[junit4] 2> 1685713 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[17]} 0 0
[junit4] 2> 1685716 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[18]} 0 0
[junit4] 2> 1685719 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[19]} 0 0
[junit4] 2> 1685722 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[20]} 0 0
[junit4] 2> 1685725 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[21]} 0 0
[junit4] 2> 1685728 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[22]} 0 0
[junit4] 2> 1685732 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[23]} 0 0
[junit4] 2> 1685735 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[24]} 0 0
[junit4] 2> 1685738 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[25]} 0 0
[junit4] 2> 1685742 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[26]} 0 0
[junit4] 2> 1685746 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[27]} 0 0
[junit4] 2> 1685749 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[28]} 0 0
[junit4] 2> 1685752 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[29]} 0 0
[junit4] 2> 1685755 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[30]} 0 0
[junit4] 2> 1685758 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[31]} 0 0
[junit4] 2> 1685761 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[32]} 0 0
[junit4] 2> 1685766 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[33]} 0 0
[junit4] 2> 1685770 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[34]} 0 0
[junit4] 2> 1685774 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[35]} 0 0
[junit4] 2> 1685777 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[36]} 0 0
[junit4] 2> 1685781 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[37]} 0 0
[junit4] 2> 1685785 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[38]} 0 0
[junit4] 2> 1685789 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[39]} 0 0
[junit4] 2> 1685792 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[40]} 0 0
[junit4] 2> 1685796 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[41]} 0 0
[junit4] 2> 1685800 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[42]} 0 0
[junit4] 2> 1685803 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[43]} 0 0
[junit4] 2> 1685806 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[44]} 0 0
[junit4] 2> 1685809 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[45]} 0 0
[junit4] 2> 1685813 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[46]} 0 0
[junit4] 2> 1685817 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[47]} 0 0
[junit4] 2> 1685820 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[48]} 0 0
[junit4] 2> 1685824 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[49]} 0 1
[junit4] 2> 1685827 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[50]} 0 0
[junit4] 2> 1685830 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[51]} 0 0
[junit4] 2> 1685833 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[52]} 0 0
[junit4] 2> 1685836 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[53]} 0 0
[junit4] 2> 1685839 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[54]} 0 0
[junit4] 2> 1685842 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[55]} 0 0
[junit4] 2> 1685846 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[56]} 0 0
[junit4] 2> 1685848 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[57]} 0 0
[junit4] 2> 1685851 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[58]} 0 0
[junit4] 2> 1685855 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[59]} 0 0
[junit4] 2> 1685858 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[60]} 0 0
[junit4] 2> 1685861 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[61]} 0 0
[junit4] 2> 1685864 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[62]} 0 0
[junit4] 2> 1685867 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[63]} 0 0
[junit4] 2> 1685870 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[64]} 0 0
[junit4] 2> 1685874 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[65]} 0 0
[junit4] 2> 1685877 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[66]} 0 0
[junit4] 2> 1685881 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[67]} 0 1
[junit4] 2> 1685885 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[68]} 0 0
[junit4] 2> 1685888 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[69]} 0 0
[junit4] 2> 1685892 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[70]} 0 0
[junit4] 2> 1685895 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[71]} 0 0
[junit4] 2> 1685899 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[72]} 0 0
[junit4] 2> 1685902 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[73]} 0 0
[junit4] 2> 1685906 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[74]} 0 0
[junit4] 2> 1685910 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[75]} 0 0
[junit4] 2> 1685914 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[76]} 0 1
[junit4] 2> 1685917 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[77]} 0 0
[junit4] 2> 1685920 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[78]} 0 0
[junit4] 2> 1685923 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[79]} 0 0
[junit4] 2> 1685926 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[80]} 0 0
[junit4] 2> 1685930 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[81]} 0 0
[junit4] 2> 1685933 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[82]} 0 0
[junit4] 2> 1685936 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[83]} 0 0
[junit4] 2> 1685939 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[84]} 0 0
[junit4] 2> 1685942 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[85]} 0 0
[junit4] 2> 1685945 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[86]} 0 0
[junit4] 2> 1685948 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[87]} 0 0
[junit4] 2> 1685951 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[88]} 0 0
[junit4] 2> 1685954 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[89]} 0 0
[junit4] 2> 1685957 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[90]} 0 0
[junit4] 2> 1685961 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[91]} 0 0
[junit4] 2> 1685964 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[92]} 0 0
[junit4] 2> 1685967 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[93]} 0 0
[junit4] 2> 1685970 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[94]} 0 0
[junit4] 2> 1685973 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[95]} 0 0
[junit4] 2> 1685976 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[96]} 0 0
[junit4] 2> 1685979 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[97]} 0 0
[junit4] 2> 1685982 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[98]} 0 0
[junit4] 2> 1685985 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[99]} 0 0
[junit4] 2> 1685988 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[100]} 0 0
[junit4] 2> 1685991 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[101]} 0 0
[junit4] 2> 1685994 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[102]} 0 0
[junit4] 2> 1685997 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[103]} 0 0
[junit4] 2> 1686000 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[104]} 0 0
[junit4] 2> 1686003 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[105]} 0 0
[junit4] 2> 1686006 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[106]} 0 0
[junit4] 2> 1686009 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[107]} 0 0
[junit4] 2> 1686012 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[108]} 0 0
[junit4] 2> 1686015 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[109]} 0 0
[junit4] 2> 1686018 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[110]} 0 0
[junit4] 2> 1686021 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[111]} 0 0
[junit4] 2> 1686024 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[112]} 0 0
[junit4] 2> 1686027 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[113]} 0 0
[junit4] 2> 1686030 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[114]} 0 0
[junit4] 2> 1686033 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[115]} 0 0
[junit4] 2> 1686036 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[116]} 0 0
[junit4] 2> 1686039 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[117]} 0 0
[junit4] 2> 1686042 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[118]} 0 0
[junit4] 2> 1686045 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[119]} 0 0
[junit4] 2> 1686049 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[120]} 0 0
[junit4] 2> 1686052 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[121]} 0 0
[junit4] 2> 1686057 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[122]} 0 0
[junit4] 2> 1686061 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[123]} 0 0
[junit4] 2> 1686064 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[124]} 0 0
[junit4] 2> 1686067 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[125]} 0 0
[junit4] 2> 1686070 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[126]} 0 0
[junit4] 2> 1686073 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[127]} 0 0
[junit4] 2> 1686076 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[128]} 0 0
[junit4] 2> 1686079 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[129]} 0 0
[junit4] 2> 1686083 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[130]} 0 0
[junit4] 2> 1686086 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[131]} 0 0
[junit4] 2> 1686089 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[132]} 0 0
[junit4] 2> 1686093 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[133]} 0 0
[junit4] 2> 1686096 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[134]} 0 0
[junit4] 2> 1686099 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[135]} 0 0
[junit4] 2> 1686102 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[136]} 0 0
[junit4] 2> 1686105 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[137]} 0 0
[junit4] 2> 1686108 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[138]} 0 0
[junit4] 2> 1686111 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[139]} 0 0
[junit4] 2> 1686114 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[140]} 0 0
[junit4] 2> 1686117 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[141]} 0 0
[junit4] 2> 1686121 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[142]} 0 0
[junit4] 2> 1686125 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[143]} 0 0
[junit4] 2> 1686128 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[144]} 0 0
[junit4] 2> 1686131 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[145]} 0 0
[junit4] 2> 1686134 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[146]} 0 0
[junit4] 2> 1686137 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[147]} 0 0
[junit4] 2> 1686141 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[148]} 0 0
[junit4] 2> 1686146 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[149]} 0 1
[junit4] 2> 1686146 T5465 c:collection1 C1009 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 1686149 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[150]} 0 0
[junit4] 2> 1686152 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[151]} 0 0
[junit4] 2> 1686155 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[152]} 0 0
[junit4] 2> 1686158 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[153]} 0 0
[junit4] 2> 1686161 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[154]} 0 0
[junit4] 2> 1686164 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[155]} 0 0
[junit4] 2> 1686168 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[156]} 0 0
[junit4] 2> 1686171 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[157]} 0 0
[junit4] 2> 1686175 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[158]} 0 1
[junit4] 2> 1686178 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[159]} 0 0
[junit4] 2> 1686181 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[160]} 0 0
[junit4] 2> 1686184 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[161]} 0 0
[junit4] 2> 1686188 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[162]} 0 0
[junit4] 2> 1686191 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[163]} 0 0
[junit4] 2> 1686194 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[164]} 0 0
[junit4] 2> 1686197 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[165]} 0 0
[junit4] 2> 1686200 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[166]} 0 0
[junit4] 2> 1686203 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[167]} 0 0
[junit4] 2> 1686207 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[168]} 0 0
[junit4] 2> 1686210 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[169]} 0 0
[junit4] 2> 1686213 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[170]} 0 0
[junit4] 2> 1686217 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[171]} 0 0
[junit4] 2> 1686220 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[172]} 0 0
[junit4] 2> 1686223 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[173]} 0 0
[junit4] 2> 1686226 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[174]} 0 0
[junit4] 2> 1686229 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[175]} 0 0
[junit4] 2> 1686240 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[176]} 0 7
[junit4] 2> 1686244 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[177]} 0 1
[junit4] 2> 1686247 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[178]} 0 0
[junit4] 2> 1686250 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[179]} 0 0
[junit4] 2> 1686253 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[180]} 0 0
[junit4] 2> 1686256 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[181]} 0 0
[junit4] 2> 1686259 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[182]} 0 0
[junit4] 2> 1686263 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[183]} 0 1
[junit4] 2> 1686266 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[184]} 0 0
[junit4] 2> 1686270 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[185]} 0 0
[junit4] 2> 1686275 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[186]} 0 1
[junit4] 2> 1686279 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[187]} 0 1
[junit4] 2> 1686282 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[188]} 0 0
[junit4] 2> 1686285 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[189]} 0 0
[junit4] 2> 1686289 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[190]} 0 0
[junit4] 2> 1686293 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[191]} 0 0
[junit4] 2> 1686296 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[192]} 0 0
[junit4] 2> 1686301 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[193]} 0 1
[junit4] 2> 1686305 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[194]} 0 1
[junit4] 2> 1686309 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[195]} 0 1
[junit4] 2> 1686314 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[196]} 0 1
[junit4] 2> 1686318 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[197]} 0 1
[junit4] 2> 1686323 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[198]} 0 1
[junit4] 2> 1686326 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[199]} 0 0
[junit4] 2> 1686329 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[200]} 0 0
[junit4] 2> 1686332 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[201]} 0 0
[junit4] 2> 1686336 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[202]} 0 0
[junit4] 2> 1686340 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[203]} 0 0
[junit4] 2> 1686344 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[204]} 0 0
[junit4] 2> 1686349 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[205]} 0 1
[junit4] 2> 1686352 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[206]} 0 0
[junit4] 2> 1686356 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[207]} 0 0
[junit4] 2> 1686359 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[208]} 0 0
[junit4] 2> 1686362 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[209]} 0 0
[junit4] 2> 1686366 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[210]} 0 0
[junit4] 2> 1686371 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[211]} 0 1
[junit4] 2> 1686374 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[212]} 0 0
[junit4] 2> 1686379 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[213]} 0 1
[junit4] 2> 1686383 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[214]} 0 1
[junit4] 2> 1686386 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[215]} 0 0
[junit4] 2> 1686389 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[216]} 0 0
[junit4] 2> 1686392 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[217]} 0 0
[junit4] 2> 1686395 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[218]} 0 0
[junit4] 2> 1686398 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[219]} 0 0
[junit4] 2> 1686402 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[220]} 0 1
[junit4] 2> 1686405 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[221]} 0 0
[junit4] 2> 1686408 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[222]} 0 0
[junit4] 2> 1686413 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[223]} 0 1
[junit4] 2> 1686416 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[224]} 0 0
[junit4] 2> 1686419 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[225]} 0 0
[junit4] 2> 1686422 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[226]} 0 0
[junit4] 2> 1686425 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[227]} 0 0
[junit4] 2> 1686428 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[228]} 0 0
[junit4] 2> 1686432 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[229]} 0 0
[junit4] 2> 1686435 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[230]} 0 0
[junit4] 2> 1686438 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[231]} 0 0
[junit4] 2> 1686441 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[232]} 0 0
[junit4] 2> 1686444 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[233]} 0 0
[junit4] 2> 1686448 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[234]} 0 0
[junit4] 2> 1686451 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[235]} 0 0
[junit4] 2> 1686454 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[236]} 0 0
[junit4] 2> 1686457 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[237]} 0 0
[junit4] 2> 1686460 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[238]} 0 0
[junit4] 2> 1686463 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[239]} 0 0
[junit4] 2> 1686466 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[240]} 0 0
[junit4] 2> 1686469 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[241]} 0 0
[junit4] 2> 1686473 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[242]} 0 1
[junit4] 2> 1686476 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[243]} 0 0
[junit4] 2> 1686480 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[244]} 0 0
[junit4] 2> 1686484 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[245]} 0 0
[junit4] 2> 1686487 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[246]} 0 0
[junit4] 2> 1686490 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[247]} 0 0
[junit4] 2> 1686493 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[248]} 0 0
[junit4] 2> 1686496 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[249]} 0 0
[junit4] 2> 1686499 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[250]} 0 0
[junit4] 2> 1686502 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[251]} 0 0
[junit4] 2> 1686505 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[252]} 0 0
[junit4] 2> 1686509 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[253]} 0 0
[junit4] 2> 1686512 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[254]} 0 0
[junit4] 2> 1686515 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[255]} 0 0
[junit4] 2> 1686518 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[256]} 0 0
[junit4] 2> 1686521 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[257]} 0 0
[junit4] 2> 1686524 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[258]} 0 0
[junit4] 2> 1686528 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[259]} 0 0
[junit4] 2> 1686531 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[260]} 0 0
[junit4] 2> 1686534 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[261]} 0 0
[junit4] 2> 1686538 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[262]} 0 1
[junit4] 2> 1686542 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[263]} 0 1
[junit4] 2> 1686545 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[264]} 0 0
[junit4] 2> 1686548 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[265]} 0 0
[junit4] 2> 1686551 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[266]} 0 0
[junit4] 2> 1686554 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[267]} 0 0
[junit4] 2> 1686557 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[268]} 0 0
[junit4] 2> 1686560 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[269]} 0 0
[junit4] 2> 1686565 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[270]} 0 1
[junit4] 2> 1686568 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[271]} 0 0
[junit4] 2> 1686571 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[272]} 0 0
[junit4] 2> 1686574 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[273]} 0 0
[junit4] 2> 1686578 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[274]} 0 1
[junit4] 2> 1686581 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[275]} 0 0
[junit4] 2> 1686586 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[276]} 0 0
[junit4] 2> 1686591 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[277]} 0 0
[junit4] 2> 1686594 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[278]} 0 0
[junit4] 2> 1686598 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[279]} 0 0
[junit4] 2> 1686601 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[280]} 0 0
[junit4] 2> 1686605 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[281]} 0 1
[junit4] 2> 1686608 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[282]} 0 0
[junit4] 2> 1686612 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[283]} 0 0
[junit4] 2> 1686615 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[284]} 0 0
[junit4] 2> 1686618 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[285]} 0 0
[junit4] 2> 1686621 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[286]} 0 0
[junit4] 2> 1686625 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[287]} 0 0
[junit4] 2> 1686630 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[288]} 0 0
[junit4] 2> 1686634 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[289]} 0 0
[junit4] 2> 1686638 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[290]} 0 0
[junit4] 2> 1686642 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[291]} 0 0
[junit4] 2> 1686646 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[292]} 0 1
[junit4] 2> 1686650 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[293]} 0 1
[junit4] 2> 1686653 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[294]} 0 0
[junit4] 2> 1686656 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[295]} 0 0
[junit4] 2> 1686659 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[296]} 0 0
[junit4] 2> 1686664 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[297]} 0 0
[junit4] 2> 1686669 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[298]} 0 1
[junit4] 2> 1686672 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[299]} 0 0
[junit4] 2> 1686676 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[300]} 0 0
[junit4] 2> 1686679 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[301]} 0 0
[junit4] 2> 1686682 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[302]} 0 0
[junit4] 2> 1686685 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[303]} 0 0
[junit4] 2> 1686688 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[304]} 0 0
[junit4] 2> 1686691 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[305]} 0 0
[junit4] 2> 1686693 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[306]} 0 0
[junit4] 2> 1686696 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[307]} 0 0
[junit4] 2> 1686699 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[308]} 0 0
[junit4] 2> 1686704 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[309]} 0 1
[junit4] 2> 1686707 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[310]} 0 0
[junit4] 2> 1686711 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[311]} 0 0
[junit4] 2> 1686714 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[312]} 0 0
[junit4] 2> 1686717 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[313]} 0 0
[junit4] 2> 1686720 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[314]} 0 0
[junit4] 2> 1686723 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[315]} 0 0
[junit4] 2> 1686726 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[316]} 0 0
[junit4] 2> 1686729 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[317]} 0 0
[junit4] 2> 1686733 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[318]} 0 0
[junit4] 2> 1686736 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[319]} 0 0
[junit4] 2> 1686739 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[320]} 0 0
[junit4] 2> 1686742 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[321]} 0 0
[junit4] 2> 1686745 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[322]} 0 0
[junit4] 2> 1686748 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[323]} 0 0
[junit4] 2> 1686752 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[324]} 0 1
[junit4] 2> 1686755 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[325]} 0 0
[junit4] 2> 1686758 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[326]} 0 0
[junit4] 2> 1686761 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[327]} 0 0
[junit4] 2> 1686764 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[328]} 0 0
[junit4] 2> 1686767 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[329]} 0 0
[junit4] 2> 1686770 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[330]} 0 0
[junit4] 2> 1686773 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[331]} 0 0
[junit4] 2> 1686776 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[332]} 0 0
[junit4] 2> 1686779 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[333]} 0 0
[junit4] 2> 1686783 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[334]} 0 0
[junit4] 2> 1686786 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[335]} 0 0
[junit4] 2> 1686790 T5469 c:collection1 C1009 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[336]} 0 1
[junit4] 2> 1686793 T5469 c:collection1 C1009 oasup.Lo
[...truncated too long message...]
ulative_errors=0}
[junit4] 2> 2907526 T5460 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 2907526 T5460 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 2907527 T5460 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 2907528 T5460 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 2907529 T5460 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 2907529 T5460 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-028/./collection1/data/index.20150413060227652 [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-028/./collection1/data/index.20150413060227652;done=false>>]
[junit4] 2> 2907530 T5460 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-028/./collection1/data/index.20150413060227652
[junit4] 2> 2907530 T5460 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-028/./collection1/data [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-028/./collection1/data;done=false>>]
[junit4] 2> 2907530 T5460 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/solr-instance-028/./collection1/data
[junit4] 2> 2907531 T5460 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4] 2> 2907728 T5460 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> 1223608 T5459 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene50), sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=de, timezone=Asia/Dili
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_65 (64-bit)/cpus=16,threads=1,free=37412328,total=243793920
[junit4] 2> NOTE: All tests run in this JVM: [TestManagedStopFilterFactory, TestStressReorder, TestExactStatsCache, HighlighterConfigTest, RequiredFieldsTest, MinimalSchemaTest, HdfsDirectoryTest, QueryParsingTest, SegmentsInfoRequestHandlerTest, ReplicationFactorTest, TestCollationField, SharedFSAutoReplicaFailoverUtilsTest, SpellCheckCollatorTest, TestMissingGroups, TestMacros, OverseerTest, TestSolrDynamicMBean, DeleteShardTest, OpenExchangeRatesOrgProviderTest, ShardRoutingCustomTest, SimpleFacetsTest, TestImplicitCoreProperties, TestCoreContainer, TestXIncludeConfig, TestCustomSort, TestFastLRUCache, TestRandomFaceting, TestSolrCoreProperties, TestManagedSchemaFieldTypeResource, CloudExitableDirectoryReaderTest, TestUpdate, ParsingFieldUpdateProcessorsTest, ExternalFileFieldSortTest, SolrTestCaseJ4Test, SuggesterTest, CustomCollectionTest, PolyFieldTest, DocValuesMissingTest, TestLRUStatsCache, TestSolrConfigHandler, TimeZoneUtilsTest, RemoteQueryErrorTest, RecoveryZkTest, UUIDFieldTest, SolrIndexConfigTest, DistributedQueryElevationComponentTest, OverseerCollectionProcessorTest, TestDynamicLoading, TestNoOpRegenerator, TestClusterStateMutator, SolrCmdDistributorTest, ZkSolrClientTest, TestManagedResourceStorage, TestSort, TestSolrDeletionPolicy2, HdfsSyncSliceTest, TestFaceting, BasicDistributedZkTest, BasicDistributedZk2Test, UnloadDistributedZkTest, SyncSliceTest, ShardRoutingTest, TestReplicationHandler]
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestReplicationHandler -Dtests.seed=303C02B061F337C5 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=de -Dtests.timezone=Asia/Dili -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J0 | TestReplicationHandler (suite) <<<
[junit4] > Throwable #1: java.lang.RuntimeException: file handle leaks: [FileChannel(/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/index-NIOFSDirectory-010/replication.properties), FileChannel(/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.handler.TestReplicationHandler 303C02B061F337C5-001/index-NIOFSDirectory-004/replication.properties)]
[junit4] > at __randomizedtesting.SeedInfo.seed([303C02B061F337C5]:0)
[junit4] > at org.apache.lucene.mockfile.LeakFS.onClose(LeakFS.java:64)
[junit4] > at org.apache.lucene.mockfile.FilterFileSystem.close(FilterFileSystem.java:78)
[junit4] > at org.apache.lucene.mockfile.FilterFileSystem.close(FilterFileSystem.java:79)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > Caused by: java.lang.Exception
[junit4] > at org.apache.lucene.mockfile.LeakFS.onOpen(LeakFS.java:47)
[junit4] > at org.apache.lucene.mockfile.HandleTrackingFS.callOpenHook(HandleTrackingFS.java:84)
[junit4] > at org.apache.lucene.mockfile.HandleTrackingFS.newFileChannel(HandleTrackingFS.java:191)
[junit4] > at org.apache.lucene.mockfile.FilterFileSystemProvider.newFileChannel(FilterFileSystemProvider.java:204)
[junit4] > at org.apache.lucene.mockfile.HandleTrackingFS.newFileChannel(HandleTrackingFS.java:163)
[junit4] > at java.nio.channels.FileChannel.open(FileChannel.java:287)
[junit4] > at java.nio.channels.FileChannel.open(FileChannel.java:334)
[junit4] > at org.apache.lucene.store.NIOFSDirectory.openInput(NIOFSDirectory.java:82)
[junit4] > at org.apache.lucene.util.LuceneTestCase.slowFileExists(LuceneTestCase.java:2487)
[junit4] > at org.apache.lucene.store.MockDirectoryWrapper.openInput(MockDirectoryWrapper.java:639)
[junit4] > at org.apache.solr.handler.ReplicationHandler.loadReplicationProperties(ReplicationHandler.java:977)
[junit4] > at org.apache.solr.handler.IndexFetcher.logReplicationTimeAndConfFiles(IndexFetcher.java:605)
[junit4] > at org.apache.solr.handler.IndexFetcher.cleanup(IndexFetcher.java:528)
[junit4] > at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:518)
[junit4] > at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:253)
[junit4] > at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:379)
[junit4] > at org.apache.solr.handler.ReplicationHandler$2.run(ReplicationHandler.java:1027)
[junit4] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
[junit4] > at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
[junit4] > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
[junit4] > at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] > ... 1 more
[junit4] Completed [437/482] on J0 in 1224.17s, 13 tests, 1 error <<< FAILURES!
[...truncated 147 lines...]
BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:543: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:484: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:61: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/extra-targets.xml:39: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build.xml:229: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/common-build.xml:510: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1434: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:991: There were test failures: 482 suites, 1914 tests, 1 suite-level error, 60 ignored (10 assumptions)
Total time: 157 minutes 18 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-NightlyTests-5.x #716
Archived 5 artifacts
Archive block size is 32768
Received 0 blocks and 895703055 bytes
Compression is 0.0%
Took 2 min 38 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-NightlyTests-5.x - Build # 814 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/814/
1 tests failed.
FAILED: org.apache.solr.cloud.RecoveryZkTest.test
Error Message:
shard1 is not consistent. Got 862 from http://127.0.0.1:63103/ne_/s/collection1lastClient and got 192 from http://127.0.0.1:63106/ne_/s/collection1
Stack Trace:
java.lang.AssertionError: shard1 is not consistent. Got 862 from http://127.0.0.1:63103/ne_/s/collection1lastClient and got 192 from http://127.0.0.1:63106/ne_/s/collection1
at __randomizedtesting.SeedInfo.seed([2C3F78376E526F98:A46B47EDC0AE0260]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.RecoveryZkTest.test(RecoveryZkTest.java:123)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 10476 lines...]
[junit4] Suite: org.apache.solr.cloud.RecoveryZkTest
[junit4] 2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/init-core-data-001
[junit4] 2> 1381073 T5127 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (true)
[junit4] 2> 1381074 T5127 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /ne_/s
[junit4] 2> 1381079 T5127 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1381080 T5128 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1381180 T5127 oasc.ZkTestServer.run start zk server on port:41594
[junit4] 2> 1381181 T5127 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1381182 T5127 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1381185 T5135 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5e4f0b0 name:ZooKeeperConnection Watcher:127.0.0.1:41594 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1381186 T5127 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1381186 T5127 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1381186 T5127 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1381189 T5127 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1381190 T5127 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1381191 T5138 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@39c60626 name:ZooKeeperConnection Watcher:127.0.0.1:41594/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1381191 T5127 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1381192 T5127 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1381192 T5127 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 1381194 T5127 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 1381196 T5127 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 1381197 T5127 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 1381199 T5127 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1381200 T5127 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1381203 T5127 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 1381203 T5127 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 1381306 T5127 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1381307 T5127 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1381309 T5127 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1381310 T5127 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1381312 T5127 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1381313 T5127 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 1381315 T5127 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1381315 T5127 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 1381317 T5127 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1381318 T5127 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1381320 T5127 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1381321 T5127 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1381323 T5127 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1381324 T5127 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1381326 T5127 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1381326 T5127 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1381328 T5127 oasc.AbstractZkTestCase.putConfig put /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1381329 T5127 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1382587 T5127 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/control-001/cores/collection1
[junit4] 2> 1382591 T5127 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1382596 T5127 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:63098
[junit4] 2> 1382596 T5127 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostPort=63098, coreRootDirectory=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/control-001/cores, hostContext=/ne_/s, solr.data.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/tempDir-001/control/data}
[junit4] 2> 1382597 T5127 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@231bf785
[junit4] 2> 1382597 T5127 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/control-001/'
[junit4] 2> 1382645 T5127 oasc.SolrXmlConfig.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/control-001/solr.xml
[junit4] 2> 1382709 T5127 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/control-001/cores
[junit4] 2> 1382709 T5127 oasc.CoreContainer.<init> New CoreContainer 972999988
[junit4] 2> 1382710 T5127 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/control-001/]
[junit4] 2> 1382710 T5127 oasc.CoreContainer.load loading shared library: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/control-001/lib
[junit4] 2> 1382711 T5127 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/control-001/lib).
[junit4] 2> 1382724 T5127 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1382725 T5127 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1382725 T5127 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1382725 T5127 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1382726 T5127 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
[junit4] 2> 1382726 T5127 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1382726 T5127 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1382726 T5127 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1382727 T5127 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1382727 T5127 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1382727 T5127 oashc.HttpShardHandlerFactory.getParameter Setting useRetries to: false
[junit4] 2> 1382734 T5127 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1382735 T5127 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1382736 T5127 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1382736 T5127 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 1382737 T5127 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41594/solr
[junit4] 2> 1382737 T5127 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1382737 T5127 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1382738 T5127 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1382740 T5150 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5679af85 name:ZooKeeperConnection Watcher:127.0.0.1:41594 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1382741 T5127 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1382741 T5127 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1382743 T5127 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1382744 T5153 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13ad131f name:ZooKeeperConnection Watcher:127.0.0.1:41594/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1382745 T5127 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1382746 T5127 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1382748 T5127 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1382751 T5127 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 1382753 T5127 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 1382755 T5127 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 1382757 T5127 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1382759 T5127 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1382760 T5127 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1382762 T5127 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63098_ne_%2Fs
[junit4] 2> 1382762 T5127 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63098_ne_%2Fs
[junit4] 2> 1382764 T5127 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 1382766 T5127 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1382767 T5127 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 1382769 T5127 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:63098_ne_%2Fs
[junit4] 2> 1382769 T5127 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1382771 T5127 oasc.Overseer.start Overseer (id=93635670365437955-127.0.0.1:63098_ne_%2Fs-n_0000000000) starting
[junit4] 2> 1382773 T5127 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1382780 T5127 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 1382780 T5155 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1382780 T5127 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1382781 T5154 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1382784 T5127 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/control-001/cores
[junit4] 2> 1382786 T5127 oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {shard=, instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/control-001/cores/collection1, loadOnStartup=true, collection=control_collection, absoluteInstDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/control-001/cores/collection1/, coreNodeName=, config=solrconfig.xml, name=collection1, transient=false, dataDir=data/, schema=schema.xml}
[junit4] 2> 1382786 T5127 oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/control-001/cores/collection1/
[junit4] 2> 1382787 T5127 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1382788 T5157 C:control_collection c:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 1382788 T5157 C:control_collection c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1382789 T5153 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1382789 T5157 C:control_collection c:collection1 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1382790 T5154 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "roles":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "shard":null,
[junit4] 2> "core":"collection1",
[junit4] 2> "node_name":"127.0.0.1:63098_ne_%2Fs",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:63098/ne_/s",
[junit4] 2> "operation":"state",
[junit4] 2> "numShards":"1"} current state version: 0
[junit4] 2> 1382790 T5154 oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "roles":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "shard":null,
[junit4] 2> "core":"collection1",
[junit4] 2> "node_name":"127.0.0.1:63098_ne_%2Fs",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:63098/ne_/s",
[junit4] 2> "operation":"state",
[junit4] 2> "numShards":"1"}
[junit4] 2> 1382790 T5154 oasco.ClusterStateMutator.createCollection building a new cName: control_collection
[junit4] 2> 1382791 T5154 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1382792 T5153 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1383789 T5157 C:control_collection c:collection1 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1383790 T5157 C:control_collection c:collection1 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 1383791 T5157 C:control_collection c:collection1 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1383791 T5157 C:control_collection c:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 1383792 T5157 C:control_collection c:collection1 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1383792 T5157 C:control_collection c:collection1 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/control-001/cores/collection1/'
[junit4] 2> 1383809 T5157 C:control_collection c:collection1 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
[junit4] 2> 1383812 T5157 C:control_collection c:collection1 oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 1383823 T5157 C:control_collection c:collection1 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 1383845 T5157 C:control_collection c:collection1 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.2.0
[junit4] 2> 1383895 T5157 C:control_collection c:collection1 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1383996 T5157 C:control_collection c:collection1 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 1384006 T5157 C:control_collection c:collection1 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1384385 T5157 C:control_collection c:collection1 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1384388 T5157 C:control_collection c:collection1 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1384390 T5157 C:control_collection c:collection1 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1384395 T5157 C:control_collection c:collection1 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1384414 T5157 C:control_collection c:collection1 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 1384415 T5157 C:control_collection c:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1384415 T5157 C:control_collection c:collection1 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/control-001/cores/collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/control-001/cores/collection1/data/
[junit4] 2> 1384416 T5157 C:control_collection c:collection1 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fe167f3
[junit4] 2> 1384417 T5157 C:control_collection c:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/control-001/cores/collection1/data
[junit4] 2> 1384417 T5157 C:control_collection c:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/control-001/cores/collection1/data/index/
[junit4] 2> 1384417 T5157 C:control_collection c:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1384418 T5157 C:control_collection c:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/control-001/cores/collection1/data/index
[junit4] 2> 1384418 T5157 C:control_collection c:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=28, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=87.6728515625, floorSegmentMB=1.197265625, forceMergeDeletesPctAllowed=15.735976729135663, segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2923950719088899
[junit4] 2> 1384419 T5157 C:control_collection c:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@439a72fa lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@50f29dc2),segFN=segments_1,generation=1}
[junit4] 2> 1384419 T5157 C:control_collection c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1384425 T5157 C:control_collection c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1384425 T5157 C:control_collection c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1384426 T5157 C:control_collection c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1384426 T5157 C:control_collection c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1384426 T5157 C:control_collection c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1384426 T5157 C:control_collection c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1384427 T5157 C:control_collection c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1384427 T5157 C:control_collection c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1384427 T5157 C:control_collection c:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1384447 T5157 C:control_collection c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1384449 T5157 C:control_collection c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1384452 T5157 C:control_collection c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1384454 T5157 C:control_collection c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1384459 T5157 C:control_collection c:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /admin/ping,/admin/luke,/replication,/admin/logging,/update/csv,/update/json,/update,standard,/admin/mbeans,/admin/plugins,/admin/properties,/admin/threads,/config,/update/json/docs,/admin/system,/admin/file,/admin/segments,/get,/schema
[junit4] 2> 1384461 T5157 C:control_collection c:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1384463 T5157 C:control_collection c:collection1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1384463 T5157 C:control_collection c:collection1 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
[junit4] 2> 1384465 T5157 C:control_collection c:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1384465 T5157 C:control_collection c:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1384466 T5157 C:control_collection c:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1521501496, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1384466 T5157 C:control_collection c:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@439a72fa lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@50f29dc2),segFN=segments_1,generation=1}
[junit4] 2> 1384467 T5157 C:control_collection c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1384467 T5157 C:control_collection c:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@54a7d149[collection1] main
[junit4] 2> 1384467 T5157 C:control_collection c:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 1384468 T5157 C:control_collection c:collection1 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1384469 T5157 C:control_collection c:collection1 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1384469 T5157 C:control_collection c:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1384469 T5157 C:control_collection c:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 1384470 T5157 C:control_collection c:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1384470 T5157 C:control_collection c:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1384470 T5157 C:control_collection c:collection1 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1384471 T5157 C:control_collection c:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 1384471 T5157 C:control_collection c:collection1 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 1384472 T5158 C:control_collection c:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@54a7d149[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1384472 T5157 C:control_collection c:collection1 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1384473 T5161 C:control_collection S:shard1 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:63098/ne_/s collection:control_collection shard:shard1
[junit4] 2> 1384474 T5127 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0
[junit4] 2> 1384474 T5127 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1384474 T5161 C:control_collection S:shard1 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 1384477 T5127 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1384478 T5127 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1384479 T5161 C:control_collection S:shard1 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1384480 T5164 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@680954cd name:ZooKeeperConnection Watcher:127.0.0.1:41594/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1384480 T5127 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1384481 T5127 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1384481 T5153 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1384481 T5161 C:control_collection S:shard1 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1384481 T5127 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1384482 T5161 C:control_collection S:shard1 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 1384482 T5154 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> ASYNC NEW_CORE C752 name=collection1 org.apache.solr.core.SolrCore@55d51534 url=http://127.0.0.1:63098/ne_/s/collection1 node=127.0.0.1:63098_ne_%2Fs C752_STATE=coll:control_collection core:collection1 props:{core=collection1, node_name=127.0.0.1:63098_ne_%2Fs, state=down, base_url=http://127.0.0.1:63098/ne_/s}
[junit4] 2> 1384483 T5161 C:control_collection S:shard1 C752 P63098 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:63098/ne_/s/collection1/
[junit4] 2> 1384483 T5161 C:control_collection S:shard1 C752 P63098 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1384484 T5161 C:control_collection S:shard1 C752 P63098 oasc.SyncStrategy.syncToMe http://127.0.0.1:63098/ne_/s/collection1/ has no replicas
[junit4] 2> 1384484 T5161 C:control_collection S:shard1 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:63098/ne_/s/collection1/ shard1
[junit4] 2> 1384484 T5164 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
[junit4] 2> 1384484 T5153 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1384484 T5161 C:control_collection S:shard1 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 1384486 T5127 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1384486 T5127 oasc.AbstractFullDistribZkTestBase.createJettys Creating collection1 with stateFormat=2
[junit4] 2> 1384486 T5127 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1384487 T5127 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1384489 T5167 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@113d238b name:ZooKeeperConnection Watcher:127.0.0.1:41594/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1384489 T5127 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1384490 T5127 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1384490 T5153 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1384492 T5154 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:63098/ne_/s",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 2
[junit4] 2> 1384495 T5154 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"create",
[junit4] 2> "name":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "stateFormat":"2"} current state version: 2
[junit4] 2> 1384495 T5154 oasco.ClusterStateMutator.createCollection building a new cName: collection1
[junit4] 2> 1384496 T5153 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1384496 T5164 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1384500 T5153 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1384500 T5154 oasco.ZkStateWriter.writePendingUpdates going to create_collection /collections/collection1/state.json
[junit4] 2> 1384502 T5153 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1384502 T5164 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1384541 T5161 C:control_collection S:shard1 oasc.ZkController.register We are http://127.0.0.1:63098/ne_/s/collection1/ and leader is http://127.0.0.1:63098/ne_/s/collection1/
[junit4] 2> 1384542 T5161 C:control_collection S:shard1 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:63098/ne_/s
[junit4] 2> 1384542 T5161 C:control_collection S:shard1 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1384542 T5161 C:control_collection S:shard1 c:collection1 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 1384543 T5161 C:control_collection S:shard1 c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1384544 T5153 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1384545 T5154 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "roles":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"collection1",
[junit4] 2> "node_name":"127.0.0.1:63098_ne_%2Fs",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:63098/ne_/s",
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "numShards":"1"} current state version: 4
[junit4] 2> 1384546 T5154 oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "roles":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"collection1",
[junit4] 2> "node_name":"127.0.0.1:63098_ne_%2Fs",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:63098/ne_/s",
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "numShards":"1"}
[junit4] 2> 1384650 T5164 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1384650 T5153 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1385914 T5127 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-1-001/cores/collection1
[junit4] 2> 1385916 T5127 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1 in directory /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-1-001
[junit4] 2> 1385917 T5127 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1385919 T5127 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:63103
[junit4] 2> 1385920 T5127 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostPort=63103, solrconfig=solrconfig.xml, coreRootDirectory=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-1-001/cores, solr.data.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/tempDir-001/jetty1, hostContext=/ne_/s}
[junit4] 2> 1385920 T5127 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@231bf785
[junit4] 2> 1385920 T5127 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-1-001/'
[junit4] 2> 1385952 T5127 oasc.SolrXmlConfig.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-1-001/solr.xml
[junit4] 2> 1385988 T5127 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-1-001/cores
[junit4] 2> 1385988 T5127 oasc.CoreContainer.<init> New CoreContainer 650824738
[junit4] 2> 1385989 T5127 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-1-001/]
[junit4] 2> 1385989 T5127 oasc.CoreContainer.load loading shared library: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-1-001/lib
[junit4] 2> 1385990 T5127 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-1-001/lib).
[junit4] 2> 1386000 T5127 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1386001 T5127 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1386001 T5127 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1386001 T5127 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1386002 T5127 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
[junit4] 2> 1386002 T5127 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1386002 T5127 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1386002 T5127 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1386002 T5127 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1386003 T5127 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1386003 T5127 oashc.HttpShardHandlerFactory.getParameter Setting useRetries to: false
[junit4] 2> 1386008 T5127 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1386008 T5127 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1386009 T5127 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1386009 T5127 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 1386009 T5127 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41594/solr
[junit4] 2> 1386009 T5127 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1386010 T5127 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1386010 T5127 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1386012 T5179 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@658fbf04 name:ZooKeeperConnection Watcher:127.0.0.1:41594 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1386013 T5127 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1386014 T5127 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1386016 T5127 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1386017 T5182 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4a81eb40 name:ZooKeeperConnection Watcher:127.0.0.1:41594/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1386017 T5127 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1386021 T5127 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1387027 T5127 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63103_ne_%2Fs
[junit4] 2> 1387028 T5127 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63103_ne_%2Fs
[junit4] 2> 1387030 T5127 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 1387033 T5127 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-1-001/cores
[junit4] 2> 1387035 T5127 oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {absoluteInstDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-1-001/cores/collection1/, coreNodeName=, shard=, config=solrconfig.xml, instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-1-001/cores/collection1, name=collection1, dataDir=data/, collection=collection1, transient=false, schema=schema.xml, loadOnStartup=true}
[junit4] 2> 1387035 T5127 oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-1-001/cores/collection1/
[junit4] 2> 1387036 T5127 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1387038 T5183 C:collection1 c:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 1387038 T5183 C:collection1 c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1387039 T5153 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1387040 T5183 C:collection1 c:collection1 oasc.ZkController.preRegister Registering watch for external collection collection1
[junit4] 2> 1387040 T5183 C:collection1 c:collection1 oascc.ZkStateReader.addZkWatch addZkWatch collection1
[junit4] 2> 1387040 T5154 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "roles":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":null,
[junit4] 2> "core":"collection1",
[junit4] 2> "node_name":"127.0.0.1:63103_ne_%2Fs",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:63103/ne_/s",
[junit4] 2> "operation":"state",
[junit4] 2> "numShards":"1"} current state version: 5
[junit4] 2> 1387041 T5183 C:collection1 c:collection1 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/collection1/state.json from ZooKeeper...
[junit4] 2> 1387041 T5154 oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "roles":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":null,
[junit4] 2> "core":"collection1",
[junit4] 2> "node_name":"127.0.0.1:63103_ne_%2Fs",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:63103/ne_/s",
[junit4] 2> "operation":"state",
[junit4] 2> "numShards":"1"}
[junit4] 2> 1387041 T5154 oasco.ReplicaMutator.updateState Collection already exists with numShards=1
[junit4] 2> 1387042 T5154 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1387042 T5183 C:collection1 c:collection1 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 0
[junit4] 2> 1387042 T5183 C:collection1 c:collection1 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1387043 T5154 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 0
[junit4] 2> 1387043 T5182 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 2)
[junit4] 2> 1387044 T5182 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 1
[junit4] 2> 1388042 T5183 C:collection1 c:collection1 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1388043 T5183 C:collection1 c:collection1 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1388044 T5183 C:collection1 c:collection1 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1388044 T5183 C:collection1 c:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1388045 T5183 C:collection1 c:collection1 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1388045 T5183 C:collection1 c:collection1 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-1-001/cores/collection1/'
[junit4] 2> 1388062 T5183 C:collection1 c:collection1 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
[junit4] 2> 1388065 T5183 C:collection1 c:collection1 oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 1388076 T5183 C:collection1 c:collection1 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 1388100 T5183 C:collection1 c:collection1 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.2.0
[junit4] 2> 1388149 T5183 C:collection1 c:collection1 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1388250 T5183 C:collection1 c:collection1 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 1388260 T5183 C:collection1 c:collection1 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1388629 T5183 C:collection1 c:collection1 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1388633 T5183 C:collection1 c:collection1 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1388635 T5183 C:collection1 c:collection1 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1388640 T5183 C:collection1 c:collection1 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1388661 T5183 C:collection1 c:collection1 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 1388661 T5183 C:collection1 c:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1388661 T5183 C:collection1 c:collection1 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-1-001/cores/collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-1-001/cores/collection1/data/
[junit4] 2> 1388662 T5183 C:collection1 c:collection1 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fe167f3
[junit4] 2> 1388662 T5183 C:collection1 c:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-1-001/cores/collection1/data
[junit4] 2> 1388663 T5183 C:collection1 c:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-1-001/cores/collection1/data/index/
[junit4] 2> 1388663 T5183 C:collection1 c:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-1-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1388664 T5183 C:collection1 c:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-1-001/cores/collection1/data/index
[junit4] 2> 1388665 T5183 C:collection1 c:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=28, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=87.6728515625, floorSegmentMB=1.197265625, forceMergeDeletesPctAllowed=15.735976729135663, segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2923950719088899
[junit4] 2> 1388666 T5183 C:collection1 c:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@6de49f01 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3c833304),segFN=segments_1,generation=1}
[junit4] 2> 1388666 T5183 C:collection1 c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1388672 T5183 C:collection1 c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1388673 T5183 C:collection1 c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1388673 T5183 C:collection1 c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1388673 T5183 C:collection1 c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1388674 T5183 C:collection1 c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1388674 T5183 C:collection1 c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1388674 T5183 C:collection1 c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1388675 T5183 C:collection1 c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1388675 T5183 C:collection1 c:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1388703 T5183 C:collection1 c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1388706 T5183 C:collection1 c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1388709 T5183 C:collection1 c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1388711 T5183 C:collection1 c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1388720 T5183 C:collection1 c:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /admin/ping,/admin/luke,/replication,/admin/logging,/update/csv,/update/json,/update,standard,/admin/mbeans,/admin/plugins,/admin/properties,/admin/threads,/config,/update/json/docs,/admin/system,/admin/file,/admin/segments,/get,/schema
[junit4] 2> 1388722 T5183 C:collection1 c:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1388724 T5183 C:collection1 c:collection1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1388724 T5183 C:collection1 c:collection1 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
[junit4] 2> 1388726 T5183 C:collection1 c:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1388727 T5183 C:collection1 c:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1388728 T5183 C:collection1 c:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1521501496, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1388729 T5183 C:collection1 c:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@6de49f01 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3c833304),segFN=segments_1,generation=1}
[junit4] 2> 1388729 T5183 C:collection1 c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1388730 T5183 C:collection1 c:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@4f76fe19[collection1] main
[junit4] 2> 1388730 T5183 C:collection1 c:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1388731 T5183 C:collection1 c:collection1 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1388731 T5183 C:collection1 c:collection1 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1388732 T5183 C:collection1 c:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1388732 T5183 C:collection1 c:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 1388732 T5183 C:collection1 c:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1388733 T5183 C:collection1 c:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1388733 T5183 C:collection1 c:collection1 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1388733 T5183 C:collection1 c:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 1388734 T5183 C:collection1 c:collection1 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 1388735 T5184 C:collection1 c:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4f76fe19[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1388735 T5183 C:collection1 c:collection1 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1388736 T5187 C:collection1 S:shard1 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:63103/ne_/s collection:collection1 shard:shard1
[junit4] 2> 1388736 T5127 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0
[junit4] 2> 1388737 T5127 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1388737 T5187 C:collection1 S:shard1 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1388742 T5187 C:collection1 S:shard1 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1388744 T5153 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1388744 T5187 C:collection1 S:shard1 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1388744 T5187 C:collection1 S:shard1 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C753 name=collection1 org.apache.solr.core.SolrCore@3cfd6af url=http://127.0.0.1:63103/ne_/s/collection1 node=127.0.0.1:63103_ne_%2Fs C753_STATE=coll:collection1 core:collection1 props:{core=collection1, node_name=127.0.0.1:63103_ne_%2Fs, state=down, base_url=http://127.0.0.1:63103/ne_/s}
[junit4] 2> 1388745 T5187 C:collection1 S:shard1 C753 P63103 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:63103/ne_/s/collection1/
[junit4] 2> 1388745 T5154 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1"} current state version: 5
[junit4] 2> 1388745 T5187 C:collection1 S:shard1 C753 P63103 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1388746 T5187 C:collection1 S:shard1 C753 P63103 oasc.SyncStrategy.syncToMe http://127.0.0.1:63103/ne_/s/collection1/ has no replicas
[junit4] 2> 1388746 T5187 C:collection1 S:shard1 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:63103/ne_/s/collection1/ shard1
[junit4] 2> 1388746 T5187 C:collection1 S:shard1 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 1388746 T5154 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 1
[junit4] 2> 1388747 T5182 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 2)
[junit4] 2> 1388748 T5182 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 2
[junit4] 2> 1388752 T5153 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1388753 T5154 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:63103/ne_/s",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 5
[junit4] 2> 1388754 T5154 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 2
[junit4] 2> 1388755 T5182 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 2)
[junit4] 2> 1388756 T5182 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 3
[junit4] 2> 1388803 T5187 C:collection1 S:shard1 oasc.ZkController.register We are http://127.0.0.1:63103/ne_/s/collection1/ and leader is http://127.0.0.1:63103/ne_/s/collection1/
[junit4] 2> 1388804 T5187 C:collection1 S:shard1 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:63103/ne_/s
[junit4] 2> 1388804 T5187 C:collection1 S:shard1 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1388804 T5187 C:collection1 S:shard1 c:collection1 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 1388804 T5187 C:collection1 S:shard1 c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1388806 T5153 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1388807 T5154 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "roles":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"collection1",
[junit4] 2> "node_name":"127.0.0.1:63103_ne_%2Fs",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:63103/ne_/s",
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "numShards":"1"} current state version: 5
[junit4] 2> 1388807 T5154 oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "roles":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"collection1",
[junit4] 2> "node_name":"127.0.0.1:63103_ne_%2Fs",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:63103/ne_/s",
[junit4] 2> "operation":"state",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "numShards":"1"}
[junit4] 2> 1388808 T5187 C:collection1 S:shard1 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 3
[junit4] 2> 1388809 T5154 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 3
[junit4] 2> 1388809 T5182 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 2)
[junit4] 2> 1388810 T5182 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 4
[junit4] 2> 1390641 T5127 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-2-001/cores/collection1
[junit4] 2> 1390644 T5127 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2 in directory /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-2-001
[junit4] 2> 1390645 T5127 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1390647 T5127 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:63106
[junit4] 2> 1390648 T5127 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {solr.data.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/tempDir-001/jetty2, solrconfig=solrconfig.xml, hostContext=/ne_/s, coreRootDirectory=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-2-001/cores, hostPort=63106}
[junit4] 2> 1390648 T5127 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@231bf785
[junit4] 2> 1390648 T5127 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-2-001/'
[junit4] 2> 1390680 T5127 oasc.SolrXmlConfig.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-2-001/solr.xml
[junit4] 2> 1390746 T5127 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-2-001/cores
[junit4] 2> 1390746 T5127 oasc.CoreContainer.<init> New CoreContainer 507398925
[junit4] 2> 1390747 T5127 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-2-001/]
[junit4] 2> 1390747 T5127 oasc.CoreContainer.load loading shared library: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-2-001/lib
[junit4] 2> 1390748 T5127 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-2-001/lib).
[junit4] 2> 1390761 T5127 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1390761 T5127 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1390762 T5127 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1390762 T5127 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1390762 T5127 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
[junit4] 2> 1390763 T5127 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1390763 T5127 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1390763 T5127 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1390764 T5127 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1390764 T5127 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1390764 T5127 oashc.HttpShardHandlerFactory.getParameter Setting useRetries to: false
[junit4] 2> 1390771 T5127 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1390772 T5127 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1390773 T5127 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1390773 T5127 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 1390773 T5127 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41594/solr
[junit4] 2> 1390774 T5127 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1390774 T5127 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1390775 T5127 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1390777 T5199 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@389ed5 name:ZooKeeperConnection Watcher:127.0.0.1:41594 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1390777 T5127 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1390778 T5127 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1390780 T5127 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1390781 T5202 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@77ba6427 name:ZooKeeperConnection Watcher:127.0.0.1:41594/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1390782 T5127 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1390787 T5127 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1391793 T5127 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63106_ne_%2Fs
[junit4] 2> 1391794 T5127 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63106_ne_%2Fs
[junit4] 2> 1391797 T5127 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 1391799 T5127 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-2-001/cores
[junit4] 2> 1391801 T5127 oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {loadOnStartup=true, name=collection1, coreNodeName=, instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-2-001/cores/collection1, config=solrconfig.xml, dataDir=data/, schema=schema.xml, shard=, transient=false, collection=collection1, absoluteInstDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-2-001/cores/collection1/}
[junit4] 2> 1391802 T5127 oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-2-001/cores/collection1/
[junit4] 2> 1391802 T5127 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1391804 T5203 C:collection1 c:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 1391805 T5203 C:collection1 c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1391806 T5153 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1391807 T5203 C:collection1 c:collection1 oasc.ZkController.preRegister Registering watch for external collection collection1
[junit4] 2> 1391807 T5154 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "roles":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":null,
[junit4] 2> "core":"collection1",
[junit4] 2> "node_name":"127.0.0.1:63106_ne_%2Fs",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:63106/ne_/s",
[junit4] 2> "operation":"state",
[junit4] 2> "numShards":"1"} current state version: 5
[junit4] 2> 1391807 T5203 C:collection1 c:collection1 oascc.ZkStateReader.addZkWatch addZkWatch collection1
[junit4] 2> 1391808 T5154 oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "roles":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":null,
[junit4] 2> "core":"collection1",
[junit4] 2> "node_name":"127.0.0.1:63106_ne_%2Fs",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:63106/ne_/s",
[junit4] 2> "operation":"state",
[junit4] 2> "numShards":"1"}
[junit4] 2> 1391808 T5203 C:collection1 c:collection1 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/collection1/state.json from ZooKeeper...
[junit4] 2> 1391808 T5154 oasco.ReplicaMutator.updateState Collection already exists with numShards=1
[junit4] 2> 1391809 T5154 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1391809 T5203 C:collection1 c:collection1 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 4
[junit4] 2> 1391810 T5203 C:collection1 c:collection1 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1391810 T5154 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 4
[junit4] 2> 1391810 T5182 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 3)
[junit4] 2> 1391810 T5202 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 3)
[junit4] 2> 1391811 T5182 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 5
[junit4] 2> 1391812 T5202 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 5
[junit4] 2> 1392810 T5203 C:collection1 c:collection1 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1392811 T5203 C:collection1 c:collection1 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1392811 T5203 C:collection1 c:collection1 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1392812 T5203 C:collection1 c:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1392812 T5203 C:collection1 c:collection1 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1392813 T5203 C:collection1 c:collection1 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-2-001/cores/collection1/'
[junit4] 2> 1392830 T5203 C:collection1 c:collection1 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
[junit4] 2> 1392833 T5203 C:collection1 c:collection1 oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 1392844 T5203 C:collection1 c:collection1 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 1392866 T5203 C:collection1 c:collection1 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.2.0
[junit4] 2> 1392916 T5203 C:collection1 c:collection1 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1393017 T5203 C:collection1 c:collection1 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 1393027 T5203 C:collection1 c:collection1 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1393382 T5203 C:collection1 c:collection1 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1393385 T5203 C:collection1 c:collection1 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1393387 T5203 C:collection1 c:collection1 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1393392 T5203 C:collection1 c:collection1 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1393415 T5203 C:collection1 c:collection1 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 1393415 T5203 C:collection1 c:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1393416 T5203 C:collection1 c:collection1 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-2-001/cores/collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-2-001/cores/collection1/data/
[junit4] 2> 1393416 T5203 C:collection1 c:collection1 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1fe167f3
[junit4] 2> 1393417 T5203 C:collection1 c:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-2-001/cores/collection1/data
[junit4] 2> 1393418 T5203 C:collection1 c:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-2-001/cores/collection1/data/index/
[junit4] 2> 1393418 T5203 C:collection1 c:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-2-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1393419 T5203 C:collection1 c:collection1 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-2-001/cores/collection1/data/index
[junit4] 2> 1393419 T5203 C:collection1 c:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=28, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=87.6728515625, floorSegmentMB=1.197265625, forceMergeDeletesPctAllowed=15.735976729135663, segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2923950719088899
[junit4] 2> 1393420 T5203 C:collection1 c:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@2ba68443 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@41356118),segFN=segments_1,generation=1}
[junit4] 2> 1393420 T5203 C:collection1 c:collection1 oasc.SolrDeletionPolicy.updateCommits
[...truncated too long message...]
joinLeaderElection Not rejoining election because CoreContainer is closed
[junit4] 2> 1553027 T5245 C:collection1 S:shard1 c:collection1 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@18c83cda
[junit4] 2> 1553028 T5245 C:collection1 S:shard1 c:collection1 oasc.ZkController.unRegisterConfListener a listener was removed because of core close
[junit4] 2> 1553029 T5245 C:collection1 S:shard1 c:collection1 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=63,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=351,cumulative_deletesById=167,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=32882,transaction_logs_total_number=1}
[junit4] 2> 1553029 T5245 C:collection1 S:shard1 c:collection1 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 1553029 T5245 C:collection1 S:shard1 c:collection1 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 1553029 T5245 C:collection1 S:shard1 c:collection1 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 1553030 T5245 C:collection1 S:shard1 c:collection1 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 1553037 T5245 C:collection1 S:shard1 c:collection1 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 1553037 T5245 C:collection1 S:shard1 c:collection1 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-2-001/cores/collection1/data [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-2-001/cores/collection1/data;done=false>>]
[junit4] 2> 1553037 T5245 C:collection1 S:shard1 c:collection1 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-2-001/cores/collection1/data
[junit4] 2> 1553037 T5245 C:collection1 S:shard1 c:collection1 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-2-001/cores/collection1/data/index [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-2-001/cores/collection1/data/index;done=false>>]
[junit4] 2> 1553038 T5245 C:collection1 S:shard1 c:collection1 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001/shard-2-001/cores/collection1/data/index
[junit4] 2> 1553039 T5127 C:collection1 S:shard1 c:collection1 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/ne_/s,null}
[junit4] 2> 1553242 T5127 C:collection1 S:shard1 c:collection1 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:41594 41594
[junit4] 2> 1553387 T5128 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:41594 41594
[junit4] 2> 1553388 T5128 oasc.ZkTestServer$ZKServerMain.runFromConfig WARN Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 5 /solr/clusterstate.json
[junit4] 2> 5 /solr/aliases.json
[junit4] 2> 4 /solr/configs/conf1
[junit4] 2> 3 /solr/collections/collection1/state.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 2 /solr/overseer_elect/election/93635670365437959-127.0.0.1:63103_ne_%2Fs-n_0000000001
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard1/election/93635670365437959-core_node1-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 4 /solr/live_nodes
[junit4] 2> 3 /solr/overseer/collection-queue-work
[junit4] 2> 3 /solr/overseer/queue
[junit4] 2>
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=RecoveryZkTest -Dtests.method=test -Dtests.seed=2C3F78376E526F98 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=sq -Dtests.timezone=Africa/Banjul -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] FAILURE 172s J0 | RecoveryZkTest.test <<<
[junit4] > Throwable #1: java.lang.AssertionError: shard1 is not consistent. Got 862 from http://127.0.0.1:63103/ne_/s/collection1lastClient and got 192 from http://127.0.0.1:63106/ne_/s/collection1
[junit4] > at __randomizedtesting.SeedInfo.seed([2C3F78376E526F98:A46B47EDC0AE0260]:0)
[junit4] > at org.apache.solr.cloud.RecoveryZkTest.test(RecoveryZkTest.java:123)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 1553405 T5127 C:collection1 S:shard1 c:collection1 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.RecoveryZkTest 2C3F78376E526F98-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene50): {id=Lucene50(blocksize=128), a_i=Lucene50(blocksize=128), a_t=PostingsFormat(name=Direct), rnd_b=Lucene50(blocksize=128), _version_=FST50}, docValues:{}, sim=DefaultSimilarity, locale=sq, timezone=Africa/Banjul
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_65 (64-bit)/cpus=16,threads=1,free=70845808,total=332398592
[junit4] 2> NOTE: All tests run in this JVM: [DistributedQueryElevationComponentTest, DistributedFacetPivotSmallAdvancedTest, TestRandomFaceting, TestDynamicLoading, HdfsBasicDistributedZk2Test, SolrCmdDistributorTest, TestSolrIndexConfig, XmlUpdateRequestHandlerTest, SegmentsInfoRequestHandlerTest, DeleteShardTest, TestTrie, TestPartialUpdateDeduplication, TestCloudInspectUtil, SpellCheckCollatorTest, DistributedSpellCheckComponentTest, HighlighterConfigTest, OpenExchangeRatesOrgProviderTest, TestDefaultSearchFieldResource, TestSort, SolrTestCaseJ4Test, TestUpdate, MBeansHandlerTest, RequiredFieldsTest, DistributedFacetPivotWhiteBoxTest, TestIBSimilarityFactory, TestSolrDeletionPolicy2, OverseerTest, SolrIndexConfigTest, TestSolrCoreProperties, ShowFileRequestHandlerTest, TestNoOpRegenerator, SharedFSAutoReplicaFailoverUtilsTest, CursorPagingTest, DebugComponentTest, MinimalSchemaTest, DistanceFunctionTest, ZkNodePropsTest, TestXIncludeConfig, TestExactStatsCache, ExternalFileFieldSortTest, TestFaceting, TestDFRSimilarityFactory, StressHdfsTest, TestLRUStatsCache, DocValuesMissingTest, SignatureUpdateProcessorFactoryTest, QueryParsingTest, OverseerCollectionProcessorTest, StatelessScriptUpdateProcessorFactoryTest, TestManagedResourceStorage, DOMUtilTest, TestManagedStopFilterFactory, HdfsRecoveryZkTest, TestMissingGroups, DateRangeFieldTest, TestMiniSolrCloudClusterSSL, ReplicationFactorTest, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, LeaderElectionIntegrationTest, RecoveryZkTest]
[junit4] Completed [191/482] on J0 in 172.37s, 1 test, 1 failure <<< FAILURES!
[...truncated 939 lines...]
BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:543: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:484: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:61: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/extra-targets.xml:39: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build.xml:229: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/common-build.xml:510: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1434: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:991: There were test failures: 482 suites, 1914 tests, 1 failure, 59 ignored (9 assumptions)
Total time: 158 minutes 23 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-NightlyTests-5.x #716
Archived 5 artifacts
Archive block size is 32768
Received 0 blocks and 915691096 bytes
Compression is 0.0%
Took 2 min 45 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure