You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2013/03/04 13:45:31 UTC
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 196 - Still
Failing
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/196/
All tests passed
Build Log:
[...truncated 29229 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:388: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:320: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/extra-targets.xml:120: The following files are missing svn:eol-style (or binary svn:mime-type):
* solr/licenses/carrot2-mini-LICENSE-BSD_LIKE.txt
* solr/licenses/carrot2-mini-NOTICE.txt
Total time: 107 minutes 14 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 202 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/202/
2 tests failed.
FAILED: junit.framework.TestSuite.org.apache.lucene.index.sorter.IndexSortingTest
Error Message:
37
Stack Trace:
java.lang.ArrayIndexOutOfBoundsException: 37
at __randomizedtesting.SeedInfo.seed([15671ED847C3A347]:0)
at org.apache.lucene.index.sorter.SortingAtomicReader$SortingDocsAndPositionsEnum.<init>(SortingAtomicReader.java:454)
at org.apache.lucene.index.sorter.SortingAtomicReader$SortingTermsEnum.docsAndPositions(SortingAtomicReader.java:161)
at org.apache.lucene.index.MultiTermsEnum.docsAndPositions(MultiTermsEnum.java:474)
at org.apache.lucene.index.TermsEnum.docsAndPositions(TermsEnum.java:183)
at org.apache.lucene.codecs.TermsConsumer.merge(TermsConsumer.java:186)
at org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:72)
at org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:383)
at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:116)
at org.apache.lucene.index.IndexWriter.addIndexes(IndexWriter.java:2420)
at org.apache.lucene.index.sorter.IndexSortingTest.beforeClassSorterUtilTest(IndexSortingTest.java:65)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:677)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:679)
FAILED: junit.framework.TestSuite.org.apache.lucene.index.sorter.SortingAtomicReaderTest
Error Message:
CheckReader failed
Stack Trace:
java.lang.RuntimeException: CheckReader failed
at __randomizedtesting.SeedInfo.seed([15671ED847C3A347]:0)
at org.apache.lucene.util._TestUtil.checkReader(_TestUtil.java:255)
at org.apache.lucene.util._TestUtil.checkReader(_TestUtil.java:234)
at org.apache.lucene.index.sorter.SortingAtomicReaderTest.beforeClassSortingAtomicReaderTest(SortingAtomicReaderTest.java:72)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:677)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:679)
Build Log:
[...truncated 6732 lines...]
[junit4:junit4] Suite: org.apache.lucene.index.sorter.SortingAtomicReaderTest
[junit4:junit4] 1> CheckReader failed
[junit4:junit4] 1> test: field norms.........OK [3 fields]
[junit4:junit4] 1> test: terms, freq, prox...ERROR: java.lang.ArrayIndexOutOfBoundsException: 37
[junit4:junit4] 1> java.lang.ArrayIndexOutOfBoundsException: 37
[junit4:junit4] 1> at org.apache.lucene.index.sorter.SortingAtomicReader$SortingDocsAndPositionsEnum.<init>(SortingAtomicReader.java:454)
[junit4:junit4] 1> at org.apache.lucene.index.sorter.SortingAtomicReader$SortingTermsEnum.docsAndPositions(SortingAtomicReader.java:161)
[junit4:junit4] 1> at org.apache.lucene.index.TermsEnum.docsAndPositions(TermsEnum.java:183)
[junit4:junit4] 1> at org.apache.lucene.index.CheckIndex.checkFields(CheckIndex.java:793)
[junit4:junit4] 1> at org.apache.lucene.index.CheckIndex.testPostings(CheckIndex.java:1200)
[junit4:junit4] 1> at org.apache.lucene.index.CheckIndex.testPostings(CheckIndex.java:1177)
[junit4:junit4] 1> at org.apache.lucene.util._TestUtil.checkReader(_TestUtil.java:243)
[junit4:junit4] 1> at org.apache.lucene.util._TestUtil.checkReader(_TestUtil.java:234)
[junit4:junit4] 1> at org.apache.lucene.index.sorter.SortingAtomicReaderTest.beforeClassSortingAtomicReaderTest(SortingAtomicReaderTest.java:72)
[junit4:junit4] 1> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4] 1> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4] 1> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4] 1> at java.lang.reflect.Method.invoke(Method.java:616)
[junit4:junit4] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:677)
[junit4:junit4] 1> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4] 1> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] 1> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] 1> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] 1> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] 1> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] 1> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] 1> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] 1> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] 1> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] 1> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] 1> at java.lang.Thread.run(Thread.java:679)
[junit4:junit4] 1> test: stored fields.......OK [77 total field count; avg 1 fields per doc]
[junit4:junit4] 1> test: term vectors........OK [77 total vector count; avg 1 term/freq vector fields per doc]
[junit4:junit4] 1> test: docvalues...........OK [0 total doc count; 4 docvalues fields]
[junit4:junit4] 1>
[junit4:junit4] 2> NOTE: test params are: codec=CheapBastard, sim=DefaultSimilarity, locale=lt_LT, timezone=Asia/Yerevan
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Sun Microsystems Inc. 1.6.0_32 (64-bit)/cpus=16,threads=1,free=417092040,total=514064384
[junit4:junit4] 2> NOTE: All tests run in this JVM: [SortingAtomicReaderTest]
[junit4:junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=SortingAtomicReaderTest -Dtests.seed=15671ED847C3A347 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/hudson/lucene-data/enwiki.random.lines.txt -Dtests.locale=lt_LT -Dtests.timezone=Asia/Yerevan -Dtests.file.encoding=ISO8859-1
[junit4:junit4] ERROR 0.00s J1 | SortingAtomicReaderTest (suite) <<<
[junit4:junit4] > Throwable #1: java.lang.RuntimeException: CheckReader failed
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([15671ED847C3A347]:0)
[junit4:junit4] > at org.apache.lucene.util._TestUtil.checkReader(_TestUtil.java:255)
[junit4:junit4] > at org.apache.lucene.util._TestUtil.checkReader(_TestUtil.java:234)
[junit4:junit4] > at org.apache.lucene.index.sorter.SortingAtomicReaderTest.beforeClassSortingAtomicReaderTest(SortingAtomicReaderTest.java:72)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4] > at java.lang.reflect.Method.invoke(Method.java:616)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:677)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:679)
[junit4:junit4] Completed on J1 in 4.57s, 0 tests, 1 error <<< FAILURES!
[...truncated 10 lines...]
[junit4:junit4] Suite: org.apache.lucene.index.sorter.IndexSortingTest
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {id=PostingsFormat(name=MockSep), positions=PostingsFormat(name=Memory doPackFST= false), norm=PostingsFormat(name=Lucene41WithOrds), docs=PostingsFormat(name=MockSep), term_vectors=PostingsFormat(name=TestBloomFilteredLucene41Postings)}, docValues:{binary=DocValuesFormat(name=Disk), numeric=DocValuesFormat(name=Disk), sorted=DocValuesFormat(name=Disk), sorted_set=DocValuesFormat(name=CheapBastard)}, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {positions=DFR I(F)B2, term_vectors=DFR I(F)3(800.0)}, locale=ja_JP_JP, timezone=ECT
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Sun Microsystems Inc. 1.6.0_32 (64-bit)/cpus=16,threads=1,free=398444944,total=514064384
[junit4:junit4] 2> NOTE: All tests run in this JVM: [SortingAtomicReaderTest, TestIndexSplitter, TestPKIndexSplitter, SweetSpotSimilarityTest, IndexSortingTest]
[junit4:junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=IndexSortingTest -Dtests.seed=15671ED847C3A347 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/hudson/lucene-data/enwiki.random.lines.txt -Dtests.locale=ja_JP_JP -Dtests.timezone=ECT -Dtests.file.encoding=ISO8859-1
[junit4:junit4] ERROR 0.00s J1 | IndexSortingTest (suite) <<<
[junit4:junit4] > Throwable #1: java.lang.ArrayIndexOutOfBoundsException: 37
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([15671ED847C3A347]:0)
[junit4:junit4] > at org.apache.lucene.index.sorter.SortingAtomicReader$SortingDocsAndPositionsEnum.<init>(SortingAtomicReader.java:454)
[junit4:junit4] > at org.apache.lucene.index.sorter.SortingAtomicReader$SortingTermsEnum.docsAndPositions(SortingAtomicReader.java:161)
[junit4:junit4] > at org.apache.lucene.index.MultiTermsEnum.docsAndPositions(MultiTermsEnum.java:474)
[junit4:junit4] > at org.apache.lucene.index.TermsEnum.docsAndPositions(TermsEnum.java:183)
[junit4:junit4] > at org.apache.lucene.codecs.TermsConsumer.merge(TermsConsumer.java:186)
[junit4:junit4] > at org.apache.lucene.codecs.FieldsConsumer.merge(FieldsConsumer.java:72)
[junit4:junit4] > at org.apache.lucene.index.SegmentMerger.mergeTerms(SegmentMerger.java:383)
[junit4:junit4] > at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:116)
[junit4:junit4] > at org.apache.lucene.index.IndexWriter.addIndexes(IndexWriter.java:2420)
[junit4:junit4] > at org.apache.lucene.index.sorter.IndexSortingTest.beforeClassSorterUtilTest(IndexSortingTest.java:65)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4] > at java.lang.reflect.Method.invoke(Method.java:616)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:677)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:679)
[junit4:junit4] Completed on J1 in 0.91s, 0 tests, 1 error <<< FAILURES!
[...truncated 14 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:388: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:361: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build.xml:548: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1758: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/module-build.xml:61: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1213: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:877: There were test failures: 8 suites, 21 tests, 2 suite-level errors
Total time: 70 minutes 35 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 201 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/201/
2 tests failed.
REGRESSION: org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch
Error Message:
No registered leader was found, collection:collection1 slice:shard1
Stack Trace:
org.apache.solr.common.SolrException: No registered leader was found, collection:collection1 slice:shard1
at __randomizedtesting.SeedInfo.seed([1D369A6D869E82A9:9CD01475F1C1E295]:0)
at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:481)
at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:295)
at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:116)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:679)
FAILED: org.apache.solr.core.OpenCloseCoreStressTest.test10MinutesNew
Error Message:
Core 00000_core bad! expected:<370> but was:<368>
Stack Trace:
java.lang.AssertionError: Core 00000_core bad! expected:<370> but was:<368>
at __randomizedtesting.SeedInfo.seed([1D369A6D869E82A9:2713224CF450681D]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.solr.core.OpenCloseCoreStressTest.checkResults(OpenCloseCoreStressTest.java:304)
at org.apache.solr.core.OpenCloseCoreStressTest.doStress(OpenCloseCoreStressTest.java:202)
at org.apache.solr.core.OpenCloseCoreStressTest.test10MinutesNew(OpenCloseCoreStressTest.java:134)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:679)
Build Log:
[...truncated 8539 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4] 2> 0 T3170 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 5 T3170 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362816809923
[junit4:junit4] 2> 6 T3170 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 7 T3171 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 10 T3171 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 10 T3171 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 10 T3171 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 10 T3171 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 12 T3171 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362816809922/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 107 T3170 oasc.ZkTestServer.run start zk server on port:13897
[junit4:junit4] 2> 107 T3170 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:13897 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@448ccec6
[junit4:junit4] 2> 108 T3170 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 109 T3176 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:13897. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 109 T3176 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:13897, initiating session
[junit4:junit4] 2> 109 T3172 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:52774
[junit4:junit4] 2> 110 T3172 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:52774
[junit4:junit4] 2> 110 T3174 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 112 T3174 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4e363bca0000 with negotiated timeout 10000 for client /140.211.11.196:52774
[junit4:junit4] 2> 112 T3176 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:13897, sessionid = 0x13d4e363bca0000, negotiated timeout = 10000
[junit4:junit4] 2> 113 T3177 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@448ccec6 name:ZooKeeperConnection Watcher:127.0.0.1:13897 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 113 T3170 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 113 T3170 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 116 T3175 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4e363bca0000
[junit4:junit4] 2> 117 T3177 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 118 T3172 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:52774 which had sessionid 0x13d4e363bca0000
[junit4:junit4] 2> 117 T3170 oaz.ZooKeeper.close Session: 0x13d4e363bca0000 closed
[junit4:junit4] 2> 118 T3170 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:13897/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@109907f8
[junit4:junit4] 2> 119 T3170 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 119 T3178 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:13897. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 119 T3178 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:13897, initiating session
[junit4:junit4] 2> 119 T3172 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:47802
[junit4:junit4] 2> 120 T3172 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:47802
[junit4:junit4] 2> 121 T3174 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4e363bca0001 with negotiated timeout 10000 for client /140.211.11.196:47802
[junit4:junit4] 2> 121 T3178 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:13897, sessionid = 0x13d4e363bca0001, negotiated timeout = 10000
[junit4:junit4] 2> 121 T3179 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@109907f8 name:ZooKeeperConnection Watcher:127.0.0.1:13897/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 121 T3170 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 121 T3170 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 131 T3170 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 134 T3170 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 141 T3170 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 143 T3170 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 144 T3170 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 157 T3170 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 158 T3170 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 261 T3170 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 262 T3170 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 265 T3170 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 265 T3170 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 275 T3170 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 276 T3170 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 278 T3170 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 279 T3170 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 281 T3170 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 282 T3170 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 284 T3170 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 285 T3170 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 287 T3170 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 288 T3170 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 290 T3175 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4e363bca0001
[junit4:junit4] 2> 291 T3172 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:47802 which had sessionid 0x13d4e363bca0001
[junit4:junit4] 2> 292 T3179 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 292 T3170 oaz.ZooKeeper.close Session: 0x13d4e363bca0001 closed
[junit4:junit4] 2> 542 T3170 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 547 T3170 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:55412
[junit4:junit4] 2> 547 T3170 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 548 T3170 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 548 T3170 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362816810210
[junit4:junit4] 2> 549 T3170 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362816810210/solr.xml
[junit4:junit4] 2> 549 T3170 oasc.CoreContainer.<init> New CoreContainer 1002213619
[junit4:junit4] 2> 550 T3170 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362816810210/'
[junit4:junit4] 2> 550 T3170 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362816810210/'
[junit4:junit4] 2> 613 T3170 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 613 T3170 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 614 T3170 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 614 T3170 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 614 T3170 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 615 T3170 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 615 T3170 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 616 T3170 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 616 T3170 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 616 T3170 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 639 T3170 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 659 T3170 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:13897/solr
[junit4:junit4] 2> 660 T3170 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 661 T3170 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:13897 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@58590fa5
[junit4:junit4] 2> 662 T3170 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 662 T3189 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:13897. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 663 T3189 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:13897, initiating session
[junit4:junit4] 2> 663 T3172 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:13183
[junit4:junit4] 2> 664 T3172 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:13183
[junit4:junit4] 2> 665 T3174 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4e363bca0002 with negotiated timeout 20000 for client /140.211.11.196:13183
[junit4:junit4] 2> 665 T3189 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:13897, sessionid = 0x13d4e363bca0002, negotiated timeout = 20000
[junit4:junit4] 2> 666 T3190 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@58590fa5 name:ZooKeeperConnection Watcher:127.0.0.1:13897 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 666 T3170 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 667 T3175 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4e363bca0002
[junit4:junit4] 2> 674 T3190 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 675 T3172 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:13183 which had sessionid 0x13d4e363bca0002
[junit4:junit4] 2> 674 T3170 oaz.ZooKeeper.close Session: 0x13d4e363bca0002 closed
[junit4:junit4] 2> 675 T3170 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 686 T3170 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:13897/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@7cd11364
[junit4:junit4] 2> 687 T3170 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 688 T3191 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:13897. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 688 T3191 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:13897, initiating session
[junit4:junit4] 2> 688 T3172 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:34817
[junit4:junit4] 2> 688 T3172 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:34817
[junit4:junit4] 2> 690 T3174 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4e363bca0003 with negotiated timeout 20000 for client /140.211.11.196:34817
[junit4:junit4] 2> 690 T3191 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:13897, sessionid = 0x13d4e363bca0003, negotiated timeout = 20000
[junit4:junit4] 2> 690 T3192 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7cd11364 name:ZooKeeperConnection Watcher:127.0.0.1:13897/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 690 T3170 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 692 T3175 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4e363bca0003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 702 T3170 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 704 T3170 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55412_
[junit4:junit4] 2> 704 T3175 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4e363bca0003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:55412_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:55412_
[junit4:junit4] 2> 705 T3170 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55412_
[junit4:junit4] 2> 715 T3170 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 727 T3175 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4e363bca0003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 735 T3170 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 746 T3170 oasc.Overseer.start Overseer (id=89313562455572483-127.0.0.1:55412_-n_0000000000) starting
[junit4:junit4] 2> 747 T3175 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4e363bca0003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 748 T3175 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4e363bca0003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 750 T3175 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4e363bca0003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 761 T3175 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4e363bca0003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 762 T3194 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 763 T3170 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 771 T3170 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 773 T3170 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 775 T3193 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 780 T3195 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362816810210/collection1
[junit4:junit4] 2> 780 T3195 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 781 T3195 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 781 T3195 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 783 T3195 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362816810210/collection1/'
[junit4:junit4] 2> 784 T3195 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362816810210/collection1/lib/README' to classloader
[junit4:junit4] 2> 785 T3195 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362816810210/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 842 T3195 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 903 T3195 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1004 T3195 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 1011 T3195 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 1663 T3195 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1675 T3195 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1680 T3195 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1694 T3195 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1701 T3195 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1713 T3195 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1714 T3195 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1714 T3195 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 1714 T3195 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1715 T3195 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1715 T3195 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 1716 T3195 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362816810210/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362816809922/control/data/
[junit4:junit4] 2> 1716 T3195 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@b05236
[junit4:junit4] 2> 1716 T3195 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1717 T3195 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362816809922/control/data forceNew: false
[junit4:junit4] 2> 1717 T3195 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362816809922/control/data/index/
[junit4:junit4] 2> 1719 T3195 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362816809922/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1719 T3195 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362816809922/control/data/index forceNew: false
[junit4:junit4] 2> 1723 T3195 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@48ddf162 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5b6fd438; maxCacheMB=0.9951171875 maxMergeSizeMB=0.47265625)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 1723 T3195 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 1726 T3195 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1726 T3195 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1727 T3195 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1727 T3195 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1728 T3195 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1728 T3195 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1728 T3195 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1728 T3195 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1729 T3195 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1741 T3195 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1751 T3195 oass.SolrIndexSearcher.<init> Opening Searcher@484834b7 main
[junit4:junit4] 2> 1751 T3195 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362816809922/control/data/tlog
[junit4:junit4] 2> 1753 T3195 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1753 T3195 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1756 T3196 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@484834b7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1758 T3195 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1758 T3195 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1759 T3175 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4e363bca0003 type:create cxid:0x55 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 2279 T3193 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2280 T3193 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:55412_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55412"}
[junit4:junit4] 2> 2280 T3193 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 2280 T3193 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 2281 T3175 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4e363bca0003 type:create cxid:0x5d zxid:0x2d txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 2298 T3192 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 2785 T3195 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 2785 T3195 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55412 collection:control_collection shard:shard1
[junit4:junit4] 2> 2786 T3195 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 2800 T3175 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4e363bca0003 type:delete cxid:0x77 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 2800 T3195 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 2801 T3175 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4e363bca0003 type:create cxid:0x78 zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2812 T3195 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 2812 T3195 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 2812 T3195 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55412/collection1/
[junit4:junit4] 2> 2812 T3195 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 2813 T3195 oasc.SyncStrategy.syncToMe http://127.0.0.1:55412/collection1/ has no replicas
[junit4:junit4] 2> 2813 T3195 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:55412/collection1/
[junit4:junit4] 2> 2813 T3195 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 2816 T3175 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4e363bca0003 type:create cxid:0x82 zxid:0x3c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3801 T3193 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3809 T3192 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3845 T3195 oasc.ZkController.register We are http://127.0.0.1:55412/collection1/ and leader is http://127.0.0.1:55412/collection1/
[junit4:junit4] 2> 3845 T3195 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55412
[junit4:junit4] 2> 3845 T3195 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 3845 T3195 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 3846 T3195 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3847 T3195 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3848 T3170 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4:junit4] 2> 3849 T3170 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 3849 T3170 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 3868 T3170 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 3869 T3170 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:13897/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@785676fe
[junit4:junit4] 2> 3870 T3170 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3871 T3198 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:13897. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 3871 T3198 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:13897, initiating session
[junit4:junit4] 2> 3871 T3172 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:51230
[junit4:junit4] 2> 3872 T3172 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:51230
[junit4:junit4] 2> 3873 T3174 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4e363bca0004 with negotiated timeout 10000 for client /140.211.11.196:51230
[junit4:junit4] 2> 3873 T3198 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:13897, sessionid = 0x13d4e363bca0004, negotiated timeout = 10000
[junit4:junit4] 2> 3873 T3199 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@785676fe name:ZooKeeperConnection Watcher:127.0.0.1:13897/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3873 T3170 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3875 T3170 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 3876 T3170 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 4131 T3170 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 4134 T3170 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:32197
[junit4:junit4] 2> 4135 T3170 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 4135 T3170 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 4136 T3170 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362816813794
[junit4:junit4] 2> 4136 T3170 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362816813794/solr.xml
[junit4:junit4] 2> 4137 T3170 oasc.CoreContainer.<init> New CoreContainer 1420682540
[junit4:junit4] 2> 4137 T3170 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362816813794/'
[junit4:junit4] 2> 4138 T3170 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362816813794/'
[junit4:junit4] 2> 4215 T3170 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 4216 T3170 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 4216 T3170 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 4217 T3170 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 4217 T3170 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 4218 T3170 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 4218 T3170 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 4219 T3170 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 4219 T3170 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 4219 T3170 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 4245 T3170 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 4269 T3170 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:13897/solr
[junit4:junit4] 2> 4270 T3170 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 4270 T3170 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:13897 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@7b8c2cca
[junit4:junit4] 2> 4271 T3170 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4271 T3209 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:13897. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 4272 T3209 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:13897, initiating session
[junit4:junit4] 2> 4273 T3172 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:10766
[junit4:junit4] 2> 4273 T3172 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:10766
[junit4:junit4] 2> 4274 T3174 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4e363bca0005 with negotiated timeout 20000 for client /140.211.11.196:10766
[junit4:junit4] 2> 4274 T3209 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:13897, sessionid = 0x13d4e363bca0005, negotiated timeout = 20000
[junit4:junit4] 2> 4275 T3210 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7b8c2cca name:ZooKeeperConnection Watcher:127.0.0.1:13897 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4275 T3170 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4276 T3175 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4e363bca0005
[junit4:junit4] 2> 4277 T3210 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 4277 T3172 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:10766 which had sessionid 0x13d4e363bca0005
[junit4:junit4] 2> 4277 T3170 oaz.ZooKeeper.close Session: 0x13d4e363bca0005 closed
[junit4:junit4] 2> 4277 T3170 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 4289 T3170 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:13897/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@4593b6b1
[junit4:junit4] 2> 4290 T3170 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4290 T3211 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:13897. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 4291 T3211 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:13897, initiating session
[junit4:junit4] 2> 4291 T3172 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:41532
[junit4:junit4] 2> 4291 T3172 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:41532
[junit4:junit4] 2> 4292 T3174 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4e363bca0006 with negotiated timeout 20000 for client /140.211.11.196:41532
[junit4:junit4] 2> 4292 T3211 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:13897, sessionid = 0x13d4e363bca0006, negotiated timeout = 20000
[junit4:junit4] 2> 4293 T3212 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4593b6b1 name:ZooKeeperConnection Watcher:127.0.0.1:13897/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4293 T3170 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4294 T3175 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4e363bca0006 type:create cxid:0x1 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4295 T3175 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4e363bca0006 type:create cxid:0x2 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4297 T3170 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 5299 T3170 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32197_
[junit4:junit4] 2> 5300 T3175 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4e363bca0006 type:delete cxid:0xb zxid:0x4c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:32197_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:32197_
[junit4:junit4] 2> 5301 T3170 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:32197_
[junit4:junit4] 2> 5304 T3192 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 5304 T3199 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5304 T3212 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5305 T3192 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5312 T3213 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362816813794/collection1
[junit4:junit4] 2> 5313 T3213 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 5313 T3213 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 5314 T3213 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 5314 T3193 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 5315 T3193 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:55412_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55412"}
[junit4:junit4] 2> 5315 T3213 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362816813794/collection1/'
[junit4:junit4] 2> 5316 T3213 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362816813794/collection1/lib/README' to classloader
[junit4:junit4] 2> 5317 T3213 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362816813794/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 5327 T3192 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5327 T3199 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5327 T3212 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5370 T3213 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 5449 T3213 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 5550 T3213 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 5560 T3213 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 6311 T3213 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 6325 T3213 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 6330 T3213 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 6342 T3213 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 6347 T3213 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 6351 T3213 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 6352 T3213 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 6353 T3213 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 6353 T3213 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 6354 T3213 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 6354 T3213 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 6354 T3213 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362816813794/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362816809922/jetty1/
[junit4:junit4] 2> 6355 T3213 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@b05236
[junit4:junit4] 2> 6355 T3213 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 6356 T3213 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362816809922/jetty1 forceNew: false
[junit4:junit4] 2> 6356 T3213 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362816809922/jetty1/index/
[junit4:junit4] 2> 6357 T3213 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362816809922/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 6357 T3213 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362816809922/jetty1/index forceNew: false
[junit4:junit4] 2> 6360 T3213 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@2c3a7345 lockFactory=org.apache.lucene.store.NativeFSLockFactory@35103068; maxCacheMB=0.9951171875 maxMergeSizeMB=0.47265625)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 6360 T3213 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 6363 T3213 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 6363 T3213 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 6364 T3213 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 6364 T3213 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 6365 T3213 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 6365 T3213 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 6365 T3213 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 6366 T3213 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 6366 T3213 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 6380 T3213 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 6389 T3213 oass.SolrIndexSearcher.<init> Opening Searcher@43a40e52 main
[junit4:junit4] 2> 6389 T3213 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362816809922/jetty1/tlog
[junit4:junit4] 2> 6390 T3213 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 6391 T3213 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 6394 T3214 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@43a40e52 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 6396 T3213 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 6397 T3213 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 6831 T3193 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6832 T3193 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:32197_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:32197"}
[junit4:junit4] 2> 6832 T3193 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 6833 T3193 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 6843 T3199 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6843 T3192 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6843 T3212 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7400 T3213 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 7400 T3213 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:32197 collection:collection1 shard:shard1
[junit4:junit4] 2> 7401 T3213 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 7422 T3175 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4e363bca0006 type:delete cxid:0x48 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 7423 T3213 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 7423 T3175 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4e363bca0006 type:create cxid:0x49 zxid:0x5d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7434 T3213 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 7435 T3213 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 7435 T3213 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:32197/collection1/
[junit4:junit4] 2> 7435 T3213 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 7435 T3213 oasc.SyncStrategy.syncToMe http://127.0.0.1:32197/collection1/ has no replicas
[junit4:junit4] 2> 7436 T3213 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:32197/collection1/
[junit4:junit4] 2> 7436 T3213 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 7446 T3175 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4e363bca0006 type:create cxid:0x53 zxid:0x61 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8352 T3193 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8379 T3192 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8379 T3199 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8379 T3212 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8427 T3213 oasc.ZkController.register We are http://127.0.0.1:32197/collection1/ and leader is http://127.0.0.1:32197/collection1/
[junit4:junit4] 2> 8427 T3213 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:32197
[junit4:junit4] 2> 8427 T3213 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 8427 T3213 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 8428 T3213 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 8429 T3213 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8430 T3170 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4:junit4] 2> 8431 T3170 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 8431 T3170 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 8696 T3170 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 8698 T3170 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:59994
[junit4:junit4] 2> 8699 T3170 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 8699 T3170 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 8700 T3170 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362816818365
[junit4:junit4] 2> 8700 T3170 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362816818365/solr.xml
[junit4:junit4] 2> 8700 T3170 oasc.CoreContainer.<init> New CoreContainer 446319396
[junit4:junit4] 2> 8701 T3170 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362816818365/'
[junit4:junit4] 2> 8701 T3170 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362816818365/'
[junit4:junit4] 2> 8778 T3170 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 8778 T3170 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 8779 T3170 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 8779 T3170 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 8780 T3170 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 8780 T3170 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 8781 T3170 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 8781 T3170 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 8781 T3170 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 8782 T3170 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 8814 T3170 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 8838 T3170 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:13897/solr
[junit4:junit4] 2> 8839 T3170 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 8840 T3170 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:13897 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@13deb47e
[junit4:junit4] 2> 8841 T3170 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8841 T3225 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:13897. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 8842 T3225 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:13897, initiating session
[junit4:junit4] 2> 8843 T3172 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:55688
[junit4:junit4] 2> 8843 T3172 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:55688
[junit4:junit4] 2> 8845 T3174 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4e363bca0007 with negotiated timeout 20000 for client /140.211.11.196:55688
[junit4:junit4] 2> 8845 T3225 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:13897, sessionid = 0x13d4e363bca0007, negotiated timeout = 20000
[junit4:junit4] 2> 8845 T3226 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13deb47e name:ZooKeeperConnection Watcher:127.0.0.1:13897 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8845 T3170 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8846 T3175 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4e363bca0007
[junit4:junit4] 2> 8848 T3226 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 8848 T3172 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:55688 which had sessionid 0x13d4e363bca0007
[junit4:junit4] 2> 8848 T3170 oaz.ZooKeeper.close Session: 0x13d4e363bca0007 closed
[junit4:junit4] 2> 8848 T3170 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 8859 T3170 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:13897/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@3a18c3b5
[junit4:junit4] 2> 8860 T3170 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8861 T3227 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:13897. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 8861 T3227 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:13897, initiating session
[junit4:junit4] 2> 8861 T3172 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:21324
[junit4:junit4] 2> 8862 T3172 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:21324
[junit4:junit4] 2> 8863 T3174 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4e363bca0008 with negotiated timeout 20000 for client /140.211.11.196:21324
[junit4:junit4] 2> 8863 T3227 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:13897, sessionid = 0x13d4e363bca0008, negotiated timeout = 20000
[junit4:junit4] 2> 8863 T3228 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3a18c3b5 name:ZooKeeperConnection Watcher:127.0.0.1:13897/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8864 T3170 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8864 T3175 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4e363bca0008 type:create cxid:0x1 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8865 T3175 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4e363bca0008 type:create cxid:0x2 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8874 T3170 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 9876 T3170 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59994_
[junit4:junit4] 2> 9877 T3175 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4e363bca0008 type:delete cxid:0xb zxid:0x70 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:59994_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:59994_
[junit4:junit4] 2> 9887 T3170 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59994_
[junit4:junit4] 2> 9909 T3199 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9909 T3212 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9909 T3192 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9910 T3228 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9910 T3199 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9911 T3212 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9911 T3193 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9957 T3193 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:32197_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:32197"}
[junit4:junit4] 2> 9963 T3229 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362816818365/collection1
[junit4:junit4] 2> 9963 T3229 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 10001 T3229 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 10001 T3229 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 10015 T3229 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362816818365/collection1/'
[junit4:junit4] 2> 10016 T3229 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362816818365/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 10016 T3229 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362816818365/collection1/lib/README' to classloader
[junit4:junit4] 2> 10025 T3199 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10025 T3212 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10025 T3228 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10028 T3192 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 10028 T3192 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10067 T3229 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 10128 T3229 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 10229 T3229 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 10238 T3229 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 10927 T3229 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 10938 T3229 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 10942 T3229 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 10952 T3229 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 10956 T3229 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 10959 T3229 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 10960 T3229 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 10961 T3229 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 10961 T3229 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 10962 T3229 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 10962 T3229 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 10962 T3229 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362816818365/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362816809922/jetty2/
[junit4:junit4] 2> 10963 T3229 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@b05236
[junit4:junit4] 2> 10963 T3229 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 10964 T3229 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362816809922/jetty2 forceNew: false
[junit4:junit4] 2> 10964 T3229 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362816809922/jetty2/index/
[junit4:junit4] 2> 10964 T3229 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362816809922/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 10965 T3229 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362816809922/jetty2/index forceNew: false
[junit4:junit4] 2> 10967 T3229 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@2640c8f2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@48b1c600; maxCacheMB=0.9951171875 maxMergeSizeMB=0.47265625)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 10967 T3229 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 10969 T3229 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 10969 T3229 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 10969 T3229 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 10970 T3229 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 10970 T3229 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 10970 T3229 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 10970 T3229 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 10971 T3229 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 10971 T3229 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 10979 T3229 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 10985 T3229 oass.SolrIndexSearcher.<init> Opening Searcher@56fe7303 main
[junit4:junit4] 2> 10986 T3229 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362816809922/jetty2/tlog
[junit4:junit4] 2> 10986 T3229 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 10987 T3229 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 10989 T3230 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@56fe7303 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 10991 T3229 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 10991 T3229 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 11529 T3193 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11530 T3193 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:59994_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59994"}
[junit4:junit4] 2> 11530 T3193 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 11530 T3193 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 11542 T3228 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11542 T3199 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11542 T3212 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11542 T3192 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11994 T3229 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 11994 T3229 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59994 collection:collection1 shard:shard2
[junit4:junit4] 2> 11995 T3229 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 12010 T3175 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4e363bca0008 type:delete cxid:0x47 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4] 2> 12016 T3229 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 12017 T3175 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4e363bca0008 type:create cxid:0x48 zxid:0x80 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12019 T3229 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 12019 T3229 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 12019 T3229 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:59994/collection1/
[junit4:junit4] 2> 12020 T3229 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 12020 T3229 oasc.SyncStrategy.syncToMe http://127.0.0.1:59994/collection1/ has no replicas
[junit4:junit4] 2> 12020 T3229 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:59994/collection1/
[junit4:junit4] 2> 12020 T3229 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 12028 T3175 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4e363bca0008 type:create cxid:0x51 zxid:0x83 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 13045 T3193 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13066 T3199 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13066 T3212 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13066 T3228 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13066 T3192 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13102 T3229 oasc.ZkController.register We are http://127.0.0.1:59994/collection1/ and leader is http://127.0.0.1:59994/collection1/
[junit4:junit4] 2> 13102 T3229 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59994
[junit4:junit4] 2> 13102 T3229 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 13102 T3229 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 13102 T3229 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 13104 T3229 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13106 T3170 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4:junit4] 2> 13106 T3170 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 13107 T3170 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 13448 T3170 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 13451 T3170 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:40393
[junit4:junit4] 2> 13451 T3170 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 13452 T3170 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 13452 T3170 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362816823049
[junit4:junit4] 2> 13453 T3170 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362816823049/solr.xml
[junit4:junit4] 2> 13453 T3170 oasc.CoreContainer.<init> New CoreContainer 628597589
[junit4:junit4] 2> 13454 T3170 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362816823049/'
[junit4:junit4] 2> 13454 T3170 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362816823049/'
[junit4:junit4] 2> 13513 T3170 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 13513 T3170 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 13514 T3170 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 13514 T3170 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 13514 T3170 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 13515 T3170 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 13515 T3170 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 13516 T3170 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 13516 T3170 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 13516 T3170 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 13537 T3170 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 13557 T3170 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:13897/solr
[junit4:junit4] 2> 13558 T3170 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 13558 T3170 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:13897 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@3e9daeb5
[junit4:junit4] 2> 13559 T3170 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 13559 T3241 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:13897. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 13560 T3241 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:13897, initiating session
[junit4:junit4] 2> 13561 T3172 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:48099
[junit4:junit4] 2> 13561 T3172 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:48099
[junit4:junit4] 2> 13562 T3174 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4e363bca0009 with negotiated timeout 20000 for client /140.211.11.196:48099
[junit4:junit4] 2> 13563 T3241 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:13897, sessionid = 0x13d4e363bca0009, negotiated timeout = 20000
[junit4:junit4] 2> 13563 T3242 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3e9daeb5 name:ZooKeeperConnection Watcher:127.0.0.1:13897 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 13563 T3170 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 13564 T3175 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4e363bca0009
[junit4:junit4] 2> 13565 T3242 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 13565 T3172 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:48099 which had sessionid 0x13d4e363bca0009
[junit4:junit4] 2> 13565 T3170 oaz.ZooKeeper.close Session: 0x13d4e363bca0009 closed
[junit4:junit4] 2> 13566 T3170 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 13577 T3170 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:13897/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@24afdc39
[junit4:junit4] 2> 13577 T3170 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 13578 T3243 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:13897. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 13578 T3243 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:13897, initiating session
[junit4:junit4] 2> 13578 T3172 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:55634
[junit4:junit4] 2> 13579 T3172 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:55634
[junit4:junit4] 2> 13580 T3174 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4e363bca000a with negotiated timeout 20000 for client /140.211.11.196:55634
[junit4:junit4] 2> 13580 T3243 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:13897, sessionid = 0x13d4e363bca000a, negotiated timeout = 20000
[junit4:junit4] 2> 13580 T3244 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@24afdc39 name:ZooKeeperConnection Watcher:127.0.0.1:13897/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 13581 T3170 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 13581 T3175 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4e363bca000a type:create cxid:0x1 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 13582 T3175 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4e363bca000a type:create cxid:0x2 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 13592 T3170 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 14575 T3193 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14576 T3193 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:59994_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59994"}
[junit4:junit4] 2> 14585 T3199 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14585 T3244 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14585 T3192 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14585 T3212 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14585 T3228 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14594 T3170 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40393_
[junit4:junit4] 2> 14595 T3175 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4e363bca000a type:delete cxid:0xd zxid:0x96 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:40393_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:40393_
[junit4:junit4] 2> 14595 T3170 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40393_
[junit4:junit4] 2> 14597 T3199 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14597 T3192 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14597 T3228 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14597 T3212 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14597 T3244 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14598 T3244 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14598 T3199 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14599 T3192 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14599 T3228 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14600 T3212 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14606 T3245 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362816823049/collection1
[junit4:junit4] 2> 14606 T3245 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 14606 T3245 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 14607 T3245 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 14608 T3245 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362816823049/collection1/'
[junit4:junit4] 2> 14609 T3245 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362816823049/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 14610 T3245 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362816823049/collection1/lib/README' to classloader
[junit4:junit4] 2> 14670 T3245 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 14739 T3245 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 14839 T3245 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 14845 T3245 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 15482 T3245 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 15492 T3245 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 15496 T3245 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 15505 T3245 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15509 T3245 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15512 T3245 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15513 T3245 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 15514 T3245 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 15514 T3245 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15515 T3245 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 15515 T3245 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 15515 T3245 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362816823049/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362816809922/jetty3/
[junit4:junit4] 2> 15515 T3245 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@b05236
[junit4:junit4] 2> 15515 T3245 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 15516 T3245 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362816809922/jetty3 forceNew: false
[junit4:junit4] 2> 15516 T3245 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362816809922/jetty3/index/
[junit4:junit4] 2> 15516 T3245 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362816809922/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 15517 T3245 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362816809922/jetty3/index forceNew: false
[junit4:junit4] 2> 15519 T3245 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@23017405 lockFactory=org.apache.lucene.store.NativeFSLockFactory@94470c6; maxCacheMB=0.9951171875 maxMergeSizeMB=0.47265625)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 15519 T3245 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 15521 T3245 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 15521 T3245 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 15521 T3245 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 15522 T3245 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 15522 T3245 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 15522 T3245 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 15522 T3245 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 15523 T3245 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 15523 T3245 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 15530 T3245 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 15535 T3245 oass.SolrIndexSearcher.<init> Opening Searcher@3e2a5b8b main
[junit4:junit4] 2> 15535 T3245 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362816809922/jetty3/tlog
[junit4:junit4] 2> 15535 T3245 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 15536 T3245 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 15538 T3246 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3e2a5b8b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 15539 T3245 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 15539 T3245 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16089 T3193 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16090 T3193 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:40393_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40393"}
[junit4:junit4] 2> 16090 T3193 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 16090 T3193 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 16103 T3199 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16103 T3228 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16103 T3192 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16103 T3244 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16103 T3212 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16542 T3245 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 16542 T3245 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:40393 collection:collection1 shard:shard1
[junit4:junit4] 2> 16546 T3245 oasc.ZkController.register We are http://127.0.0.1:40393/collection1/ and leader is http://127.0.0.1:32197/collection1/
[junit4:junit4] 2> 16546 T3245 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40393
[junit4:junit4] 2> 16546 T3245 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 16546 T3245 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C143 name=collection1 org.apache.solr.core.SolrCore@a33cd75 url=http://127.0.0.1:40393/collection1 node=127.0.0.1:40393_ C143_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:40393_, base_url=http://127.0.0.1:40393}
[junit4:junit4] 2> 16547 T3247 C143 P40393 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 16548 T3247 C143 P40393 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 16548 T3245 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16548 T3247 C143 P40393 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 16548 T3247 C143 P40393 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16549 T3170 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4:junit4] 2> 16550 T3247 C143 P40393 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16550 T3170 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 16550 T3170 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16574 T3170 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16576 T3170 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16588 T3203 oasc.CoreContainer.create Creating SolrCore 'onenodecollectioncore' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362816813794/onenodecollectioncore
[junit4:junit4] 2> 16588 T3203 oasc.ZkController.createCollectionZkNode Check for collection zkNode:onenodecollection
[junit4:junit4] 2> 16589 T3203 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:onenodecollection
[junit4:junit4] 2> 16589 T3203 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 16590 T3203 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 16591 T3203 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection
[junit4:junit4] 2> 16593 T3203 oasc.ZkController.readConfigName Load collection config from:/collections/onenodecollection
[junit4:junit4] 2> 16595 T3203 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362816813794/onenodecollectioncore/'
[junit4:junit4] 2> 16664 T3203 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 16731 T3203 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 16832 T3203 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 16838 T3203 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 17496 T3203 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 17506 T3203 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 17510 T3203 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 17520 T3203 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 17525 T3203 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 17529 T3203 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 17530 T3203 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 17531 T3203 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 17531 T3203 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 17532 T3203 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 17532 T3203 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 17532 T3203 oasc.SolrCore.<init> [onenodecollectioncore] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362816813794/onenodecollectioncore/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362816809923/onenodecollection/
[junit4:junit4] 2> 17532 T3203 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@b05236
[junit4:junit4] 2> 17533 T3203 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 17533 T3203 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362816809923/onenodecollection forceNew: false
[junit4:junit4] 2> 17534 T3203 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362816809923/onenodecollection/index/
[junit4:junit4] 2> 17534 T3203 oasc.SolrCore.initIndex WARNING [onenodecollectioncore] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362816809923/onenodecollection/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 17535 T3203 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362816809923/onenodecollection/index forceNew: false
[junit4:junit4] 2> 17537 T3203 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@33967686 lockFactory=org.apache.lucene.store.NativeFSLockFactory@44a4df5b; maxCacheMB=0.9951171875 maxMergeSizeMB=0.47265625)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 17537 T3203 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 17539 T3203 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 17539 T3203 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 17540 T3203 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 17540 T3203 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 17540 T3203 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 17541 T3203 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 17541 T3203 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 17541 T3203 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 17542 T3203 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 17548 T3203 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 17553 T3203 oass.SolrIndexSearcher.<init> Opening Searcher@5da7e1b4 main
[junit4:junit4] 2> 17553 T3203 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362816809923/onenodecollection/tlog
[junit4:junit4] 2> 17554 T3203 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 17555 T3203 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 17557 T3249 oasc.SolrCore.registerSearcher [onenodecollectioncore] Registered new searcher Searcher@5da7e1b4 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 17558 T3203 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4] 2> 17612 T3193 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17613 T3193 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:40393_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40393"}
[junit4:junit4] 2> 17616 T3193 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "node_name":"127.0.0.1:32197_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:32197"}
[junit4:junit4] 2> 17616 T3193 oasc.Overseer$ClusterStateUpdater.createCollection Create collection onenodecollection with numShards 1
[junit4:junit4] 2> 17616 T3193 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 17628 T3192 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17628 T3228 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17628 T3212 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17628 T3244 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17628 T3199 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18564 T3203 oasc.CoreContainer.registerCore registering core: onenodecollectioncore
[junit4:junit4] 2> 18565 T3203 oasc.ZkController.register Register replica - core:onenodecollectioncore address:http://127.0.0.1:32197 collection:onenodecollection shard:shard1
[junit4:junit4] 2> 18566 T3203 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leader_elect/shard1/election
[junit4:junit4] 2> 18577 T3202 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:40393__collection1&state=recovering&nodeName=127.0.0.1:40393_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002
[junit4:junit4] 2> 18586 T3175 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4e363bca0006 type:delete cxid:0xa1 zxid:0xad txntype:-1 reqpath:n/a Error Path:/solr/collections/onenodecollection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/onenodecollection/leaders
[junit4:junit4] 2> 18587 T3203 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 18588 T3175 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4e363bca0006 type:create cxid:0xa2 zxid:0xae txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 18600 T3203 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 18600 T3203 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 18601 T3203 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:32197/onenodecollectioncore/
[junit4:junit4] 2> 18601 T3203 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 18601 T3203 oasc.SyncStrategy.syncToMe http://127.0.0.1:32197/onenodecollectioncore/ has no replicas
[junit4:junit4] 2> 18602 T3203 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:32197/onenodecollectioncore/
[junit4:junit4] 2> 18602 T3203 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leaders/shard1
[junit4:junit4] 2> 18619 T3175 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d4e363bca0006 type:create cxid:0xac zxid:0xb2 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 19138 T3193 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19162 T3192 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 19162 T3244 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 19162 T3212 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 19162 T3228 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 19162 T3199 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 19195 T3203 oasc.ZkController.register We are http://127.0.0.1:32197/onenodecollectioncore/ and leader is http://127.0.0.1:32197/onenodecollectioncore/
[junit4:junit4] 2> 19196 T3203 oasc.ZkController.register No LogReplay needed for core=onenodecollectioncore baseURL=http://127.0.0.1:32197
[junit4:junit4] 2> 19196 T3203 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 19196 T3203 oasc.ZkController.publish publishing core=onenodecollectioncore state=active
[junit4:junit4] 2> 19198 T3203 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19199 T3203 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {numShards=1&roles=none&name=onenodecollectioncore&action=CREATE&collection=onenodecollection&dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362816809923/onenodecollection&wt=javabin&version=2} status=0 QTime=2611
[junit4:junit4] 2> 19200 T3170 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: onenodecollection failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 19201 T3170 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20202 T3170 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C143_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:40393_, base_url=http://127.0.0.1:40393}
[junit4:junit4] 2> 20578 T3247 C143 P40393 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:32197/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 20578 T3247 C143 P40393 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:40393 START replicas=[http://127.0.0.1:32197/collection1/] nUpdates=100
[junit4:junit4] 2> 20578 T3247 C143 P40393 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 20579 T3247 C143 P40393 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 20579 T3247 C143 P40393 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 20579 T3247 C143 P40393 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 20579 T3247 C143 P40393 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 20579 T3247 C143 P40393 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:32197/collection1/. core=collection1
[junit4:junit4] 2> 20580 T3247 C143 P40393 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C144 name=collection1 org.apache.solr.core.SolrCore@67a25ef8 url=http://127.0.0.1:32197/collection1 node=127.0.0.1:32197_ C144_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:32197_, base_url=http://127.0.0.1:32197, leader=true}
[junit4:junit4] 2> 20587 T3204 C144 P32197 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=2
[junit4:junit4] 2> 20598 T3205 C144 P32197 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 20600 T3205 C144 P32197 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@2c3a7345 lockFactory=org.apache.lucene.store.NativeFSLockFactory@35103068; maxCacheMB=0.9951171875 maxMergeSizeMB=0.47265625)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 20601 T3205 C144 P32197 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 20602 T3205 C144 P32197 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@2c3a7345 lockFactory=org.apache.lucene.store.NativeFSLockFactory@35103068; maxCacheMB=0.9951171875 maxMergeSizeMB=0.47265625)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@2c3a7345 lockFactory=org.apache.lucene.store.NativeFSLockFactory@35103068; maxCacheMB=0.9951171875 maxMergeSizeMB=0.47265625)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 20602 T3205 C144 P32197 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 20603 T3205 C144 P32197 oass.SolrIndexSearcher.<init> Opening Searcher@619656c3 realtime
[junit4:junit4] 2> 20603 T3205 C144 P32197 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 20603 T3205 C144 P32197 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> 20604 T3247 C143 P40393 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 20604 T3247 C143 P40393 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 20606 T3206 C144 P32197 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 20607 T3206 C144 P32197 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 20607 T3247 C143 P40393 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 20607 T3247 C143 P40393 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 20607 T3247 C143 P40393 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 20610 T3206 C144 P32197 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 20611 T3247 C143 P40393 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 20612 T3247 C143 P40393 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362816809922/jetty3/index.20130309001350528 forceNew: false
[junit4:junit4] 2> 20612 T3247 C143 P40393 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@35fa760 lockFactory=org.apache.lucene.store.NativeFSLockFactory@43a9ebc5) fullCopy=false
[junit4:junit4] 2> 20615 T3206 C144 P32197 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 20616 T3247 C143 P40393 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 20617 T3247 C143 P40393 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 20617 T3247 C143 P40393 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 20619 T3247 C143 P40393 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@23017405 lockFactory=org.apache.lucene.store.NativeFSLockFactory@94470c6; maxCacheMB=0.9951171875 maxMergeSizeMB=0.47265625)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@23017405 lockFactory=org.apache.lucene.store.NativeFSLockFactory@94470c6; maxCacheMB=0.9951171875 maxMergeSizeMB=0.47265625)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 20619 T3247 C143 P40393 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 20620 T3247 C143 P40393 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 20620 T3247 C143 P40393 oass.SolrIndexSearcher.<init> Opening Searcher@fb79789 main
[junit4:junit4] 2> 20621 T3246 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@fb79789 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 20621 T3247 C143 P40393 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(org.apache.lucene.store.RAMDirectory@35fa760 lockFactory=org.apache.lucene.store.NativeFSLockFactory@43a9ebc5)
[junit4:junit4] 2> 20621 T3247 C143 P40393 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 20621 T3247 C143 P40393 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 20622 T3247 C143 P40393 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 20622 T3247 C143 P40393 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 20623 T3247 C143 P40393 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 20672 T3193 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20673 T3193 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "node_name":"127.0.0.1:32197_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:32197"}
[junit4:junit4] 2> 20676 T3193 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:40393_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40393"}
[junit4:junit4] 2> 20687 T3199 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 20687 T3192 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 20687 T3228 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 20687 T3212 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 20687 T3244 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 21204 T3170 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21205 T3170 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: onenodecollection
[junit4:junit4] 2> 21206 T3170 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C145 name=onenodecollectioncore org.apache.solr.core.SolrCore@6863c4cf url=http://127.0.0.1:32197/onenodecollectioncore node=127.0.0.1:32197_ C145_STATE=coll:onenodecollection core:onenodecollectioncore props:{shard=shard1, roles=none, state=active, core=onenodecollectioncore, collection=onenodecollection, node_name=127.0.0.1:32197_, base_url=http://127.0.0.1:32197, leader=true}
[junit4:junit4] 2> 21237 T3207 C145 P32197 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@33967686 lockFactory=org.apache.lucene.store.NativeFSLockFactory@44a4df5b; maxCacheMB=0.9951171875 maxMergeSizeMB=0.47265625)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 21238 T3207 C145 P32197 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 21239 T3207 C145 P32197 /update {wt=javabin&version=2} {add=[1 (1429017021542039552)]} 0 5
[junit4:junit4] 2> 21247 T3207 C145 P32197 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 21250 T3207 C145 P32197 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@33967686 lockFactory=org.apache.lucene.store.NativeFSLockFactory@44a4df5b; maxCacheMB=0.9951171875 maxMergeSizeMB=0.47265625)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@33967686 lockFactory=org.apache.lucene.store.NativeFSLockFactory@44a4df5b; maxCacheMB=0.9951171875 maxMergeSizeMB=0.47265625)),segFN=segments_2,generation=2,filenames=[_0_MockVariableIntBlock_0.doc, _0_TestBloomFilteredLucene41Postings_0.tim, _0_MockVariableIntBlock_0.skp, _0_TestBloomFilteredLucene41Postings_0.tip, _0_TestBloomFilteredLucene41Postings_0.pos, _0_MockVariableIntBlock_0.pyl, _0_MockVariableIntBlock_0.tib, _0_Pulsing41_0.tim, _0_Pulsing41_0.tip, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.si, _0_MockVariableIntBlock_0.tii, _0.fnm, _0_TestBloomFilteredLucene41Postings_0.blm, _0_Asserting_0.dvd, _0_Asserting_0.dvm, _0.nvm, _0_MockRandom_0.skp, _0_MockRandom_0.tip, _0_MockRandom_0.frq, _0_MockRandom_0.sd, _0_Pulsing41_0.doc, _0_Pulsing41_0.pos, _0_MockRandom_0.doc, _0_MockVariableIntBlock_0.frq, _0_MockRandom_0.pos, _0_TestBloomFilteredLucene41Postings_0.doc, segments_2, _0.fdx, _0_MockRandom_0.pyl, _0_MockRandom_0.tim, _0.fdt]
[junit4:junit4] 2> 21250 T3207 C145 P32197 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[_0_MockVariableIntBlock_0.doc, _0_TestBloomFilteredLucene41Postings_0.tim, _0_MockVariableIntBlock_0.skp, _0_TestBloomFilteredLucene41Postings_0.tip, _0_TestBloomFilteredLucene41Postings_0.pos, _0_MockVariableIntBlock_0.pyl, _0_MockVariableIntBlock_0.tib, _0_Pulsing41_0.tim, _0_Pulsing41_0.tip, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.si, _0_MockVariableIntBlock_0.tii, _0.fnm, _0_TestBloomFilteredLucene41Postings_0.blm, _0_Asserting_0.dvd, _0_Asserting_0.dvm, _0.nvm, _0_MockRandom_0.skp, _0_MockRandom_0.tip, _0_MockRandom_0.frq, _0_MockRandom_0.sd, _0_Pulsing41_0.doc, _0_Pulsing41_0.pos, _0_MockRandom_0.doc, _0_MockVariableIntBlock_0.frq, _0_MockRandom_0.pos, _0_TestBloomFilteredLucene41Postings_0.doc, segments_2, _0.fdx, _0_MockRandom_0.pyl, _0_MockRandom_0.tim, _0.fdt]
[junit4:junit4] 2> 21252 T3207 C145 P32197 oass.SolrIndexSearcher.<init> Opening Searcher@8f4ec77 main
[junit4:junit4] 2> 21252 T3207 C145 P32197 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 21253 T3249 oasc.SolrCore.registerSearcher [onenodecollectioncore] Registered new searcher Searcher@8f4ec77 main{StandardDirectoryReader(segments_2:3 _0(5.0):C1)}
[junit4:junit4] 2> 21254 T3207 C145 P32197 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 21257 T3207 C145 P32197 REQ /select {q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=1
[junit4:junit4] 2> 21258 T3170 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 21273 T3207 C145 P32197 REQ /select {q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=1
[junit4:junit4] 2> ASYNC NEW_CORE C146 name=collection1 org.apache.solr.core.SolrCore@49970e71 url=http://127.0.0.1:55412/collection1 node=127.0.0.1:55412_ C146_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:55412_, base_url=http://127.0.0.1:55412, leader=true}
[junit4:junit4] 2> 21286 T3182 C146 P55412 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@48ddf162 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5b6fd438; maxCacheMB=0.9951171875 maxMergeSizeMB=0.47265625)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 21287 T3182 C146 P55412 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 21289 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[1 (1429017021591322624)]} 0 7
[junit4:junit4] 2> C143_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:40393_, base_url=http://127.0.0.1:40393}
[junit4:junit4] 2> 21315 T3234 C143 P40393 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1429017021612294144)]} 0 2
[junit4:junit4] 2> 21316 T3208 C144 P32197 /update {wt=javabin&version=2} {add=[1 (1429017021612294144)]} 0 15
[junit4:junit4] 2> 21319 T3182 C146 P55412 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 21323 T3182 C146 P55412 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@48ddf162 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5b6fd438; maxCacheMB=0.9951171875 maxMergeSizeMB=0.47265625)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@48ddf162 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5b6fd438; maxCacheMB=0.9951171875 maxMergeSizeMB=0.47265625)),segFN=segments_2,generation=2,filenames=[_0_MockVariableIntBlock_0.doc, _0_TestBloomFilteredLucene41Postings_0.tim, _0_MockVariableIntBlock_0.skp, _0_TestBloomFilteredLucene41Postings_0.tip, _0_TestBloomFilteredLucene41Postings_0.pos, _0_MockVariableIntBlock_0.pyl, _0_Pulsing41_0.tim, _0_MockVariableIntBlock_0.tib, _0_Pulsing41_0.tip, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.si, _0_MockVariableIntBlock_0.tii, _0.fnm, _0_TestBloomFilteredLucene41Postings_0.blm, _0_Asserting_0.dvd, _0_Asserting_0.dvm, _0.nvm, _0_MockRandom_0.skp, _0_MockRandom_0.tip, _0_MockRandom_0.frq, _0_MockRandom_0.sd, _0_Pulsing41_0.doc, _0_Pulsing41_0.pos, _0_MockRandom_0.doc, _0_MockVariableIntBlock_0.frq, _0_MockRandom_0.pos, _0_TestBloomFilteredLucene41Postings_0.doc, segments_2, _0.fdx, _0_MockRandom_0.pyl, _0_MockRandom_0.tim, _0.fdt]
[junit4:junit4] 2> 21324 T3182 C146 P55412 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[_0_MockVariableIntBlock_0.doc, _0_TestBloomFilteredLucene41Postings_0.tim, _0_MockVariableIntBlock_0.skp, _0_TestBloomFilteredLucene41Postings_0.tip, _0_TestBloomFilteredLucene41Postings_0.pos, _0_MockVariableIntBlock_0.pyl, _0_Pulsing41_0.tim, _0_MockVariableIntBlock_0.tib, _0_Pulsing41_0.tip, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.si, _0_MockVariableIntBlock_0.tii, _0.fnm, _0_TestBloomFilteredLucene41Postings_0.blm, _0_Asserting_0.dvd, _0_Asserting_0.dvm, _0.nvm, _0_MockRandom_0.skp, _0_MockRandom_0.tip, _0_MockRandom_0.frq, _0_MockRandom_0.sd, _0_Pulsing41_0.doc, _0_Pulsing41_0.pos, _0_MockRandom_0.doc, _0_MockVariableIntBlock_0.frq, _0_MockRandom_0.pos, _0_TestBloomFilteredLucene41Postings_0.doc, segments_2, _0.fdx, _0_MockRandom_0.pyl, _0_MockRandom_0.tim, _0.fdt]
[junit4:junit4] 2> 21325 T3182 C146 P55412 oass.SolrIndexSearcher.<init> Opening Searcher@4fa22bca main
[junit4:junit4] 2> 21326 T3182 C146 P55412 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 21326 T3196 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4fa22bca main{StandardDirectoryReader(segments_2:3 _0(5.0):C1)}
[junit4:junit4] 2> 21327 T3182 C146 P55412 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 8
[junit4:junit4] 2> ASYNC NEW_CORE C147 name=collection1 org.apache.solr.core.SolrCore@300c2fc3 url=http://127.0.0.1:59994/collection1 node=127.0.0.1:59994_ C147_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:59994_, base_url=http://127.0.0.1:59994, leader=true}
[junit4:junit4] 2> 21335 T3220 C147 P59994 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 21338 T3220 C147 P59994 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@2640c8f2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@48b1c600; maxCacheMB=0.9951171875 maxMergeSizeMB=0.47265625)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 21339 T3220 C147 P59994 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 21340 T3220 C147 P59994 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@2640c8f2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@48b1c600; maxCacheMB=0.9951171875 maxMergeSizeMB=0.47265625)),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@2640c8f2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@48b1c600; maxCacheMB=0.9951171875 maxMergeSizeMB=0.47265625)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 21340 T3220 C147 P59994 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 21341 T3220 C147 P59994 oass.SolrIndexSearcher.<init> Opening Searcher@74330031 main
[junit4:junit4] 2> 21341 T3220 C147 P59994 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 21342 T3230 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@74330031 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 21343 T3220 C147 P59994 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:32197/collection1/, StdNode: http://127.0.0.1:40393/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 21346 T3235 C143 P40393 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 21346 T3202 C144 P32197 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 21350 T3235 C143 P40393 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@23017405 lockFactory=org.apache.lucene.store.NativeFSLockFactory@94470c6; maxCacheMB=0.9951171875 maxMergeSizeMB=0.47265625)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@23017405 lockFactory=org.apache.lucene.store.NativeFSLockFactory@94470c6; maxCacheMB=0.9951171875 maxMergeSizeMB=0.47265625)),segFN=segments_3,generation=3,filenames=[_0_TestBloomFilteredLucene41Postings_0.tim, _0_MockVariableIntBlock_0.doc, _0_TestBloomFilteredLucene41Postings_0.tip, _0_MockVariableIntBlock_0.skp, _0_TestBloomFilteredLucene41Postings_0.pos, _0_MockVariableIntBlock_0.pyl, _0_Pulsing41_0.tim, _0_MockVariableIntBlock_0.tib, _0_Pulsing41_0.tip, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.si, _0_MockVariableIntBlock_0.tii, _0.fnm, _0_Asserting_0.dvd, _0_TestBloomFilteredLucene41Postings_0.blm, _0_Asserting_0.dvm, _0.nvm, _0_MockRandom_0.tip, _0_MockRandom_0.sd, _0_Pulsing41_0.doc, _0_Pulsing41_0.pos, _0_MockRandom_0.doc, _0_MockRandom_0.pos, _0_MockVariableIntBlock_0.frq, _0_TestBloomFilteredLucene41Postings_0.doc, _0.fdx, _0_MockRandom_0.tim, _0.fdt, segments_3]
[junit4:junit4] 2> 21350 T3235 C143 P40393 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0_TestBloomFilteredLucene41Postings_0.tim, _0_MockVariableIntBlock_0.doc, _0_TestBloomFilteredLucene41Postings_0.tip, _0_MockVariableIntBlock_0.skp, _0_TestBloomFilteredLucene41Postings_0.pos, _0_MockVariableIntBlock_0.pyl, _0_Pulsing41_0.tim, _0_MockVariableIntBlock_0.tib, _0_Pulsing41_0.tip, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.si, _0_MockVariableIntBlock_0.tii, _0.fnm, _0_Asserting_0.dvd, _0_TestBloomFilteredLucene41Postings_0.blm, _0_Asserting_0.dvm, _0.nvm, _0_MockRandom_0.tip, _0_MockRandom_0.sd, _0_Pulsing41_0.doc, _0_Pulsing41_0.pos, _0_MockRandom_0.doc, _0_MockRandom_0.pos, _0_MockVariableIntBlock_0.frq, _0_TestBloomFilteredLucene41Postings_0.doc, _0.fdx, _0_MockRandom_0.tim, _0.fdt, segments_3]
[junit4:junit4] 2> 21352 T3202 C144 P32197 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@2c3a7345 lockFactory=org.apache.lucene.store.NativeFSLockFactory@35103068; maxCacheMB=0.9951171875 maxMergeSizeMB=0.47265625)),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@2c3a7345 lockFactory=org.apache.lucene.store.NativeFSLockFactory@35103068; maxCacheMB=0.9951171875 maxMergeSizeMB=0.47265625)),segFN=segments_3,generation=3,filenames=[_0_TestBloomFilteredLucene41Postings_0.tim, _0_MockVariableIntBlock_0.doc, _0_TestBloomFilteredLucene41Postings_0.tip, _0_MockVariableIntBlock_0.skp, _0_TestBloomFilteredLucene41Postings_0.pos, _0_MockVariableIntBlock_0.pyl, _0_Pulsing41_0.tim, _0_MockVariableIntBlock_0.tib, _0_Pulsing41_0.tip, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.si, _0_MockVariableIntBlock_0.tii, _0.fnm, _0_Asserting_0.dvd, _0_TestBloomFilteredLucene41Postings_0.blm, _0_Asserting_0.dvm, _0.nvm, _0_MockRandom_0.tip, _0_MockRandom_0.sd, _0_Pulsing41_0.doc, _0_Pulsing41_0.pos, _0_MockRandom_0.doc, _0_MockRandom_0.pos, _0_MockVariableIntBlock_0.frq, _0_TestBloomFilteredLucene41Postings_0.doc, _0.fdx, _0_MockRandom_0.tim, _0.fdt, segments_3]
[junit4:junit4] 2> 21352 T3235 C143 P40393 oass.SolrIndexSearcher.<init> Opening Searcher@1a8fd3fa main
[junit4:junit4] 2> 21353 T3202 C144 P32197 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0_TestBloomFilteredLucene41Postings_0.tim, _0_MockVariableIntBlock_0.doc, _0_TestBloomFilteredLucene41Postings_0.tip, _0_MockVariableIntBlock_0.skp, _0_TestBloomFilteredLucene41Postings_0.pos, _0_MockVariableIntBlock_0.pyl, _0_Pulsing41_0.tim, _0_MockVariableIntBlock_0.tib, _0_Pulsing41_0.tip, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.si, _0_MockVariableIntBlock_0.tii, _0.fnm, _0_Asserting_0.dvd, _0_TestBloomFilteredLucene41Postings_0.blm, _0_Asserting_0.dvm, _0.nvm, _0_MockRandom_0.tip, _0_MockRandom_0.sd, _0_Pulsing41_0.doc, _0_Pulsing41_0.pos, _0_MockRandom_0.doc, _0_MockRandom_0.pos, _0_MockVariableIntBlock_0.frq, _0_TestBloomFilteredLucene41Postings_0.doc, _0.fdx, _0_MockRandom_0.tim, _0.fdt, segments_3]
[junit4:junit4] 2> 21353 T3235 C143 P40393 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 21354 T3246 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1a8fd3fa main{StandardDirectoryReader(segments_3:3:nrt _0(5.0):C1)}
[junit4:junit4] 2> 21354 T3235 C143 P40393 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 8
[junit4:junit4] 2> 21355 T3202 C144 P32197 oass.SolrIndexSearcher.<init> Opening Searcher@578e6a70 main
[junit4:junit4] 2> 21356 T3202 C144 P32197 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 21356 T3214 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@578e6a70 main{StandardDirectoryReader(segments_3:3:nrt _0(5.0):C1)}
[junit4:junit4] 2> 21356 T3202 C144 P32197 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 10
[junit4:junit4] 2> 21357 T3220 C147 P59994 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 22
[junit4:junit4] 2> 21358 T3170 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 21359 T3170 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21359 T3170 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> 21363 T3182 C146 P55412 REQ /select {q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=1
[junit4:junit4] 2> 21363 T3170 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:13897/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@46ee0bf8
[junit4:junit4] 2> 21364 T3170 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 21365 T3256 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:13897. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 21365 T3256 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:13897, initiating session
[junit4:junit4] 2> 21365 T3172 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:26807
[junit4:junit4] 2> 21366 T3172 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:26807
[junit4:junit4] 2> 21367 T3174 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d4e363bca000b with negotiated timeout 10000 for client /140.211.11.196:26807
[junit4:junit4] 2> 21367 T3256 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:13897, sessionid = 0x13d4e363bca000b, negotiated timeout = 10000
[junit4:junit4] 2> 21367 T3257 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@46ee0bf8 name:ZooKeeperConnection Watcher:127.0.0.1:13897/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 21367 T3170 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 21368 T3170 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 21370 T3175 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d4e363bca000b
[junit4:junit4] 2> 21371 T3257 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 21371 T3172 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:26807 which had sessionid 0x13d4e363bca000b
[junit4:junit4] 2> 21371 T3170 oaz.ZooKeeper.close Session: 0x13d4e363bca000b closed
[junit4:junit4] 2> 21373 T3205 C144 P32197 REQ /select {q=*:*&distrib=false&wt=javabin&version=2} hits=1 status=0 QTime=0
[junit4:junit4] 2> 21376 T3221 C147 P59994 REQ /select {q=*:*&distrib=false&wt=javabin&version=2} hits=0 status=0 QTime=1
[junit4:junit4] 2> 21381 T3260 C144 P32197 REQ /select {NOW=1362816831295&shard.url=127.0.0.1:32197/collection1/|127.0.0.1:40393/collection1/&fl=id,score&start=0&q=*:*&distrib=false&wt=javabin&isShard=true&fsv=true&version=2&rows=10} hits=1 status=0 QTime=1
[junit4:junit4] 2> 21381 T3222 C147 P59994 REQ /select {NOW=1362816831295&shard.url=127.0.0.1:59994/collection1/&fl=id,score&start=0&q=*:*&distrib=false&wt=javabin&isShard=true&fsv=true&version=2&rows=10} hits=0 status=0 QTime=1
[junit4:junit4] 2> 21384 T3260 C144 P32197 REQ /select {NOW=1362816831295&shard.url=127.0.0.1:32197/collection1/|127.0.0.1:40393/collection1/&ids=1&q=*:*&distrib=false&wt=javabin&isShard=true&version=2} status=0 QTime=0
[junit4:junit4] 2> 21385 T3208 C144 P32197 REQ /select {q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=7
[junit4:junit4] 2> 21390 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[2 (1429017021701423104)]} 0 3
[junit4:junit4] 2> 21395 T3220 C147 P59994 /update {wt=javabin&version=2} {add=[2 (1429017021707714560)]} 0 2
[junit4:junit4] 2> 21399 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[3 (1429017021712957440)]} 0 1
[junit4:junit4] 2> 21403 T3220 C147 P59994 /update {wt=javabin&version=2} {add=[3 (1429017021717151744)]} 0 1
[junit4:junit4] 2> 21407 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[4 (1429017021721346048)]} 0 1
[junit4:junit4] 2> 21416 T3234 C143 P40393 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[4 (1429017021725540352)]} 0 2
[junit4:junit4] 2> 21417 T3208 C144 P32197 /update {wt=javabin&version=2} {add=[4 (1429017021725540352)]} 0 7
[junit4:junit4] 2> 21421 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[5 (1429017021736026112)]} 0 1
[junit4:junit4] 2> 21424 T3220 C147 P59994 /update {wt=javabin&version=2} {add=[5 (1429017021739171840)]} 0 1
[junit4:junit4] 2> 21427 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[6 (1429017021742317568)]} 0 1
[junit4:junit4] 2> 21430 T3220 C147 P59994 /update {wt=javabin&version=2} {add=[6 (1429017021745463296)]} 0 1
[junit4:junit4] 2> 21433 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[7 (1429017021748609024)]} 0 1
[junit4:junit4] 2> 21438 T3223 C147 P59994 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[7 (1429017021753851904)]} 0 2
[junit4:junit4] 2> 21439 T3208 C144 P32197 /update {wt=javabin&version=2} {add=[7]} 0 4
[junit4:junit4] 2> 21442 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[8 (1429017021758046208)]} 0 1
[junit4:junit4] 2> 21448 T3234 C143 P40393 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[8 (1429017021761191936)]} 0 1
[junit4:junit4] 2> 21449 T3208 C144 P32197 /update {wt=javabin&version=2} {add=[8 (1429017021761191936)]} 0 5
[junit4:junit4] 2> 21452 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[9 (1429017021768531968)]} 0 1
[junit4:junit4] 2> 21457 T3223 C147 P59994 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[9 (1429017021773774848)]} 0 1
[junit4:junit4] 2> 21457 T3208 C144 P32197 /update {wt=javabin&version=2} {add=[9]} 0 3
[junit4:junit4] 2> 21461 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[10 (1429017021777969152)]} 0 1
[junit4:junit4] 2> 21469 T3234 C143 P40393 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10 (1429017021783212032)]} 0 1
[junit4:junit4] 2> 21471 T3202 C144 P32197 /update {distrib.from=http://127.0.0.1:59994/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[10 (1429017021783212032)]} 0 6
[junit4:junit4] 2> 21472 T3220 C147 P59994 /update {wt=javabin&version=2} {add=[10]} 0 9
[junit4:junit4] 2> 21477 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[11 (1429017021793697792)]} 0 2
[junit4:junit4] 2> 21483 T3234 C143 P40393 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[11 (1429017021797892096)]} 0 1
[junit4:junit4] 2> 21483 T3208 C144 P32197 /update {wt=javabin&version=2} {add=[11 (1429017021797892096)]} 0 4
[junit4:junit4] 2> 21487 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[12 (1429017021805232128)]} 0 1
[junit4:junit4] 2> 21493 T3234 C143 P40393 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[12 (1429017021808377856)]} 0 1
[junit4:junit4] 2> 21493 T3208 C144 P32197 /update {wt=javabin&version=2} {add=[12 (1429017021808377856)]} 0 4
[junit4:junit4] 2> 21497 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[13 (1429017021815717888)]} 0 1
[junit4:junit4] 2> 21505 T3234 C143 P40393 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[13 (1429017021820960768)]} 0 1
[junit4:junit4] 2> 21505 T3202 C144 P32197 /update {distrib.from=http://127.0.0.1:59994/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[13 (1429017021820960768)]} 0 4
[junit4:junit4] 2> 21506 T3220 C147 P59994 /update {wt=javabin&version=2} {add=[13]} 0 7
[junit4:junit4] 2> 21509 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[14 (1429017021828300800)]} 0 1
[junit4:junit4] 2> 21515 T3234 C143 P40393 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[14 (1429017021831446528)]} 0 1
[junit4:junit4] 2> 21515 T3208 C144 P32197 /update {wt=javabin&version=2} {add=[14 (1429017021831446528)]} 0 4
[junit4:junit4] 2> 21518 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[15 (1429017021838786560)]} 0 0
[junit4:junit4] 2> 21525 T3234 C143 P40393 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[15 (1429017021841932288)]} 0 1
[junit4:junit4] 2> 21526 T3208 C144 P32197 /update {wt=javabin&version=2} {add=[15 (1429017021841932288)]} 0 5
[junit4:junit4] 2> 21529 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[16 (1429017021849272320)]} 0 1
[junit4:junit4] 2> 21535 T3234 C143 P40393 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[16 (1429017021852418048)]} 0 1
[junit4:junit4] 2> 21535 T3208 C144 P32197 /update {wt=javabin&version=2} {add=[16 (1429017021852418048)]} 0 4
[junit4:junit4] 2> 21540 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[17 (1429017021859758080)]} 0 2
[junit4:junit4] 2> 21544 T3220 C147 P59994 /update {wt=javabin&version=2} {add=[17 (1429017021863952384)]} 0 2
[junit4:junit4] 2> 21546 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[100 (1429017021868146688)]} 0 0
[junit4:junit4] 2> 21555 T3234 C143 P40393 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[100 (1429017021873389568)]} 0 1
[junit4:junit4] 2> 21555 T3202 C144 P32197 /update {distrib.from=http://127.0.0.1:59994/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[100 (1429017021873389568)]} 0 4
[junit4:junit4] 2> 21556 T3220 C147 P59994 /update {wt=javabin&version=2} {add=[100]} 0 7
[junit4:junit4] 2> 21559 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[101 (1429017021880729600)]} 0 1
[junit4:junit4] 2> 21565 T3234 C143 P40393 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[101 (1429017021883875328)]} 0 1
[junit4:junit4] 2> 21565 T3208 C144 P32197 /update {wt=javabin&version=2} {add=[101 (1429017021883875328)]} 0 4
[junit4:junit4] 2> 21568 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[102 (1429017021891215360)]} 0 0
[junit4:junit4] 2> 21573 T3234 C143 P40393 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[102 (1429017021894361088)]} 0 0
[junit4:junit4] 2> 21574 T3208 C144 P32197 /update {wt=javabin&version=2} {add=[102 (1429017021894361088)]} 0 3
[junit4:junit4] 2> 21576 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[103 (1429017021899603968)]} 0 0
[junit4:junit4] 2> 21580 T3220 C147 P59994 /update {wt=javabin&version=2} {add=[103 (1429017021902749696)]} 0 1
[junit4:junit4] 2> 21582 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[104 (1429017021905895424)]} 0 0
[junit4:junit4] 2> 21587 T3223 C147 P59994 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[104 (1429017021911138304)]} 0 0
[junit4:junit4] 2> 21588 T3208 C144 P32197 /update {wt=javabin&version=2} {add=[104]} 0 3
[junit4:junit4] 2> 21592 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[105 (1429017021915332608)]} 0 1
[junit4:junit4] 2> 21595 T3220 C147 P59994 /update {wt=javabin&version=2} {add=[105 (1429017021918478336)]} 0 0
[junit4:junit4] 2> 21598 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[106 (1429017021921624064)]} 0 1
[junit4:junit4] 2> 21601 T3220 C147 P59994 /update {wt=javabin&version=2} {add=[106 (1429017021924769792)]} 0 1
[junit4:junit4] 2> 21603 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[107 (1429017021927915520)]} 0 0
[junit4:junit4] 2> 21612 T3234 C143 P40393 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[107 (1429017021933158400)]} 0 1
[junit4:junit4] 2> 21612 T3202 C144 P32197 /update {distrib.from=http://127.0.0.1:59994/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[107 (1429017021933158400)]} 0 4
[junit4:junit4] 2> 21613 T3220 C147 P59994 /update {wt=javabin&version=2} {add=[107]} 0 7
[junit4:junit4] 2> 21616 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[108 (1429017021940498432)]} 0 1
[junit4:junit4] 2> 21622 T3234 C143 P40393 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[108 (1429017021943644160)]} 0 1
[junit4:junit4] 2> 21622 T3208 C144 P32197 /update {wt=javabin&version=2} {add=[108 (1429017021943644160)]} 0 4
[junit4:junit4] 2> 21626 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[109 (1429017021950984192)]} 0 1
[junit4:junit4] 2> 21634 T3234 C143 P40393 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[109 (1429017021956227072)]} 0 1
[junit4:junit4] 2> 21635 T3202 C144 P32197 /update {distrib.from=http://127.0.0.1:59994/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[109 (1429017021956227072)]} 0 5
[junit4:junit4] 2> 21635 T3220 C147 P59994 /update {wt=javabin&version=2} {add=[109]} 0 7
[junit4:junit4] 2> 21639 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[110 (1429017021964615680)]} 0 1
[junit4:junit4] 2> 21647 T3234 C143 P40393 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[110 (1429017021969858560)]} 0 1
[junit4:junit4] 2> 21648 T3202 C144 P32197 /update {distrib.from=http://127.0.0.1:59994/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[110 (1429017021969858560)]} 0 5
[junit4:junit4] 2> 21648 T3220 C147 P59994 /update {wt=javabin&version=2} {add=[110]} 0 7
[junit4:junit4] 2> 21652 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[111 (1429017021978247168)]} 0 1
[junit4:junit4] 2> 21658 T3234 C143 P40393 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[111 (1429017021981392896)]} 0 1
[junit4:junit4] 2> 21659 T3208 C144 P32197 /update {wt=javabin&version=2} {add=[111 (1429017021981392896)]} 0 5
[junit4:junit4] 2> 21662 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[112 (1429017021988732928)]} 0 1
[junit4:junit4] 2> 21665 T3220 C147 P59994 /update {wt=javabin&version=2} {add=[112 (1429017021991878656)]} 0 1
[junit4:junit4] 2> 21668 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[113 (1429017021995024384)]} 0 1
[junit4:junit4] 2> 21674 T3234 C143 P40393 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[113 (1429017021998170112)]} 0 1
[junit4:junit4] 2> 21675 T3208 C144 P32197 /update {wt=javabin&version=2} {add=[113 (1429017021998170112)]} 0 5
[junit4:junit4] 2> 21678 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[114 (1429017022005510144)]} 0 1
[junit4:junit4] 2> 21684 T3234 C143 P40393 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[114 (1429017022008655872)]} 0 1
[junit4:junit4] 2> 21684 T3208 C144 P32197 /update {wt=javabin&version=2} {add=[114 (1429017022008655872)]} 0 4
[junit4:junit4] 2> 21689 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[115 (1429017022017044480)]} 0 1
[junit4:junit4] 2> 21694 T3223 C147 P59994 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[115 (1429017022022287360)]} 0 1
[junit4:junit4] 2> 21694 T3208 C144 P32197 /update {wt=javabin&version=2} {add=[115]} 0 3
[junit4:junit4] 2> 21698 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[116 (1429017022026481664)]} 0 1
[junit4:junit4] 2> 21702 T3223 C147 P59994 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[116 (1429017022031724544)]} 0 0
[junit4:junit4] 2> 21703 T3208 C144 P32197 /update {wt=javabin&version=2} {add=[116]} 0 3
[junit4:junit4] 2> 21707 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[117 (1429017022035918848)]} 0 1
[junit4:junit4] 2> 21712 T3223 C147 P59994 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[117 (1429017022042210304)]} 0 0
[junit4:junit4] 2> 21713 T3208 C144 P32197 /update {wt=javabin&version=2} {add=[117]} 0 3
[junit4:junit4] 2> 21717 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[118 (1429017022046404608)]} 0 1
[junit4:junit4] 2> 21724 T3234 C143 P40393 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[118 (1429017022050598912)]} 0 1
[junit4:junit4] 2> 21724 T3208 C144 P32197 /update {wt=javabin&version=2} {add=[118 (1429017022050598912)]} 0 4
[junit4:junit4] 2> 21728 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[119 (1429017022057938944)]} 0 1
[junit4:junit4] 2> 21731 T3220 C147 P59994 /update {wt=javabin&version=2} {add=[119 (1429017022061084672)]} 0 1
[junit4:junit4] 2> 21734 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[120 (1429017022064230400)]} 0 1
[junit4:junit4] 2> 21737 T3220 C147 P59994 /update {wt=javabin&version=2} {add=[120 (1429017022067376128)]} 0 1
[junit4:junit4] 2> 21740 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[121 (1429017022070521856)]} 0 0
[junit4:junit4] 2> 21745 T3223 C147 P59994 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[121 (1429017022075764736)]} 0 1
[junit4:junit4] 2> 21746 T3208 C144 P32197 /update {wt=javabin&version=2} {add=[121]} 0 4
[junit4:junit4] 2> 21749 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[122 (1429017022079959040)]} 0 1
[junit4:junit4] 2> 21757 T3234 C143 P40393 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[122 (1429017022085201920)]} 0 1
[junit4:junit4] 2> 21757 T3202 C144 P32197 /update {distrib.from=http://127.0.0.1:59994/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[122 (1429017022085201920)]} 0 4
[junit4:junit4] 2> 21758 T3220 C147 P59994 /update {wt=javabin&version=2} {add=[122]} 0 7
[junit4:junit4] 2> 21762 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[123 (1429017022093590528)]} 0 1
[junit4:junit4] 2> 21770 T3234 C143 P40393 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[123 (1429017022098833408)]} 0 1
[junit4:junit4] 2> 21770 T3202 C144 P32197 /update {distrib.from=http://127.0.0.1:59994/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[123 (1429017022098833408)]} 0 4
[junit4:junit4] 2> 21771 T3220 C147 P59994 /update {wt=javabin&version=2} {add=[123]} 0 7
[junit4:junit4] 2> 21774 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[124 (1429017022106173440)]} 0 1
[junit4:junit4] 2> 21781 T3234 C143 P40393 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[124 (1429017022111416320)]} 0 0
[junit4:junit4] 2> 21782 T3202 C144 P32197 /update {distrib.from=http://127.0.0.1:59994/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[124 (1429017022111416320)]} 0 4
[junit4:junit4] 2> 21783 T3220 C147 P59994 /update {wt=javabin&version=2} {add=[124]} 0 7
[junit4:junit4] 2> 21785 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[125 (1429017022118756352)]} 0 0
[junit4:junit4] 2> 21792 T3234 C143 P40393 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[125 (1429017022121902080)]} 0 1
[junit4:junit4] 2> 21792 T3208 C144 P32197 /update {wt=javabin&version=2} {add=[125 (1429017022121902080)]} 0 4
[junit4:junit4] 2> 21796 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[126 (1429017022129242112)]} 0 1
[junit4:junit4] 2> 21801 T3223 C147 P59994 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[126 (1429017022134484992)]} 0 1
[junit4:junit4] 2> 21801 T3208 C144 P32197 /update {wt=javabin&version=2} {add=[126]} 0 3
[junit4:junit4] 2> 21805 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[127 (1429017022138679296)]} 0 1
[junit4:junit4] 2> 21808 T3220 C147 P59994 /update {wt=javabin&version=2} {add=[127 (1429017022141825024)]} 0 1
[junit4:junit4] 2> 21810 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[128 (1429017022144970752)]} 0 0
[junit4:junit4] 2> 21814 T3220 C147 P59994 /update {wt=javabin&version=2} {add=[128 (1429017022148116480)]} 0 1
[junit4:junit4] 2> 21817 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[129 (1429017022151262208)]} 0 1
[junit4:junit4] 2> 21825 T3234 C143 P40393 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[129 (1429017022156505088)]} 0 1
[junit4:junit4] 2> 21825 T3202 C144 P32197 /update {distrib.from=http://127.0.0.1:59994/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[129 (1429017022156505088)]} 0 4
[junit4:junit4] 2> 21826 T3220 C147 P59994 /update {wt=javabin&version=2} {add=[129]} 0 7
[junit4:junit4] 2> 21830 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[130 (1429017022164893696)]} 0 1
[junit4:junit4] 2> 21835 T3223 C147 P59994 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[130 (1429017022170136576)]} 0 1
[junit4:junit4] 2> 21835 T3208 C144 P32197 /update {wt=javabin&version=2} {add=[130]} 0 3
[junit4:junit4] 2> 21839 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[131 (1429017022174330880)]} 0 1
[junit4:junit4] 2> 21844 T3223 C147 P59994 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[131 (1429017022179573760)]} 0 1
[junit4:junit4] 2> 21844 T3208 C144 P32197 /update {wt=javabin&version=2} {add=[131]} 0 3
[junit4:junit4] 2> 21847 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[132 (1429017022183768064)]} 0 0
[junit4:junit4] 2> 21856 T3234 C143 P40393 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[132 (1429017022189010944)]} 0 1
[junit4:junit4] 2> 21857 T3202 C144 P32197 /update {distrib.from=http://127.0.0.1:59994/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[132 (1429017022189010944)]} 0 5
[junit4:junit4] 2> 21857 T3220 C147 P59994 /update {wt=javabin&version=2} {add=[132]} 0 7
[junit4:junit4] 2> 21860 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[133 (1429017022197399552)]} 0 0
[junit4:junit4] 2> 21867 T3234 C143 P40393 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[133 (1429017022200545280)]} 0 1
[junit4:junit4] 2> 21868 T3208 C144 P32197 /update {wt=javabin&version=2} {add=[133 (1429017022200545280)]} 0 5
[junit4:junit4] 2> 21871 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[134 (1429017022207885312)]} 0 1
[junit4:junit4] 2> 21873 T3220 C147 P59994 /update {wt=javabin&version=2} {add=[134 (1429017022211031040)]} 0 0
[junit4:junit4] 2> 21877 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[135 (1429017022214176768)]} 0 0
[junit4:junit4] 2> 21883 T3234 C143 P40393 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[135 (1429017022217322496)]} 0 1
[junit4:junit4] 2> 21884 T3208 C144 P32197 /update {wt=javabin&version=2} {add=[135 (1429017022217322496)]} 0 5
[junit4:junit4] 2> 21887 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[136 (1429017022224662528)]} 0 1
[junit4:junit4] 2> 21890 T3220 C147 P59994 /update {wt=javabin&version=2} {add=[136 (1429017022227808256)]} 0 1
[junit4:junit4] 2> 21892 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[137 (1429017022230953984)]} 0 0
[junit4:junit4] 2> 21897 T3223 C147 P59994 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[137 (1429017022236196864)]} 0 0
[junit4:junit4] 2> 21898 T3208 C144 P32197 /update {wt=javabin&version=2} {add=[137]} 0 3
[junit4:junit4] 2> 21901 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[138 (1429017022240391168)]} 0 0
[junit4:junit4] 2> 21908 T3234 C143 P40393 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[138 (1429017022243536896)]} 0 1
[junit4:junit4] 2> 21909 T3208 C144 P32197 /update {wt=javabin&version=2} {add=[138 (1429017022243536896)]} 0 5
[junit4:junit4] 2> 21912 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[139 (1429017022251925504)]} 0 0
[junit4:junit4] 2> 21916 T3220 C147 P59994 /update {wt=javabin&version=2} {add=[139 (1429017022255071232)]} 0 1
[junit4:junit4] 2> 21918 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[140 (1429017022258216960)]} 0 0
[junit4:junit4] 2> 21923 T3223 C147 P59994 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[140 (1429017022263459840)]} 0 0
[junit4:junit4] 2> 21924 T3208 C144 P32197 /update {wt=javabin&version=2} {add=[140]} 0 3
[junit4:junit4] 2> 21928 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[141 (1429017022267654144)]} 0 1
[junit4:junit4] 2> 21932 T3223 C147 P59994 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[141 (1429017022272897024)]} 0 0
[junit4:junit4] 2> 21933 T3208 C144 P32197 /update {wt=javabin&version=2} {add=[141]} 0 3
[junit4:junit4] 2> 21936 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[142 (1429017022276042752)]} 0 0
[junit4:junit4] 2> 21940 T3223 C147 P59994 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[142 (1429017022281285632)]} 0 0
[junit4:junit4] 2> 21941 T3208 C144 P32197 /update {wt=javabin&version=2} {add=[142]} 0 3
[junit4:junit4] 2> 21944 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[143 (1429017022285479936)]} 0 0
[junit4:junit4] 2> 21947 T3220 C147 P59994 /update {wt=javabin&version=2} {add=[143 (1429017022288625664)]} 0 0
[junit4:junit4] 2> 21950 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[144 (1429017022291771392)]} 0 0
[junit4:junit4] 2> 21954 T3220 C147 P59994 /update {wt=javabin&version=2} {add=[144 (1429017022294917120)]} 0 1
[junit4:junit4] 2> 21956 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[145 (1429017022298062848)]} 0 0
[junit4:junit4] 2> 21959 T3220 C147 P59994 /update {wt=javabin&version=2} {add=[145 (1429017022301208576)]} 0 0
[junit4:junit4] 2> 21963 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[146 (1429017022304354304)]} 0 1
[junit4:junit4] 2> 21969 T3234 C143 P40393 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[146 (1429017022307500032)]} 0 1
[junit4:junit4] 2> 21969 T3208 C144 P32197 /update {wt=javabin&version=2} {add=[146 (1429017022307500032)]} 0 4
[junit4:junit4] 2> 21973 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[147 (1429017022314840064)]} 0 1
[junit4:junit4] 2> 21977 T3223 C147 P59994 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[147 (1429017022320082944)]} 0 0
[junit4:junit4] 2> 21978 T3208 C144 P32197 /update {wt=javabin&version=2} {add=[147]} 0 3
[junit4:junit4] 2> 21981 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[148 (1429017022324277248)]} 0 0
[junit4:junit4] 2> 21991 T3234 C143 P40393 /update {distrib.from=http://127.0.0.1:32197/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[148 (1429017022330568704)]} 0 1
[junit4:junit4] 2> 21991 T3202 C144 P32197 /update {distrib.from=http://127.0.0.1:59994/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[148 (1429017022330568704)]} 0 5
[junit4:junit4] 2> 21992 T3220 C147 P59994 /update {wt=javabin&version=2} {add=[148]} 0 8
[junit4:junit4] 2> 21995 T3182 C146 P55412 /update {wt=javabin&version=2} {add=[149 (1429017022338957312)]} 0 0
[junit4:junit4] 2> 21998 T3220 C147 P59994 /update {wt=javabin&version=2} {add=[149 (1429017022342103040)]} 0 0
[junit4:junit4] 2> 21999 T3170 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 22000 T3170 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 22001 T3170 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> 22003 T3182 C146 P55412 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 22019 T3182 C146 P55412 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=BaseDirectoryWrapper(NRTCachingDirectory(org.apache.lucene.store.RAMDirectory@48ddf162 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5b6fd438; maxCacheMB=0.9951171875 maxMergeSizeMB=0.47265625)),segFN=segments_2,generation=2,filenames=[_0_MockVariableIntBlock_0.doc, _0_TestBloomFilteredLucene41Postings_0.tim, _0_MockVariableIntBlock_0.skp, _0_TestBloomFilteredLucene41Postings_0.tip, _0_TestBloomFilteredLucene41Postings_0.pos, _0_MockVariableIntBlock_0.pyl, _0_Pulsing41_0.tim, _0_MockVariableIntBlock_0.tib, _0_Pulsing41_0.tip, _0.nvd, _0_MockVariableIntBlock_0.pos, _0.si, _0_MockVaria
[...truncated too long message...]
ressTest_/00007_core/data
[junit4:junit4] 2> 826080 T2694 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./OpenCloseCoreStressTest_/00007_core/data
[junit4:junit4] 2> 826081 T2694 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./OpenCloseCoreStressTest_/00007_core/data/index
[junit4:junit4] 2> 826081 T2694 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./OpenCloseCoreStressTest_/00007_core/data/index
[junit4:junit4] 2> 826137 T2694 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4] 2> 826776 T2694 oas.SolrTestCaseJ4.tearDown ###Ending test10MinutesNew
[junit4:junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=OpenCloseCoreStressTest -Dtests.method=test10MinutesNew -Dtests.seed=1D369A6D869E82A9 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/hudson/lucene-data/enwiki.random.lines.txt -Dtests.locale=sq_AL -Dtests.timezone=SystemV/MST7 -Dtests.file.encoding=UTF-8
[junit4:junit4] FAILURE 306s J1 | OpenCloseCoreStressTest.test10MinutesNew <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: Core 00000_core bad! expected:<370> but was:<368>
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([1D369A6D869E82A9:2713224CF450681D]:0)
[junit4:junit4] > at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4] > at org.junit.Assert.failNotEquals(Assert.java:647)
[junit4:junit4] > at org.junit.Assert.assertEquals(Assert.java:128)
[junit4:junit4] > at org.junit.Assert.assertEquals(Assert.java:472)
[junit4:junit4] > at org.apache.solr.core.OpenCloseCoreStressTest.checkResults(OpenCloseCoreStressTest.java:304)
[junit4:junit4] > at org.apache.solr.core.OpenCloseCoreStressTest.doStress(OpenCloseCoreStressTest.java:202)
[junit4:junit4] > at org.apache.solr.core.OpenCloseCoreStressTest.test10MinutesNew(OpenCloseCoreStressTest.java:134)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4] > at java.lang.reflect.Method.invoke(Method.java:616)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4:junit4] > at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:679)
[junit4:junit4] 2> 826799 T2694 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> NOTE: test params are: codec=Asserting, sim=DefaultSimilarity, locale=sq_AL, timezone=SystemV/MST7
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Sun Microsystems Inc. 1.6.0_32 (64-bit)/cpus=16,threads=1,free=356438768,total=532152320
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestQuerySenderNoQuery, SortByFunctionTest, TestSolrJ, CollectionsAPIDistributedZkTest, CopyFieldTest, TestCSVResponseWriter, SpellCheckComponentTest, TestStressLucene, TestZkChroot, DebugComponentTest, TestComponentsName, SimplePostToolTest, TestNumberUtils, SuggesterWFSTTest, EchoParamsTest, ChaosMonkeySafeLeaderTest, TestPropInject, TestRandomFaceting, DocumentAnalysisRequestHandlerTest, RequiredFieldsTest, UpdateParamsTest, TestPostingsSolrHighlighter, IndexReaderFactoryTest, TestDistributedGrouping, TestSystemIdResolver, ZkNodePropsTest, BadIndexSchemaTest, TestDynamicFieldResource, TestBinaryField, TestIndexSearcher, XmlUpdateRequestHandlerTest, SuggesterTSTTest, DirectUpdateHandlerTest, OpenExchangeRatesOrgProviderTest, TestStressReorder, SampleTest, SolrCoreCheckLockOnStartupTest, SolrCmdDistributorTest, TestSolrDiscoveryProperties, FieldAnalysisRequestHandlerTest, BasicZkTest, TestDefaultSimilarityFactory, IndexBasedSpellCheckerTest, TestPartialUpdateDeduplication, TestIndexingPerformance, TestDistributedSearch, OpenCloseCoreStressTest]
[junit4:junit4] Completed on J1 in 826.84s, 6 tests, 1 failure, 2 skipped <<< FAILURES!
[...truncated 476 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:388: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:361: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:183: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:449: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1213: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:877: There were test failures: 269 suites, 1137 tests, 1 error, 1 failure, 25 ignored (6 assumptions)
Total time: 103 minutes 26 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 200 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/200/
2 tests failed.
REGRESSION: org.apache.solr.cloud.SyncSliceTest.testDistribSearch
Error Message:
shard1 is not consistent. Got 305 from http://127.0.0.1:37713/m_d/fq/collection1lastClient and got 5 from http://127.0.0.1:59675/m_d/fq/collection1
Stack Trace:
java.lang.AssertionError: shard1 is not consistent. Got 305 from http://127.0.0.1:37713/m_d/fq/collection1lastClient and got 5 from http://127.0.0.1:59675/m_d/fq/collection1
at __randomizedtesting.SeedInfo.seed([FDCFC3F55E95DDFB:7C294DED29CABDC7]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:963)
at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:234)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:679)
REGRESSION: org.apache.solr.core.OpenCloseCoreStressTest.test10MinutesNew
Error Message:
Core 00012_core bad! expected:<357> but was:<348>
Stack Trace:
java.lang.AssertionError: Core 00012_core bad! expected:<357> but was:<348>
at __randomizedtesting.SeedInfo.seed([FDCFC3F55E95DDFB:C7EA7BD42C5B374F]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.solr.core.OpenCloseCoreStressTest.checkResults(OpenCloseCoreStressTest.java:304)
at org.apache.solr.core.OpenCloseCoreStressTest.doStress(OpenCloseCoreStressTest.java:202)
at org.apache.solr.core.OpenCloseCoreStressTest.test10MinutesNew(OpenCloseCoreStressTest.java:134)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:679)
Build Log:
[...truncated 8671 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4] 2> 0 T1936 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /m_d/fq
[junit4:junit4] 2> 5 T1936 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./solrtest-SyncSliceTest-1362745667510
[junit4:junit4] 2> 6 T1936 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 7 T1937 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 10 T1937 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 10 T1937 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 10 T1937 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 10 T1937 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 11 T1937 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1362745667509/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 107 T1936 oasc.ZkTestServer.run start zk server on port:23995
[junit4:junit4] 2> 107 T1936 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23995 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@549ce387
[junit4:junit4] 2> 108 T1936 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 109 T1942 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23995. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 109 T1942 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23995, initiating session
[junit4:junit4] 2> 110 T1938 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:62554
[junit4:junit4] 2> 110 T1938 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:62554
[junit4:junit4] 2> 110 T1940 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 113 T1940 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d49f8afbc0000 with negotiated timeout 10000 for client /140.211.11.196:62554
[junit4:junit4] 2> 113 T1942 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23995, sessionid = 0x13d49f8afbc0000, negotiated timeout = 10000
[junit4:junit4] 2> 114 T1943 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@549ce387 name:ZooKeeperConnection Watcher:127.0.0.1:23995 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 114 T1936 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 115 T1936 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 119 T1941 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d49f8afbc0000
[junit4:junit4] 2> 137 T1943 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 138 T1938 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:62554 which had sessionid 0x13d49f8afbc0000
[junit4:junit4] 2> 137 T1936 oaz.ZooKeeper.close Session: 0x13d49f8afbc0000 closed
[junit4:junit4] 2> 139 T1936 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23995/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@57e52afd
[junit4:junit4] 2> 139 T1936 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 140 T1944 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23995. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 140 T1944 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23995, initiating session
[junit4:junit4] 2> 141 T1938 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:64234
[junit4:junit4] 2> 141 T1938 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:64234
[junit4:junit4] 2> 142 T1940 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d49f8afbc0001 with negotiated timeout 10000 for client /140.211.11.196:64234
[junit4:junit4] 2> 142 T1944 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23995, sessionid = 0x13d49f8afbc0001, negotiated timeout = 10000
[junit4:junit4] 2> 143 T1945 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@57e52afd name:ZooKeeperConnection Watcher:127.0.0.1:23995/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 143 T1936 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 143 T1936 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 153 T1936 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 158 T1936 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 161 T1936 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 172 T1936 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 172 T1936 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 185 T1936 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 186 T1936 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 190 T1936 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 190 T1936 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 193 T1936 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 194 T1936 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 205 T1936 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 205 T1936 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 208 T1936 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 209 T1936 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 212 T1936 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 212 T1936 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 215 T1936 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 216 T1936 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 223 T1936 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 223 T1936 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 226 T1941 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d49f8afbc0001
[junit4:junit4] 2> 227 T1945 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 227 T1938 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:64234 which had sessionid 0x13d49f8afbc0001
[junit4:junit4] 2> 227 T1936 oaz.ZooKeeper.close Session: 0x13d49f8afbc0001 closed
[junit4:junit4] 2> 410 T1936 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 415 T1936 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:51630
[junit4:junit4] 2> 416 T1936 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 417 T1936 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 417 T1936 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1362745667732
[junit4:junit4] 2> 418 T1936 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1362745667732/solr.xml
[junit4:junit4] 2> 418 T1936 oasc.CoreContainer.<init> New CoreContainer 23494472
[junit4:junit4] 2> 419 T1936 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1362745667732/'
[junit4:junit4] 2> 419 T1936 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1362745667732/'
[junit4:junit4] 2> 468 T1936 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 469 T1936 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 469 T1936 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 470 T1936 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 470 T1936 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 471 T1936 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 471 T1936 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 471 T1936 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 472 T1936 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 472 T1936 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 493 T1936 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 512 T1936 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:23995/solr
[junit4:junit4] 2> 512 T1936 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 513 T1936 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23995 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@70b34ab2
[junit4:junit4] 2> 514 T1936 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 514 T1955 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23995. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 515 T1955 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23995, initiating session
[junit4:junit4] 2> 515 T1938 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:49154
[junit4:junit4] 2> 516 T1938 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:49154
[junit4:junit4] 2> 518 T1940 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d49f8afbc0002 with negotiated timeout 20000 for client /140.211.11.196:49154
[junit4:junit4] 2> 518 T1955 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23995, sessionid = 0x13d49f8afbc0002, negotiated timeout = 20000
[junit4:junit4] 2> 518 T1956 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@70b34ab2 name:ZooKeeperConnection Watcher:127.0.0.1:23995 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 518 T1936 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 520 T1941 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d49f8afbc0002
[junit4:junit4] 2> 521 T1956 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 521 T1938 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:49154 which had sessionid 0x13d49f8afbc0002
[junit4:junit4] 2> 521 T1936 oaz.ZooKeeper.close Session: 0x13d49f8afbc0002 closed
[junit4:junit4] 2> 521 T1936 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 532 T1936 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23995/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@2e2baa5a
[junit4:junit4] 2> 533 T1936 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 533 T1957 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23995. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 534 T1957 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23995, initiating session
[junit4:junit4] 2> 534 T1938 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:45314
[junit4:junit4] 2> 534 T1938 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:45314
[junit4:junit4] 2> 535 T1940 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d49f8afbc0003 with negotiated timeout 20000 for client /140.211.11.196:45314
[junit4:junit4] 2> 535 T1957 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23995, sessionid = 0x13d49f8afbc0003, negotiated timeout = 20000
[junit4:junit4] 2> 536 T1958 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2e2baa5a name:ZooKeeperConnection Watcher:127.0.0.1:23995/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 536 T1936 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 538 T1941 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d49f8afbc0003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 547 T1936 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 549 T1936 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51630_m_d%2Ffq
[junit4:junit4] 2> 550 T1941 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d49f8afbc0003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:51630_m_d%2Ffq Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:51630_m_d%2Ffq
[junit4:junit4] 2> 551 T1936 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51630_m_d%2Ffq
[junit4:junit4] 2> 560 T1936 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 572 T1941 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d49f8afbc0003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 573 T1936 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 580 T1936 oasc.Overseer.start Overseer (id=89308900066328579-127.0.0.1:51630_m_d%2Ffq-n_0000000000) starting
[junit4:junit4] 2> 580 T1941 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d49f8afbc0003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 582 T1941 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d49f8afbc0003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 583 T1941 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d49f8afbc0003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 592 T1941 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d49f8afbc0003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 594 T1960 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 595 T1936 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 598 T1936 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 608 T1936 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 610 T1959 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 614 T1961 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1362745667732/collection1
[junit4:junit4] 2> 614 T1961 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 615 T1961 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 615 T1961 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 616 T1961 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1362745667732/collection1/'
[junit4:junit4] 2> 617 T1961 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-controljetty-1362745667732/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 618 T1961 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-controljetty-1362745667732/collection1/lib/README' to classloader
[junit4:junit4] 2> 665 T1961 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 723 T1961 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 724 T1961 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 730 T1961 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 1372 T1961 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1385 T1961 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1390 T1961 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1405 T1961 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1410 T1961 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1416 T1961 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1417 T1961 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1417 T1961 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 1417 T1961 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1418 T1961 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1419 T1961 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 1419 T1961 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1362745667732/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1362745667509/control/data/
[junit4:junit4] 2> 1419 T1961 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4ee14d81
[junit4:junit4] 2> 1420 T1961 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1420 T1961 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1362745667509/control/data forceNew: false
[junit4:junit4] 2> 1421 T1961 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1362745667509/control/data/index/
[junit4:junit4] 2> 1421 T1961 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1362745667509/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1422 T1961 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1362745667509/control/data/index forceNew: false
[junit4:junit4] 2> 1425 T1961 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@26e1a282 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3704b7d5),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 1425 T1961 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 1428 T1961 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1428 T1961 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1429 T1961 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1429 T1961 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1430 T1961 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1430 T1961 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1430 T1961 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1431 T1961 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1431 T1961 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1440 T1961 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1447 T1961 oass.SolrIndexSearcher.<init> Opening Searcher@455cebe6 main
[junit4:junit4] 2> 1447 T1961 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1362745667509/control/data/tlog
[junit4:junit4] 2> 1448 T1961 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1448 T1961 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1452 T1962 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@455cebe6 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1452 T1961 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1453 T1961 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1453 T1941 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d49f8afbc0003 type:create cxid:0x55 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 2114 T1959 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2115 T1959 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:51630_m_d%2Ffq",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51630/m_d/fq"}
[junit4:junit4] 2> 2115 T1959 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 2115 T1959 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 2116 T1941 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d49f8afbc0003 type:create cxid:0x5d zxid:0x2d txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 2135 T1958 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 2499 T1961 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 2499 T1961 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51630/m_d/fq collection:control_collection shard:shard1
[junit4:junit4] 2> 2500 T1961 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 2516 T1941 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d49f8afbc0003 type:delete cxid:0x77 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 2517 T1961 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 2517 T1941 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d49f8afbc0003 type:create cxid:0x78 zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2527 T1961 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 2527 T1961 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 2528 T1961 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51630/m_d/fq/collection1/
[junit4:junit4] 2> 2528 T1961 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 2528 T1961 oasc.SyncStrategy.syncToMe http://127.0.0.1:51630/m_d/fq/collection1/ has no replicas
[junit4:junit4] 2> 2528 T1961 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51630/m_d/fq/collection1/
[junit4:junit4] 2> 2529 T1961 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 2532 T1941 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d49f8afbc0003 type:create cxid:0x82 zxid:0x3c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3645 T1959 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3661 T1958 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3707 T1961 oasc.ZkController.register We are http://127.0.0.1:51630/m_d/fq/collection1/ and leader is http://127.0.0.1:51630/m_d/fq/collection1/
[junit4:junit4] 2> 3707 T1961 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51630/m_d/fq
[junit4:junit4] 2> 3707 T1961 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 3707 T1961 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 3708 T1961 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3709 T1961 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3711 T1936 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4:junit4] 2> 3711 T1936 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 3712 T1936 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 3725 T1936 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 3726 T1936 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23995/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@15112db5
[junit4:junit4] 2> 3727 T1936 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3727 T1964 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23995. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 3728 T1964 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23995, initiating session
[junit4:junit4] 2> 3728 T1938 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:28643
[junit4:junit4] 2> 3728 T1938 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:28643
[junit4:junit4] 2> 3729 T1940 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d49f8afbc0004 with negotiated timeout 10000 for client /140.211.11.196:28643
[junit4:junit4] 2> 3729 T1964 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23995, sessionid = 0x13d49f8afbc0004, negotiated timeout = 10000
[junit4:junit4] 2> 3730 T1965 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15112db5 name:ZooKeeperConnection Watcher:127.0.0.1:23995/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3730 T1936 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3732 T1936 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 3733 T1936 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 3915 T1936 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 3918 T1936 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:55492
[junit4:junit4] 2> 3919 T1936 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 3919 T1936 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 3920 T1936 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1362745671238
[junit4:junit4] 2> 3920 T1936 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1362745671238/solr.xml
[junit4:junit4] 2> 3921 T1936 oasc.CoreContainer.<init> New CoreContainer 1159266502
[junit4:junit4] 2> 3921 T1936 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1362745671238/'
[junit4:junit4] 2> 3922 T1936 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1362745671238/'
[junit4:junit4] 2> 3971 T1936 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 3972 T1936 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 3972 T1936 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 3973 T1936 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 3973 T1936 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 3974 T1936 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 3974 T1936 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 3975 T1936 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 3975 T1936 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 3976 T1936 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 3994 T1936 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 4013 T1936 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:23995/solr
[junit4:junit4] 2> 4013 T1936 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 4014 T1936 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23995 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@45515c1d
[junit4:junit4] 2> 4015 T1936 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4015 T1975 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23995. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 4016 T1975 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23995, initiating session
[junit4:junit4] 2> 4016 T1938 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:64987
[junit4:junit4] 2> 4017 T1938 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:64987
[junit4:junit4] 2> 4019 T1940 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d49f8afbc0005 with negotiated timeout 20000 for client /140.211.11.196:64987
[junit4:junit4] 2> 4019 T1975 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23995, sessionid = 0x13d49f8afbc0005, negotiated timeout = 20000
[junit4:junit4] 2> 4019 T1976 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@45515c1d name:ZooKeeperConnection Watcher:127.0.0.1:23995 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4019 T1936 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4021 T1941 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d49f8afbc0005
[junit4:junit4] 2> 4034 T1976 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 4034 T1938 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:64987 which had sessionid 0x13d49f8afbc0005
[junit4:junit4] 2> 4034 T1936 oaz.ZooKeeper.close Session: 0x13d49f8afbc0005 closed
[junit4:junit4] 2> 4035 T1936 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 4044 T1936 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23995/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@1e419f34
[junit4:junit4] 2> 4045 T1936 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4046 T1977 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23995. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 4046 T1977 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23995, initiating session
[junit4:junit4] 2> 4046 T1938 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:40928
[junit4:junit4] 2> 4047 T1938 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:40928
[junit4:junit4] 2> 4048 T1940 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d49f8afbc0006 with negotiated timeout 20000 for client /140.211.11.196:40928
[junit4:junit4] 2> 4048 T1977 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23995, sessionid = 0x13d49f8afbc0006, negotiated timeout = 20000
[junit4:junit4] 2> 4048 T1978 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e419f34 name:ZooKeeperConnection Watcher:127.0.0.1:23995/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4048 T1936 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4050 T1941 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d49f8afbc0006 type:create cxid:0x1 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4051 T1941 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d49f8afbc0006 type:create cxid:0x2 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4053 T1936 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 5056 T1936 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55492_m_d%2Ffq
[junit4:junit4] 2> 5057 T1941 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d49f8afbc0006 type:delete cxid:0xb zxid:0x4c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:55492_m_d%2Ffq Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:55492_m_d%2Ffq
[junit4:junit4] 2> 5062 T1936 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55492_m_d%2Ffq
[junit4:junit4] 2> 5064 T1958 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 5065 T1965 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5065 T1978 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5066 T1958 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5080 T1979 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1362745671238/collection1
[junit4:junit4] 2> 5080 T1979 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 5081 T1979 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 5081 T1979 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 5082 T1979 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1362745671238/collection1/'
[junit4:junit4] 2> 5083 T1979 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty1-1362745671238/collection1/lib/README' to classloader
[junit4:junit4] 2> 5084 T1979 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty1-1362745671238/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 5131 T1979 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 5175 T1959 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 5176 T1959 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:51630_m_d%2Ffq",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51630/m_d/fq"}
[junit4:junit4] 2> 5190 T1958 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5190 T1978 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5190 T1965 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5191 T1979 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 5193 T1979 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 5199 T1979 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 5818 T1979 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 5829 T1979 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 5833 T1979 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 5846 T1979 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5850 T1979 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 5855 T1979 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5856 T1979 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 5856 T1979 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 5857 T1979 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 5857 T1979 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 5858 T1979 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 5858 T1979 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1362745671238/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1362745667509/jetty1/
[junit4:junit4] 2> 5858 T1979 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4ee14d81
[junit4:junit4] 2> 5859 T1979 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 5860 T1979 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1362745667509/jetty1 forceNew: false
[junit4:junit4] 2> 5860 T1979 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1362745667509/jetty1/index/
[junit4:junit4] 2> 5860 T1979 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1362745667509/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 5861 T1979 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1362745667509/jetty1/index forceNew: false
[junit4:junit4] 2> 5863 T1979 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3773908b lockFactory=org.apache.lucene.store.NativeFSLockFactory@6e07d1aa),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 5864 T1979 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 5866 T1979 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 5866 T1979 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 5867 T1979 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 5868 T1979 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 5868 T1979 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 5868 T1979 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 5869 T1979 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 5869 T1979 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 5870 T1979 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 5877 T1979 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 5882 T1979 oass.SolrIndexSearcher.<init> Opening Searcher@c047ab main
[junit4:junit4] 2> 5883 T1979 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1362745667509/jetty1/tlog
[junit4:junit4] 2> 5884 T1979 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 5884 T1979 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 5887 T1980 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@c047ab main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 5889 T1979 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 5890 T1979 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 6695 T1959 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6696 T1959 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:55492_m_d%2Ffq",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55492/m_d/fq"}
[junit4:junit4] 2> 6696 T1959 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4] 2> 6697 T1959 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 6747 T1978 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6747 T1965 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6747 T1958 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6892 T1979 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 6892 T1979 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55492/m_d/fq collection:collection1 shard:shard1
[junit4:junit4] 2> 6893 T1979 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 6932 T1941 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d49f8afbc0006 type:delete cxid:0x48 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 6933 T1979 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 6933 T1941 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d49f8afbc0006 type:create cxid:0x49 zxid:0x5d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 6944 T1979 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 6944 T1979 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 6944 T1979 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55492/m_d/fq/collection1/
[junit4:junit4] 2> 6944 T1979 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 6945 T1979 oasc.SyncStrategy.syncToMe http://127.0.0.1:55492/m_d/fq/collection1/ has no replicas
[junit4:junit4] 2> 6945 T1979 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:55492/m_d/fq/collection1/
[junit4:junit4] 2> 6945 T1979 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 6955 T1941 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d49f8afbc0006 type:create cxid:0x53 zxid:0x61 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8251 T1959 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8267 T1958 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8267 T1978 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8267 T1965 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8284 T1979 oasc.ZkController.register We are http://127.0.0.1:55492/m_d/fq/collection1/ and leader is http://127.0.0.1:55492/m_d/fq/collection1/
[junit4:junit4] 2> 8284 T1979 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55492/m_d/fq
[junit4:junit4] 2> 8284 T1979 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 8284 T1979 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 8285 T1979 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 8286 T1979 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8287 T1936 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4:junit4] 2> 8288 T1936 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 8288 T1936 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 8483 T1936 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 8486 T1936 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:31677
[junit4:junit4] 2> 8486 T1936 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 8487 T1936 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 8487 T1936 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1362745675806
[junit4:junit4] 2> 8488 T1936 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1362745675806/solr.xml
[junit4:junit4] 2> 8488 T1936 oasc.CoreContainer.<init> New CoreContainer 448693308
[junit4:junit4] 2> 8489 T1936 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1362745675806/'
[junit4:junit4] 2> 8490 T1936 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1362745675806/'
[junit4:junit4] 2> 8539 T1936 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 8540 T1936 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 8540 T1936 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 8541 T1936 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 8541 T1936 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 8542 T1936 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 8542 T1936 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 8542 T1936 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 8543 T1936 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 8543 T1936 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 8564 T1936 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 8582 T1936 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:23995/solr
[junit4:junit4] 2> 8583 T1936 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 8584 T1936 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23995 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@24fca7d9
[junit4:junit4] 2> 8585 T1936 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8585 T1991 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23995. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 8586 T1991 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23995, initiating session
[junit4:junit4] 2> 8586 T1938 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:39828
[junit4:junit4] 2> 8586 T1938 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:39828
[junit4:junit4] 2> 8588 T1940 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d49f8afbc0007 with negotiated timeout 20000 for client /140.211.11.196:39828
[junit4:junit4] 2> 8588 T1991 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23995, sessionid = 0x13d49f8afbc0007, negotiated timeout = 20000
[junit4:junit4] 2> 8589 T1992 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@24fca7d9 name:ZooKeeperConnection Watcher:127.0.0.1:23995 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8589 T1936 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8591 T1941 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d49f8afbc0007
[junit4:junit4] 2> 8605 T1938 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:39828 which had sessionid 0x13d49f8afbc0007
[junit4:junit4] 2> 8605 T1992 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 8605 T1936 oaz.ZooKeeper.close Session: 0x13d49f8afbc0007 closed
[junit4:junit4] 2> 8606 T1936 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 8617 T1936 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23995/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@26e24671
[junit4:junit4] 2> 8618 T1936 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8619 T1993 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23995. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 8619 T1993 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23995, initiating session
[junit4:junit4] 2> 8619 T1938 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:30588
[junit4:junit4] 2> 8620 T1938 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:30588
[junit4:junit4] 2> 8621 T1940 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d49f8afbc0008 with negotiated timeout 20000 for client /140.211.11.196:30588
[junit4:junit4] 2> 8621 T1993 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23995, sessionid = 0x13d49f8afbc0008, negotiated timeout = 20000
[junit4:junit4] 2> 8621 T1994 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@26e24671 name:ZooKeeperConnection Watcher:127.0.0.1:23995/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8622 T1936 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8623 T1941 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d49f8afbc0008 type:create cxid:0x1 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8624 T1941 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d49f8afbc0008 type:create cxid:0x2 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8633 T1936 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 9636 T1936 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:31677_m_d%2Ffq
[junit4:junit4] 2> 9637 T1941 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d49f8afbc0008 type:delete cxid:0xb zxid:0x70 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:31677_m_d%2Ffq Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:31677_m_d%2Ffq
[junit4:junit4] 2> 9641 T1936 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:31677_m_d%2Ffq
[junit4:junit4] 2> 9644 T1958 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9644 T1965 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9645 T1978 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9645 T1994 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9645 T1978 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9646 T1958 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9646 T1965 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9662 T1995 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1362745675806/collection1
[junit4:junit4] 2> 9663 T1995 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 9663 T1995 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 9664 T1995 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 9665 T1995 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1362745675806/collection1/'
[junit4:junit4] 2> 9666 T1995 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty2-1362745675806/collection1/lib/README' to classloader
[junit4:junit4] 2> 9667 T1995 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty2-1362745675806/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 9717 T1995 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 9773 T1959 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9774 T1959 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:55492_m_d%2Ffq",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:55492/m_d/fq"}
[junit4:junit4] 2> 9775 T1995 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 9776 T1995 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 9782 T1995 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 9787 T1994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9787 T1978 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9787 T1958 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9787 T1965 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10411 T1995 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 10422 T1995 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 10427 T1995 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 10439 T1995 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 10444 T1995 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 10448 T1995 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 10449 T1995 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 10450 T1995 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 10450 T1995 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 10451 T1995 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 10451 T1995 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 10451 T1995 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1362745675806/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1362745667509/jetty2/
[junit4:junit4] 2> 10452 T1995 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4ee14d81
[junit4:junit4] 2> 10452 T1995 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 10453 T1995 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1362745667509/jetty2 forceNew: false
[junit4:junit4] 2> 10453 T1995 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1362745667509/jetty2/index/
[junit4:junit4] 2> 10454 T1995 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1362745667509/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 10454 T1995 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1362745667509/jetty2/index forceNew: false
[junit4:junit4] 2> 10457 T1995 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2f27d403 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5b3d2ba0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 10457 T1995 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 10459 T1995 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 10460 T1995 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 10460 T1995 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 10461 T1995 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 10462 T1995 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 10462 T1995 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 10462 T1995 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 10463 T1995 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 10463 T1995 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 10470 T1995 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 10476 T1995 oass.SolrIndexSearcher.<init> Opening Searcher@5c26b747 main
[junit4:junit4] 2> 10476 T1995 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1362745667509/jetty2/tlog
[junit4:junit4] 2> 10477 T1995 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 10478 T1995 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 10482 T1996 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5c26b747 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 10483 T1995 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 10484 T1995 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 11291 T1959 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11292 T1959 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:31677_m_d%2Ffq",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:31677/m_d/fq"}
[junit4:junit4] 2> 11292 T1959 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 11293 T1959 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 11297 T1994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11297 T1958 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11297 T1965 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11297 T1978 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11486 T1995 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 11486 T1995 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:31677/m_d/fq collection:collection1 shard:shard1
[junit4:junit4] 2> 11496 T1995 oasc.ZkController.register We are http://127.0.0.1:31677/m_d/fq/collection1/ and leader is http://127.0.0.1:55492/m_d/fq/collection1/
[junit4:junit4] 2> 11496 T1995 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:31677/m_d/fq
[junit4:junit4] 2> 11496 T1995 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 11497 T1995 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C134 name=collection1 org.apache.solr.core.SolrCore@7739df61 url=http://127.0.0.1:31677/m_d/fq/collection1 node=127.0.0.1:31677_m_d%2Ffq C134_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:31677_m_d%2Ffq, base_url=http://127.0.0.1:31677/m_d/fq}
[junit4:junit4] 2> 11497 T1997 C134 P31677 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 11497 T1995 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11498 T1997 C134 P31677 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 11498 T1997 C134 P31677 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 11498 T1997 C134 P31677 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 11498 T1936 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4:junit4] 2> 11499 T1936 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 11500 T1936 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 11503 T1997 C134 P31677 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 11700 T1936 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 11703 T1936 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:36187
[junit4:junit4] 2> 11703 T1936 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 11704 T1936 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 11704 T1936 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1362745679020
[junit4:junit4] 2> 11705 T1936 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1362745679020/solr.xml
[junit4:junit4] 2> 11705 T1936 oasc.CoreContainer.<init> New CoreContainer 1737627575
[junit4:junit4] 2> 11706 T1936 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1362745679020/'
[junit4:junit4] 2> 11706 T1936 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1362745679020/'
[junit4:junit4] 2> 11756 T1936 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 11756 T1936 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 11757 T1936 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 11757 T1936 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 11758 T1936 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 11758 T1936 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 11758 T1936 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 11759 T1936 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 11759 T1936 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 11760 T1936 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 11778 T1936 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 11797 T1936 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:23995/solr
[junit4:junit4] 2> 11797 T1936 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 11798 T1936 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23995 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@6a81642e
[junit4:junit4] 2> 11799 T1936 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 11799 T2008 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23995. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 11800 T2008 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23995, initiating session
[junit4:junit4] 2> 11801 T1938 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:65256
[junit4:junit4] 2> 11801 T1938 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:65256
[junit4:junit4] 2> 11803 T1940 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d49f8afbc0009 with negotiated timeout 20000 for client /140.211.11.196:65256
[junit4:junit4] 2> 11803 T2008 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23995, sessionid = 0x13d49f8afbc0009, negotiated timeout = 20000
[junit4:junit4] 2> 11803 T2009 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6a81642e name:ZooKeeperConnection Watcher:127.0.0.1:23995 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 11803 T1936 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 11805 T1941 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d49f8afbc0009
[junit4:junit4] 2> 11806 T2009 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 11806 T1938 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:65256 which had sessionid 0x13d49f8afbc0009
[junit4:junit4] 2> 11806 T1936 oaz.ZooKeeper.close Session: 0x13d49f8afbc0009 closed
[junit4:junit4] 2> 11807 T1936 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 11816 T1936 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23995/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@360469df
[junit4:junit4] 2> 11817 T1936 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 11817 T2010 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23995. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 11818 T2010 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23995, initiating session
[junit4:junit4] 2> 11818 T1938 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:45925
[junit4:junit4] 2> 11818 T1938 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:45925
[junit4:junit4] 2> 11819 T1940 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d49f8afbc000a with negotiated timeout 20000 for client /140.211.11.196:45925
[junit4:junit4] 2> 11820 T2010 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23995, sessionid = 0x13d49f8afbc000a, negotiated timeout = 20000
[junit4:junit4] 2> 11820 T2011 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@360469df name:ZooKeeperConnection Watcher:127.0.0.1:23995/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 11820 T1936 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 11821 T1941 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d49f8afbc000a type:create cxid:0x1 zxid:0x81 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 11823 T1941 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d49f8afbc000a type:create cxid:0x2 zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 11831 T1936 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 12834 T1936 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36187_m_d%2Ffq
[junit4:junit4] 2> 12835 T1941 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d49f8afbc000a type:delete cxid:0xb zxid:0x83 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:36187_m_d%2Ffq Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:36187_m_d%2Ffq
[junit4:junit4] 2> 12836 T1936 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:36187_m_d%2Ffq
[junit4:junit4] 2> 12839 T1994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12839 T1958 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12839 T1965 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12840 T1978 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 12840 T2011 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 12840 T1978 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 12841 T1994 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 12841 T1958 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 12853 T1965 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 12858 T2012 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1362745679020/collection1
[junit4:junit4] 2> 12858 T1959 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12858 T2012 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 12859 T1959 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:31677_m_d%2Ffq",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:31677/m_d/fq"}
[junit4:junit4] 2> 12859 T2012 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 12859 T2012 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 12861 T2012 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1362745679020/collection1/'
[junit4:junit4] 2> 12862 T2012 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty3-1362745679020/collection1/lib/README' to classloader
[junit4:junit4] 2> 12862 T2012 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty3-1362745679020/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 12872 T1994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 12872 T1978 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 12872 T2011 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 12872 T1958 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 12872 T1965 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 12895 T2012 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 12934 T2012 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 12935 T2012 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 12939 T2012 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 13356 T2012 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 13363 T2012 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 13366 T2012 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 13377 T2012 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 13381 T2012 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 13384 T2012 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 13385 T2012 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 13386 T2012 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 13386 T2012 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 13387 T2012 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 13387 T2012 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 13387 T2012 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1362745679020/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1362745667509/jetty3/
[junit4:junit4] 2> 13387 T2012 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4ee14d81
[junit4:junit4] 2> 13387 T2012 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 13388 T2012 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1362745667509/jetty3 forceNew: false
[junit4:junit4] 2> 13388 T2012 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1362745667509/jetty3/index/
[junit4:junit4] 2> 13389 T2012 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1362745667509/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 13389 T2012 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1362745667509/jetty3/index forceNew: false
[junit4:junit4] 2> 13391 T2012 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@321b8bc9 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5a3770d2),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 13391 T2012 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 13392 T2012 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 13393 T2012 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 13393 T2012 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 13394 T2012 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 13394 T2012 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 13394 T2012 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 13394 T2012 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 13395 T2012 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 13395 T2012 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 13400 T2012 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 13403 T2012 oass.SolrIndexSearcher.<init> Opening Searcher@6c91110c main
[junit4:junit4] 2> 13404 T2012 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1362745667509/jetty3/tlog
[junit4:junit4] 2> 13404 T2012 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 13404 T2012 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 13407 T2013 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6c91110c main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 13409 T2012 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 13409 T2012 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 13519 T1968 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:31677_m_d%252Ffq_collection1&state=recovering&nodeName=127.0.0.1:31677_m_d%252Ffq&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002
[junit4:junit4] 2> 14376 T1959 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14377 T1959 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:36187_m_d%2Ffq",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:36187/m_d/fq"}
[junit4:junit4] 2> 14377 T1959 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 14378 T1959 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 14392 T1958 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14392 T1994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14392 T2011 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14392 T1965 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14392 T1978 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14411 T2012 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 14411 T2012 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:36187/m_d/fq collection:collection1 shard:shard1
[junit4:junit4] 2> 14414 T2012 oasc.ZkController.register We are http://127.0.0.1:36187/m_d/fq/collection1/ and leader is http://127.0.0.1:55492/m_d/fq/collection1/
[junit4:junit4] 2> 14414 T2012 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:36187/m_d/fq
[junit4:junit4] 2> 14414 T2012 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 14415 T2012 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C135 name=collection1 org.apache.solr.core.SolrCore@4a398d2c url=http://127.0.0.1:36187/m_d/fq/collection1 node=127.0.0.1:36187_m_d%2Ffq C135_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:36187_m_d%2Ffq, base_url=http://127.0.0.1:36187/m_d/fq}
[junit4:junit4] 2> 14415 T2014 C135 P36187 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 14415 T2014 C135 P36187 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 14415 T2012 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14416 T2014 C135 P36187 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 14416 T2014 C135 P36187 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 14416 T1936 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4:junit4] 2> 14417 T2014 C135 P36187 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 14417 T1936 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 14418 T1936 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 14615 T1936 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 14617 T1936 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:33172
[junit4:junit4] 2> 14618 T1936 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 14619 T1936 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 14619 T1936 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1362745681936
[junit4:junit4] 2> 14620 T1936 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1362745681936/solr.xml
[junit4:junit4] 2> 14620 T1936 oasc.CoreContainer.<init> New CoreContainer 408314008
[junit4:junit4] 2> 14621 T1936 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1362745681936/'
[junit4:junit4] 2> 14621 T1936 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1362745681936/'
[junit4:junit4] 2> 14671 T1936 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 14672 T1936 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 14672 T1936 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 14672 T1936 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 14673 T1936 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 14673 T1936 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 14674 T1936 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 14674 T1936 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 14675 T1936 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 14675 T1936 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 14696 T1936 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 14715 T1936 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:23995/solr
[junit4:junit4] 2> 14716 T1936 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 14716 T1936 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23995 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@3d76e6c9
[junit4:junit4] 2> 14717 T1936 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 14718 T2025 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23995. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 14718 T2025 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23995, initiating session
[junit4:junit4] 2> 14719 T1938 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:22668
[junit4:junit4] 2> 14719 T1938 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:22668
[junit4:junit4] 2> 14746 T1940 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d49f8afbc000b with negotiated timeout 20000 for client /140.211.11.196:22668
[junit4:junit4] 2> 14746 T2025 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23995, sessionid = 0x13d49f8afbc000b, negotiated timeout = 20000
[junit4:junit4] 2> 14746 T2026 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3d76e6c9 name:ZooKeeperConnection Watcher:127.0.0.1:23995 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 14746 T1936 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 14748 T1941 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d49f8afbc000b
[junit4:junit4] 2> 14749 T2026 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 14749 T1938 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:22668 which had sessionid 0x13d49f8afbc000b
[junit4:junit4] 2> 14749 T1936 oaz.ZooKeeper.close Session: 0x13d49f8afbc000b closed
[junit4:junit4] 2> 14750 T1936 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 14761 T1936 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23995/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@7d51ad90
[junit4:junit4] 2> 14762 T1936 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 14762 T2027 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23995. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 14763 T2027 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23995, initiating session
[junit4:junit4] 2> 14763 T1938 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:43454
[junit4:junit4] 2> 14763 T1938 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:43454
[junit4:junit4] 2> 14764 T1940 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d49f8afbc000c with negotiated timeout 20000 for client /140.211.11.196:43454
[junit4:junit4] 2> 14764 T2027 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23995, sessionid = 0x13d49f8afbc000c, negotiated timeout = 20000
[junit4:junit4] 2> 14765 T2028 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7d51ad90 name:ZooKeeperConnection Watcher:127.0.0.1:23995/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 14765 T1936 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 14766 T1941 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d49f8afbc000c type:create cxid:0x1 zxid:0x94 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 14768 T1941 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d49f8afbc000c type:create cxid:0x2 zxid:0x95 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 14777 T1936 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> C134_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:31677_m_d%2Ffq, base_url=http://127.0.0.1:31677/m_d/fq}
[junit4:junit4] 2> 15520 T1997 C134 P31677 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:55492/m_d/fq/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 15520 T1997 C134 P31677 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:31677/m_d/fq START replicas=[http://127.0.0.1:55492/m_d/fq/collection1/] nUpdates=100
[junit4:junit4] 2> 15520 T1997 C134 P31677 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 15521 T1997 C134 P31677 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 15521 T1997 C134 P31677 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 15522 T1997 C134 P31677 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 15522 T1997 C134 P31677 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 15522 T1997 C134 P31677 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:55492/m_d/fq/collection1/. core=collection1
[junit4:junit4] 2> 15522 T1997 C134 P31677 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C136 name=collection1 org.apache.solr.core.SolrCore@62c41cca url=http://127.0.0.1:55492/m_d/fq/collection1 node=127.0.0.1:55492_m_d%2Ffq C136_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:55492_m_d%2Ffq, base_url=http://127.0.0.1:55492/m_d/fq, leader=true}
[junit4:junit4] 2> 15528 T1970 C136 P55492 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 15534 T1971 C136 P55492 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 15536 T1971 C136 P55492 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3773908b lockFactory=org.apache.lucene.store.NativeFSLockFactory@6e07d1aa),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 15537 T1971 C136 P55492 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 15537 T1971 C136 P55492 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3773908b lockFactory=org.apache.lucene.store.NativeFSLockFactory@6e07d1aa),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3773908b lockFactory=org.apache.lucene.store.NativeFSLockFactory@6e07d1aa),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 15538 T1971 C136 P55492 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 15538 T1971 C136 P55492 oass.SolrIndexSearcher.<init> Opening Searcher@45a41998 realtime
[junit4:junit4] 2> 15539 T1971 C136 P55492 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 15539 T1971 C136 P55492 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> 15540 T1997 C134 P31677 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 15540 T1997 C134 P31677 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 15542 T1972 C136 P55492 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 15542 T1972 C136 P55492 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 15543 T1997 C134 P31677 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 15543 T1997 C134 P31677 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 15543 T1997 C134 P31677 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 15545 T1972 C136 P55492 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 15546 T1997 C134 P31677 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 15547 T1997 C134 P31677 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1362745667509/jetty2/index.20130308082803050 forceNew: false
[junit4:junit4] 2> 15547 T1997 C134 P31677 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@16d2e172 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5be69f93)) fullCopy=false
[junit4:junit4] 2> 15550 T1972 C136 P55492 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 15602 T1997 C134 P31677 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 15603 T1997 C134 P31677 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 15603 T1997 C134 P31677 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 15605 T1997 C134 P31677 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2f27d403 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5b3d2ba0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2f27d403 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5b3d2ba0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 15605 T1997 C134 P31677 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 15605 T1997 C134 P31677 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 15605 T1997 C134 P31677 oass.SolrIndexSearcher.<init> Opening Searcher@1c1c696b main
[junit4:junit4] 2> 15606 T1996 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1c1c696b main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 15607 T1997 C134 P31677 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@16d2e172 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5be69f93))
[junit4:junit4] 2> 15607 T1997 C134 P31677 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 15607 T1997 C134 P31677 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 15608 T1997 C134 P31677 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 15608 T1997 C134 P31677 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 15611 T1997 C134 P31677 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 15779 T1936 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33172_m_d%2Ffq
[junit4:junit4] 2> 15780 T1941 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d49f8afbc000c type:delete cxid:0xb zxid:0x97 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:33172_m_d%2Ffq Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:33172_m_d%2Ffq
[junit4:junit4] 2> 15782 T1936 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:33172_m_d%2Ffq
[junit4:junit4] 2> 15785 T1965 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15785 T1958 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15785 T1994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 15786 T2028 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 15786 T2011 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 15786 T1978 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 15787 T1978 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15787 T2011 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15787 T1965 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 15794 T1994 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 15795 T1958 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 15799 T2031 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1362745681936/collection1
[junit4:junit4] 2> 15799 T2031 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 15800 T2031 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 15800 T2031 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 15801 T2031 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1362745681936/collection1/'
[junit4:junit4] 2> 15802 T2031 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty4-1362745681936/collection1/lib/README' to classloader
[junit4:junit4] 2> 15803 T2031 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty4-1362745681936/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 15849 T2031 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 15897 T1959 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 15898 T1959 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:36187_m_d%2Ffq",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:36187/m_d/fq"}
[junit4:junit4] 2> 15901 T1959 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:31677_m_d%2Ffq",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:31677/m_d/fq"}
[junit4:junit4] 2> 15906 T2031 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 15910 T2031 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 15916 T2031 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 15918 T1994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15918 T1978 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15918 T2028 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15918 T1965 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15918 T1958 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 15918 T2011 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 16436 T1969 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:36187_m_d%252Ffq_collection1&state=recovering&nodeName=127.0.0.1:36187_m_d%252Ffq&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002
[junit4:junit4] 2> 16535 T2031 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 16546 T2031 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 16548 T2031 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 16558 T2031 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 16562 T2031 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 16565 T2031 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 16565 T2031 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 16566 T2031 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 16566 T2031 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 16567 T2031 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 16567 T2031 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 16567 T2031 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1362745681936/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1362745667509/jetty4/
[junit4:junit4] 2> 16568 T2031 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4ee14d81
[junit4:junit4] 2> 16568 T2031 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 16568 T2031 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1362745667509/jetty4 forceNew: false
[junit4:junit4] 2> 16569 T2031 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1362745667509/jetty4/index/
[junit4:junit4] 2> 16569 T2031 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1362745667509/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 16569 T2031 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1362745667509/jetty4/index forceNew: false
[junit4:junit4] 2> 16571 T2031 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@69ad92ce lockFactory=org.apache.lucene.store.NativeFSLockFactory@75c47122),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 16571 T2031 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 16573 T2031 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 16573 T2031 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 16574 T2031 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 16574 T2031 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 16575 T2031 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 16575 T2031 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 16575 T2031 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 16575 T2031 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 16576 T2031 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 16580 T2031 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 16584 T2031 oass.SolrIndexSearcher.<init> Opening Searcher@5be50bbb main
[junit4:junit4] 2> 16585 T2031 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1362745667509/jetty4/tlog
[junit4:junit4] 2> 16585 T2031 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 16585 T2031 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 16588 T2032 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5be50bbb main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 16590 T2031 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 16590 T2031 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 17424 T1959 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17425 T1959 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:33172_m_d%2Ffq",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:33172/m_d/fq"}
[junit4:junit4] 2> 17425 T1959 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 17425 T1959 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 17432 T1958 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17433 T2011 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17433 T1978 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17432 T1965 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17432 T1994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17433 T2028 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 17594 T2031 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 17594 T2031 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:33172/m_d/fq collection:collection1 shard:shard1
[junit4:junit4] 2> 17597 T2031 oasc.ZkController.register We are http://127.0.0.1:33172/m_d/fq/collection1/ and leader is http://127.0.0.1:55492/m_d/fq/collection1/
[junit4:junit4] 2> 17597 T2031 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:33172/m_d/fq
[junit4:junit4] 2> 17597 T2031 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 17597 T2031 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C137 name=collection1 org.apache.solr.core.SolrCore@3c7293ab url=http://127.0.0.1:33172/m_d/fq/collection1 node=127.0.0.1:33172_m_d%2Ffq C137_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:33172_m_d%2Ffq, base_url=http://127.0.0.1:33172/m_d/fq}
[junit4:junit4] 2> 17598 T2033 C137 P33172 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 17598 T2033 C137 P33172 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 17598 T2031 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17598 T2033 C137 P33172 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 17599 T2033 C137 P33172 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 17599 T1936 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4:junit4] 2> 17600 T2033 C137 P33172 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 17600 T1936 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 17600 T1936 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 17798 T1936 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 17802 T1936 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:40532
[junit4:junit4] 2> 17802 T1936 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 17803 T1936 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 17803 T1936 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty5-1362745685122
[junit4:junit4] 2> 17804 T1936 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty5-1362745685122/solr.xml
[junit4:junit4] 2> 17804 T1936 oasc.CoreContainer.<init> New CoreContainer 174165952
[junit4:junit4] 2> 17805 T1936 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty5-1362745685122/'
[junit4:junit4] 2> 17805 T1936 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty5-1362745685122/'
[junit4:junit4] 2> 17854 T1936 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 17855 T1936 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 17855 T1936 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 17856 T1936 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 17856 T1936 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 17857 T1936 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 17857 T1936 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 17858 T1936 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 17858 T1936 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 17858 T1936 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 17877 T1936 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 17895 T1936 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:23995/solr
[junit4:junit4] 2> 17896 T1936 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 17897 T1936 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23995 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@235feb10
[junit4:junit4] 2> 17898 T1936 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 17899 T2044 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23995. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 17899 T2044 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23995, initiating session
[junit4:junit4] 2> 17900 T1938 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:56421
[junit4:junit4] 2> 17900 T1938 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:56421
[junit4:junit4] 2> 17901 T1940 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d49f8afbc000d with negotiated timeout 20000 for client /140.211.11.196:56421
[junit4:junit4] 2> 17901 T2044 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23995, sessionid = 0x13d49f8afbc000d, negotiated timeout = 20000
[junit4:junit4] 2> 17902 T2045 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@235feb10 name:ZooKeeperConnection Watcher:127.0.0.1:23995 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 17902 T1936 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 17903 T1941 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d49f8afbc000d
[junit4:junit4] 2> 17904 T2045 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 17905 T1938 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:56421 which had sessionid 0x13d49f8afbc000d
[junit4:junit4] 2> 17904 T1936 oaz.ZooKeeper.close Session: 0x13d49f8afbc000d closed
[junit4:junit4] 2> 17906 T1936 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 17915 T1936 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23995/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@4810971c
[junit4:junit4] 2> 17916 T1936 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 17916 T2046 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23995. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 17916 T2046 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23995, initiating session
[junit4:junit4] 2> 17917 T1938 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:32476
[junit4:junit4] 2> 17917 T1938 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:32476
[junit4:junit4] 2> 17918 T1940 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d49f8afbc000e with negotiated timeout 20000 for client /140.211.11.196:32476
[junit4:junit4] 2> 17918 T2046 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23995, sessionid = 0x13d49f8afbc000e, negotiated timeout = 20000
[junit4:junit4] 2> 17918 T2047 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4810971c name:ZooKeeperConnection Watcher:127.0.0.1:23995/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 17919 T1936 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 17920 T1941 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d49f8afbc000e type:create cxid:0x1 zxid:0xab txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 17921 T1941 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d49f8afbc000e type:create cxid:0x2 zxid:0xac txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 17930 T1936 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> C135_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:36187_m_d%2Ffq, base_url=http://127.0.0.1:36187/m_d/fq}
[junit4:junit4] 2> 18438 T2014 C135 P36187 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:55492/m_d/fq/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 18438 T2014 C135 P36187 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:36187/m_d/fq START replicas=[http://127.0.0.1:55492/m_d/fq/collection1/] nUpdates=100
[junit4:junit4] 2> 18438 T2014 C135 P36187 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 18439 T2014 C135 P36187 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 18439 T2014 C135 P36187 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 18439 T2014 C135 P36187 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 18439 T2014 C135 P36187 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 18439 T2014 C135 P36187 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:55492/m_d/fq/collection1/. core=collection1
[junit4:junit4] 2> 18439 T2014 C135 P36187 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 18441 T1970 C136 P55492 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 18450 T1974 C136 P55492 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 18451 T1974 C136 P55492 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3773908b lockFactory=org.apache.lucene.store.NativeFSLockFactory@6e07d1aa),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3773908b lockFactory=org.apache.lucene.store.NativeFSLockFactory@6e07d1aa),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 18452 T1974 C136 P55492 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 18452 T1974 C136 P55492 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 18452 T1974 C136 P55492 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 3
[junit4:junit4] 2> 18453 T2014 C135 P36187 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 18453 T2014 C135 P36187 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 18456 T1972 C136 P55492 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 18457 T2014 C135 P36187 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4] 2> 18457 T2014 C135 P36187 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 18457 T2014 C135 P36187 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 18459 T1972 C136 P55492 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=3&version=2} status=0 QTime=0
[junit4:junit4] 2> 18460 T2014 C135 P36187 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 18461 T2014 C135 P36187 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1362745667509/jetty3/index.20130308082805964 forceNew: false
[junit4:junit4] 2> 18461 T2014 C135 P36187 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@31d5ffb5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7e40e415)) fullCopy=false
[junit4:junit4] 2> 18463 T1972 C136 P55492 REQ /replication {file=segments_3&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0
[junit4:junit4] 2> 18464 T2014 C135 P36187 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 18465 T2014 C135 P36187 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 18465 T2014 C135 P36187 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 18467 T2014 C135 P36187 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@321b8bc9 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5a3770d2),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@321b8bc9 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5a3770d2),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 18467 T2014 C135 P36187 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 18467 T2014 C135 P36187 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 18468 T2014 C135 P36187 oass.SolrIndexSearcher.<init> Opening Searcher@1210bfcf main
[junit4:junit4] 2> 18469 T2013 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1210bfcf main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 18469 T2014 C135 P36187 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@31d5ffb5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7e40e415))
[junit4:junit4] 2> 18469 T2014 C135 P36187 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 18469 T2014 C135 P36187 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 18470 T2014 C135 P36187 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 18470 T2014 C135 P36187 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 18473 T2014 C135 P36187 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 18933 T1936 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40532_m_d%2Ffq
[junit4:junit4] 2> 18934 T1941 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d49f8afbc000e type:delete cxid:0xb zxid:0xae txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:40532_m_d%2Ffq Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:40532_m_d%2Ffq
[junit4:junit4] 2> 18936 T1936 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40532_m_d%2Ffq
[junit4:junit4] 2> 18937 T1959 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18937 T1959 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:33172_m_d%2Ffq",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:33172/m_d/fq"}
[junit4:junit4] 2> 18939 T1965 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18939 T1958 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18939 T1994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18946 T2047 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 18946 T2011 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 18945 T1978 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 18946 T2028 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 18946 T2011 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 18947 T2028 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 18946 T1978 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 18947 T1965 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 18954 T1994 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 18954 T1959 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:36187_m_d%2Ffq",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:36187/m_d/fq"}
[junit4:junit4] 2> 18960 T2050 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty5-1362745685122/collection1
[junit4:junit4] 2> 18960 T2050 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 18965 T2050 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 18965 T2050 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 18966 T2050 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty5-1362745685122/collection1/'
[junit4:junit4] 2> 18967 T2011 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 18967 T2047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 18967 T1978 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 18967 T1994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 18967 T1965 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 18967 T2028 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 18968 T2050 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty5-1362745685122/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 18969 T2050 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty5-1362745685122/collection1/lib/README' to classloader
[junit4:junit4] 2> 18977 T1958 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 18978 T1958 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 19016 T2050 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 19080 T2050 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 19081 T2050 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 19087 T2050 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 19621 T1973 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:33172_m_d%252Ffq_collection1&state=recovering&nodeName=127.0.0.1:33172_m_d%252Ffq&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002
[junit4:junit4] 2> 19642 T2050 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 19650 T2050 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 19653 T2050 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 19664 T2050 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 19667 T2050 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 19671 T2050 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 19672 T2050 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 19672 T2050 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 19673 T2050 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 19674 T2050 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 19674 T2050 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 19674 T2050 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty5-1362745685122/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1362745667509/jetty5/
[junit4:junit4] 2> 19674 T2050 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4ee14d81
[junit4:junit4] 2> 19674 T2050 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 19675 T2050 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1362745667509/jetty5 forceNew: false
[junit4:junit4] 2> 19675 T2050 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1362745667509/jetty5/index/
[junit4:junit4] 2> 19676 T2050 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1362745667509/jetty5/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 19676 T2050 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1362745667509/jetty5/index forceNew: false
[junit4:junit4] 2> 19678 T2050 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@13a8b2e2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@65d99836),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 19678 T2050 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 19679 T2050 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 19680 T2050 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 19680 T2050 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 19681 T2050 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 19681 T2050 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 19681 T2050 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 19681 T2050 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 19682 T2050 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 19682 T2050 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 19687 T2050 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 19691 T2050 oass.SolrIndexSearcher.<init> Opening Searcher@7fe15a1 main
[junit4:junit4] 2> 19691 T2050 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1362745667509/jetty5/tlog
[junit4:junit4] 2> 19692 T2050 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 19692 T2050 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 19694 T2051 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7fe15a1 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 19695 T2050 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 19695 T2050 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 20478 T1959 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20479 T1959 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:40532_m_d%2Ffq",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40532/m_d/fq"}
[junit4:junit4] 2> 20479 T1959 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 20479 T1959 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 20492 T2011 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 20492 T2028 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 20492 T2047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 20492 T1994 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 20492 T1965 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 20493 T1978 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 20493 T1958 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 20698 T2050 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 20698 T2050 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:40532/m_d/fq collection:collection1 shard:shard1
[junit4:junit4] 2> 20701 T2050 oasc.ZkController.register We are http://127.0.0.1:40532/m_d/fq/collection1/ and leader is http://127.0.0.1:55492/m_d/fq/collection1/
[junit4:junit4] 2> 20701 T2050 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40532/m_d/fq
[junit4:junit4] 2> 20701 T2050 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 20702 T2050 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C138 name=collection1 org.apache.solr.core.SolrCore@40cac70f url=http://127.0.0.1:40532/m_d/fq/collection1 node=127.0.0.1:40532_m_d%2Ffq C138_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:40532_m_d%2Ffq, base_url=http://127.0.0.1:40532/m_d/fq}
[junit4:junit4] 2> 20702 T2052 C138 P40532 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 20703 T2052 C138 P40532 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 20703 T2052 C138 P40532 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 20703 T2052 C138 P40532 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 20703 T2050 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20704 T2052 C138 P40532 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 20705 T1936 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4:junit4] 2> 20705 T1936 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 20706 T1936 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 20901 T1936 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 20904 T1936 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:37713
[junit4:junit4] 2> 20905 T1936 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 20905 T1936 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 20906 T1936 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty6-1362745688223
[junit4:junit4] 2> 20906 T1936 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty6-1362745688223/solr.xml
[junit4:junit4] 2> 20907 T1936 oasc.CoreContainer.<init> New CoreContainer 1378094936
[junit4:junit4] 2> 20908 T1936 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty6-1362745688223/'
[junit4:junit4] 2> 20908 T1936 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty6-1362745688223/'
[junit4:junit4] 2> 20957 T1936 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 20958 T1936 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 20959 T1936 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 20959 T1936 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 20959 T1936 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 20960 T1936 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 20960 T1936 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 20961 T1936 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 20961 T1936 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 20962 T1936 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 20982 T1936 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 21001 T1936 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:23995/solr
[junit4:junit4] 2> 21001 T1936 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 21002 T1936 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23995 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@5dca5ddf
[junit4:junit4] 2> 21003 T1936 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 21003 T2063 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23995. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 21004 T2063 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23995, initiating session
[junit4:junit4] 2> 21004 T1938 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:38593
[junit4:junit4] 2> 21005 T1938 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:38593
[junit4:junit4] 2> 21007 T1940 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d49f8afbc000f with negotiated timeout 20000 for client /140.211.11.196:38593
[junit4:junit4] 2> 21007 T2063 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23995, sessionid = 0x13d49f8afbc000f, negotiated timeout = 20000
[junit4:junit4] 2> 21007 T2064 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5dca5ddf name:ZooKeeperConnection Watcher:127.0.0.1:23995 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 21007 T1936 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 21009 T1941 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d49f8afbc000f
[junit4:junit4] 2> 21023 T2064 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 21023 T1938 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:38593 which had sessionid 0x13d49f8afbc000f
[junit4:junit4] 2> 21023 T1936 oaz.ZooKeeper.close Session: 0x13d49f8afbc000f closed
[junit4:junit4] 2> 21024 T1936 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 21035 T1936 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:23995/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@446baaa
[junit4:junit4] 2> 21036 T1936 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 21036 T2065 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:23995. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 21037 T2065 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:23995, initiating session
[junit4:junit4] 2> 21037 T1938 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:32574
[junit4:junit4] 2> 21038 T1938 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:32574
[junit4:junit4] 2> 21039 T1940 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d49f8afbc0010 with negotiated timeout 20000 for client /140.211.11.196:32574
[junit4:junit4] 2> 21039 T2065 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:23995, sessionid = 0x13d49f8afbc0010, negotiated timeout = 20000
[junit4:junit4] 2> 21039 T2066 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@446baaa name:ZooKeeperConnection Watcher:127.0.0.1:23995/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 21039 T1936 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 21040 T1941 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d49f8afbc0010 type:create cxid:0x1 zxid:0xc2 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 21042 T1941 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d49f8afbc0010 type:create cxid:0x2 zxid:0xc3 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 21050 T1936 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> C137_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:33172_m_d%2Ffq, base_url=http://127.0.0.1:33172/m_d/fq}
[junit4:junit4] 2> 21623 T2033 C137 P33172 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:55492/m_d/fq/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 21623 T2033 C137 P33172 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:33172/m_d/fq START replicas=[http://127.0.0.1:55492/m_d/fq/collection1/] nUpdates=100
[junit4:junit4] 2> 21624 T2033 C137 P33172 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 21624 T2033 C137 P33172 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 21624 T2033 C137 P33172 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 21624 T2033 C137 P33172 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 21624 T2033 C137 P33172 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 21625 T2033 C137 P33172 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:55492/m_d/fq/collection1/. core=collection1
[junit4:junit4] 2> 21625 T2033 C137 P33172 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 21626 T1970 C136 P55492 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 21636 T1971 C136 P55492 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 21647 T1971 C136 P55492 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=3
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3773908b lockFactory=org.apache.lucene.store.NativeFSLockFactory@6e07d1aa),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3773908b lockFactory=org.apache.lucene.store.NativeFSLockFactory@6e07d1aa),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3773908b lockFactory=org.apache.lucene.store.NativeFSLockFactory@6e07d1aa),segFN=segments_4,generation=4,filenames=[segments_4]
[junit4:junit4] 2> 21647 T1971 C136 P55492 oasc.SolrDeletionPolicy.updateCommits newest commit = 4[segments_4]
[junit4:junit4] 2> 21648 T1971 C136 P55492 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 21648 T1971 C136 P55492 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 12
[junit4:junit4] 2> 21649 T2033 C137 P33172 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 21649 T2033 C137 P33172 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 21651 T1972 C136 P55492 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 21652 T2033 C137 P33172 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4] 2> 21652 T2033 C137 P33172 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 21652 T2033 C137 P33172 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 21654 T1972 C136 P55492 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=4&version=2} status=0 QTime=0
[junit4:junit4] 2> 21655 T2033 C137 P33172 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 21655 T2033 C137 P33172 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-1362745667509/jetty4/index.20130308082809159 forceNew: false
[junit4:junit4] 2> 21656 T2033 C137 P33172 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(RateLimitedDirectoryWrapper(org.apache.lucene.store.RAMDirectory@1
[...truncated too long message...]
core/data
[junit4:junit4] 2> 804076 T1814 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00008_core/data
[junit4:junit4] 2> 804076 T1814 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00008_core/data/index
[junit4:junit4] 2> 804077 T1814 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00008_core/data/index
[junit4:junit4] 2> 804470 T1814 oasc.SolrCore.close [00018_core] CLOSING SolrCore org.apache.solr.core.SolrCore@55bbb3d7
[junit4:junit4] 2> 804473 T1814 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=7,autocommits=0,soft autocommits=6,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=7134,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 804474 T1814 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 804474 T1814 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 804474 T1814 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 804476 T1814 oasc.SolrCore.closeSearcher [00018_core] Closing main searcher on request.
[junit4:junit4] 2> 804476 T1814 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00018_core/data/index
[junit4:junit4] 2> 804477 T1814 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00018_core/data/index
[junit4:junit4] 2> 804879 T1814 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00018_core/data
[junit4:junit4] 2> 804880 T1814 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00018_core/data
[junit4:junit4] 2> 804880 T1814 oasc.SolrCore.close [00006_core] CLOSING SolrCore org.apache.solr.core.SolrCore@2ce9c4c8
[junit4:junit4] 2> 804883 T1814 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=7,autocommits=0,soft autocommits=6,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=7121,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 804884 T1814 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 804884 T1814 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 804884 T1814 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 804886 T1814 oasc.SolrCore.closeSearcher [00006_core] Closing main searcher on request.
[junit4:junit4] 2> 804886 T1814 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00006_core/data/index
[junit4:junit4] 2> 804887 T1814 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00006_core/data/index
[junit4:junit4] 2> 805284 T1814 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00006_core/data
[junit4:junit4] 2> 805285 T1814 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00006_core/data
[junit4:junit4] 2> 805285 T1814 oasc.SolrCore.close [00014_core] CLOSING SolrCore org.apache.solr.core.SolrCore@30d9360a
[junit4:junit4] 2> 805288 T1814 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=7,autocommits=0,soft autocommits=6,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=6961,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 805289 T1814 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 805289 T1814 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 805289 T1814 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 805291 T1814 oasc.SolrCore.closeSearcher [00014_core] Closing main searcher on request.
[junit4:junit4] 2> 805292 T1814 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00014_core/data
[junit4:junit4] 2> 805292 T1814 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00014_core/data
[junit4:junit4] 2> 805293 T1814 oasc.CachingDirectoryFactory.close Closing directory when closing factory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00014_core/data/index
[junit4:junit4] 2> 805293 T1814 oasc.CachingDirectoryFactory.closeDirectory Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./OpenCloseCoreStressTest_/00014_core/data/index
[junit4:junit4] 2> 805710 T1814 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4] 2> 806076 T1814 oas.SolrTestCaseJ4.tearDown ###Ending test30SecondsOld
[junit4:junit4] 2> 806078 T1814 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {id=Lucene41(blocksize=128), text=PostingsFormat(name=Memory doPackFST= true)}, docValues:{}, sim=DefaultSimilarity, locale=ga_IE, timezone=Europe/Chisinau
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Sun Microsystems Inc. 1.6.0_32 (64-bit)/cpus=16,threads=1,free=10492944,total=530055168
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestSearchPerf, ClusterStateUpdateTest, MBeansHandlerTest, TestLMDirichletSimilarityFactory, MinimalSchemaTest, TestSolrCoreProperties, TestPhraseSuggestions, UUIDFieldTest, TestConfig, QueryEqualityTest, CoreAdminHandlerTest, PreAnalyzedFieldTest, TestSolrIndexConfig, AlternateDirectoryTest, ReturnFieldsTest, StatelessScriptUpdateProcessorFactoryTest, TestRealTimeGet, TestDocumentBuilder, BasicFunctionalityTest, ResourceLoaderTest, BasicDistributedZkTest, TestFastWriter, DocumentBuilderTest, TestFastLRUCache, TestPseudoReturnFields, TestPluginEnable, TestStressRecovery, SliceStateUpdateTest, TestCoreContainer, PluginInfoTest, TestSweetSpotSimilarityFactory, PeerSyncTest, LukeRequestHandlerTest, TestFunctionQuery, WordBreakSolrSpellCheckerTest, TestReversedWildcardFilterFactory, TestFuzzyAnalyzedSuggestions, TestJoin, TestFieldTypeCollectionResource, UnloadDistributedZkTest, SliceStateTest, TestRemoteStreaming, TestWriterPerf, SuggesterTest, DocValuesTest, TestSolrQueryParser, TestSolrDeletionPolicy1, AutoCommitTest, TestGroupingSearch, SOLR749Test, CircularListTest, SynonymTokenizerTest, BadComponentTest, ShowFileRequestHandlerTest, SuggesterFSTTest, SolrCoreTest, TestTrie, TestBadConfig, SchemaVersionSpecificBehaviorTest, QueryParsingTest, DistributedTermsComponentTest, IndexSchemaTest, PrimitiveFieldTypeTest, TestQuerySenderListener, BasicDistributedZk2Test, OpenCloseCoreStressTest]
[junit4:junit4] Completed on J0 in 806.10s, 6 tests, 1 failure, 2 skipped <<< FAILURES!
[...truncated 404 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:388: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:361: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:183: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:449: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1213: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:877: There were test failures: 269 suites, 1137 tests, 2 failures, 25 ignored (6 assumptions)
Total time: 135 minutes 47 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 199 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/199/
3 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.SyncSliceTest
Error Message:
ERROR: SolrIndexSearcher opens=243 closes=242
Stack Trace:
java.lang.AssertionError: ERROR: SolrIndexSearcher opens=243 closes=242
at __randomizedtesting.SeedInfo.seed([C9DF8849654AE2AB]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:246)
at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:97)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:679)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.SyncSliceTest
Error Message:
2 threads leaked from SUITE scope at org.apache.solr.cloud.SyncSliceTest: 1) Thread[id=852, name=searcherExecutor-398-thread-1, state=WAITING, group=TGRP-SyncSliceTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:679) 2) Thread[id=1132, name=RecoveryThread, state=TIMED_WAITING, group=TGRP-SyncSliceTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:490) at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:223)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.SyncSliceTest:
1) Thread[id=852, name=searcherExecutor-398-thread-1, state=WAITING, group=TGRP-SyncSliceTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
2) Thread[id=1132, name=RecoveryThread, state=TIMED_WAITING, group=TGRP-SyncSliceTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:490)
at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:223)
at __randomizedtesting.SeedInfo.seed([C9DF8849654AE2AB]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.SyncSliceTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=852, name=searcherExecutor-398-thread-1, state=WAITING, group=TGRP-SyncSliceTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:679) 2) Thread[id=1132, name=RecoveryThread, state=WAITING, group=TGRP-SyncSliceTest] at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1203) at java.lang.Thread.join(Thread.java:1256) at org.apache.solr.update.DefaultSolrCoreState.cancelRecovery(DefaultSolrCoreState.java:250) at org.apache.solr.update.DefaultSolrCoreState.close(DefaultSolrCoreState.java:277) at org.apache.solr.update.SolrCoreState.decrefSolrCoreState(SolrCoreState.java:73) at org.apache.solr.core.SolrCore.close(SolrCore.java:975) at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:235)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=852, name=searcherExecutor-398-thread-1, state=WAITING, group=TGRP-SyncSliceTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
2) Thread[id=1132, name=RecoveryThread, state=WAITING, group=TGRP-SyncSliceTest]
at java.lang.Object.wait(Native Method)
at java.lang.Thread.join(Thread.java:1203)
at java.lang.Thread.join(Thread.java:1256)
at org.apache.solr.update.DefaultSolrCoreState.cancelRecovery(DefaultSolrCoreState.java:250)
at org.apache.solr.update.DefaultSolrCoreState.close(DefaultSolrCoreState.java:277)
at org.apache.solr.update.SolrCoreState.decrefSolrCoreState(SolrCoreState.java:73)
at org.apache.solr.core.SolrCore.close(SolrCore.java:975)
at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:235)
at __randomizedtesting.SeedInfo.seed([C9DF8849654AE2AB]:0)
Build Log:
[...truncated 8436 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4] 2> 1 T718 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /qy/
[junit4:junit4] 2> 6 T718 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-SyncSliceTest-1362640712825
[junit4:junit4] 2> 15 T718 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 22 T719 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 77 T719 oaz.Environment.logEnv Server environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4] 2> 77 T719 oaz.Environment.logEnv Server environment:host.name=lucene.zones.apache.org
[junit4:junit4] 2> 77 T719 oaz.Environment.logEnv Server environment:java.version=1.6.0_32
[junit4:junit4] 2> 77 T719 oaz.Environment.logEnv Server environment:java.vendor=Sun Microsystems Inc.
[junit4:junit4] 2> 77 T719 oaz.Environment.logEnv Server environment:java.home=/usr/local/openjdk6/jre
[junit4:junit4] 2> 77 T719 oaz.Environment.logEnv Server environment:java.class.path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/classes/test:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-test-framework/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/test-framework/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/codecs/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-solrj/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/analysis/common/lucene-analyzers-common-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/codecs/lucene-codecs-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/highlighter/lucene-highlighter-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/memory/lucene-memory-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/misc/lucene-misc-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/spatial/lucene-spatial-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/suggest/lucene-suggest-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/grouping/lucene-grouping-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/queries/lucene-queries-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/queryparser/lucene-queryparser-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/cglib-nodep-2.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/commons-cli-1.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/commons-codec-1.7.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/commons-fileupload-1.2.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/commons-lang-2.6.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/easymock-3.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/guava-13.0.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/javax.servlet-api-3.0.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/objenesis-1.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/org.restlet-2.1.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/org.restlet.ext.servlet-2.1.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/spatial4j-0.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/commons-io-2.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/httpclient-4.2.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/httpcore-4.2.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/httpmime-4.2.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/slf4j-api-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/wstx-asl-3.2.7.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/zookeeper-3.4.5.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/example/lib/servlet-api-3.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/core/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/test-framework/lib/junit-4.10.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/test-framework/lib/randomizedtesting-runner-2.0.8.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-launcher.jar:/home/hudson/.ant/lib/ivy-2.2.0.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-logging.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-regexp.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-oro.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-swing.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jdepend.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-xalan2.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bsf.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit4.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-net.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-antlr.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jmf.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-netrexx.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-log4j.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-resolver.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jsch.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-testutil.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bcel.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jai.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-javamail.jar:/usr/local/openjdk6/lib/tools.jar:/home/hudson/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.8.jar
[junit4:junit4] 2> 78 T719 oaz.Environment.logEnv Server environment:java.library.path=/usr/local/openjdk6/jre/lib/amd64/server:/usr/local/openjdk6/jre/lib/amd64:/usr/local/openjdk6/jre/../lib/amd64:/usr/java/packages/lib/amd64:/lib:/usr/lib:/usr/local/lib
[junit4:junit4] 2> 78 T719 oaz.Environment.logEnv Server environment:java.io.tmpdir=.
[junit4:junit4] 2> 79 T719 oaz.Environment.logEnv Server environment:java.compiler=<NA>
[junit4:junit4] 2> 79 T719 oaz.Environment.logEnv Server environment:os.name=FreeBSD
[junit4:junit4] 2> 79 T719 oaz.Environment.logEnv Server environment:os.arch=amd64
[junit4:junit4] 2> 79 T719 oaz.Environment.logEnv Server environment:os.version=9.0-RELEASE
[junit4:junit4] 2> 79 T719 oaz.Environment.logEnv Server environment:user.name=hudson
[junit4:junit4] 2> 79 T719 oaz.Environment.logEnv Server environment:user.home=/home/hudson
[junit4:junit4] 2> 79 T719 oaz.Environment.logEnv Server environment:user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4:junit4] 2> 111 T719 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 111 T719 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 111 T719 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 116 T719 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 123 T718 oasc.ZkTestServer.run start zk server on port:49200
[junit4:junit4] 2> 235 T719 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1362640712825/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 245 T718 oaz.Environment.logEnv Client environment:zookeeper.version=3.4.5-1392090, built on 09/30/2012 17:52 GMT
[junit4:junit4] 2> 245 T718 oaz.Environment.logEnv Client environment:host.name=lucene.zones.apache.org
[junit4:junit4] 2> 245 T718 oaz.Environment.logEnv Client environment:java.version=1.6.0_32
[junit4:junit4] 2> 246 T718 oaz.Environment.logEnv Client environment:java.vendor=Sun Microsystems Inc.
[junit4:junit4] 2> 246 T718 oaz.Environment.logEnv Client environment:java.home=/usr/local/openjdk6/jre
[junit4:junit4] 2> 246 T718 oaz.Environment.logEnv Client environment:java.class.path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/classes/test:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-test-framework/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/test-framework/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/codecs/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-solrj/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/analysis/common/lucene-analyzers-common-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/analysis/kuromoji/lucene-analyzers-kuromoji-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/analysis/phonetic/lucene-analyzers-phonetic-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/codecs/lucene-codecs-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/highlighter/lucene-highlighter-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/memory/lucene-memory-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/misc/lucene-misc-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/spatial/lucene-spatial-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/suggest/lucene-suggest-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/grouping/lucene-grouping-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/queries/lucene-queries-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/queryparser/lucene-queryparser-5.0-SNAPSHOT.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/cglib-nodep-2.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/commons-cli-1.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/commons-codec-1.7.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/commons-fileupload-1.2.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/commons-lang-2.6.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/easymock-3.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/guava-13.0.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/javax.servlet-api-3.0.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/objenesis-1.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/org.restlet-2.1.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/org.restlet.ext.servlet-2.1.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/lib/spatial4j-0.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/commons-io-2.1.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/httpclient-4.2.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/httpcore-4.2.2.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/httpmime-4.2.3.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/jcl-over-slf4j-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/slf4j-api-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/slf4j-jdk14-1.6.4.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/wstx-asl-3.2.7.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/solrj/lib/zookeeper-3.4.5.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/example/lib/jetty-continuation-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/example/lib/jetty-deploy-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/example/lib/jetty-http-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/example/lib/jetty-io-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/example/lib/jetty-jmx-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/example/lib/jetty-security-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/example/lib/jetty-server-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/example/lib/jetty-servlet-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/example/lib/jetty-util-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/example/lib/jetty-webapp-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/example/lib/jetty-xml-8.1.8.v20121106.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/example/lib/servlet-api-3.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/example/example-DIH/solr/db/lib/derby-10.9.1.0.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/example/example-DIH/solr/db/lib/hsqldb-1.8.0.10.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/build/core/classes/java:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/test-framework/lib/junit-4.10.jar:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/test-framework/lib/randomizedtesting-runner-2.0.8.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-launcher.jar:/home/hudson/.ant/lib/ivy-2.2.0.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-logging.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-regexp.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-oro.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-swing.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jdepend.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-xalan2.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bsf.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit4.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-net.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-antlr.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jmf.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-netrexx.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-log4j.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-resolver.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jsch.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-testutil.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bcel.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jai.jar:/home/hudson/hudson-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-javamail.jar:/usr/local/openjdk6/lib/tools.jar:/home/hudson/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.0.8.jar
[junit4:junit4] 2> 247 T718 oaz.Environment.logEnv Client environment:java.library.path=/usr/local/openjdk6/jre/lib/amd64/server:/usr/local/openjdk6/jre/lib/amd64:/usr/local/openjdk6/jre/../lib/amd64:/usr/java/packages/lib/amd64:/lib:/usr/lib:/usr/local/lib
[junit4:junit4] 2> 247 T718 oaz.Environment.logEnv Client environment:java.io.tmpdir=.
[junit4:junit4] 2> 248 T718 oaz.Environment.logEnv Client environment:java.compiler=<NA>
[junit4:junit4] 2> 248 T718 oaz.Environment.logEnv Client environment:os.name=FreeBSD
[junit4:junit4] 2> 248 T718 oaz.Environment.logEnv Client environment:os.arch=amd64
[junit4:junit4] 2> 248 T718 oaz.Environment.logEnv Client environment:os.version=9.0-RELEASE
[junit4:junit4] 2> 248 T718 oaz.Environment.logEnv Client environment:user.name=hudson
[junit4:junit4] 2> 249 T718 oaz.Environment.logEnv Client environment:user.home=/home/hudson
[junit4:junit4] 2> 249 T718 oaz.Environment.logEnv Client environment:user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4:junit4] 2> 253 T718 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49200 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@490a2cf4
[junit4:junit4] 2> 365 T718 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 379 T722 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:49200. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 387 T722 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:49200, initiating session
[junit4:junit4] 2> 388 T720 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:35530
[junit4:junit4] 2> 424 T720 oazs.NIOServerCnxn.doIO WARNING Exception causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not running
[junit4:junit4] 2> 425 T720 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:35530 (no session established for client)
[junit4:junit4] 2> 425 T722 oaz.ClientCnxn$SendThread.run Unable to read additional data from server sessionid 0x0, likely server has closed socket, closing socket connection and attempting reconnect
[junit4:junit4] 2> 1904 T722 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:49200. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 1905 T722 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:49200, initiating session
[junit4:junit4] 2> 1905 T720 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:54777
[junit4:junit4] 2> 1918 T720 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:54777
[junit4:junit4] 2> 1934 T724 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 2000 T724 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d43b735a30000 with negotiated timeout 10000 for client /140.211.11.196:54777
[junit4:junit4] 2> 2003 T722 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:49200, sessionid = 0x13d43b735a30000, negotiated timeout = 10000
[junit4:junit4] 2> 2007 T723 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@490a2cf4 name:ZooKeeperConnection Watcher:127.0.0.1:49200 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2008 T718 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2009 T718 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 2092 T725 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d43b735a30000
[junit4:junit4] 2> 2093 T723 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 2093 T718 oaz.ZooKeeper.close Session: 0x13d43b735a30000 closed
[junit4:junit4] 2> 2094 T718 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49200/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@528d8c58
[junit4:junit4] 2> 2095 T720 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:54777 which had sessionid 0x13d43b735a30000
[junit4:junit4] 2> 2096 T718 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2096 T726 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:49200. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 2097 T726 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:49200, initiating session
[junit4:junit4] 2> 2097 T720 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:35997
[junit4:junit4] 2> 2098 T720 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:35997
[junit4:junit4] 2> 2099 T724 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d43b735a30001 with negotiated timeout 10000 for client /140.211.11.196:35997
[junit4:junit4] 2> 2099 T726 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:49200, sessionid = 0x13d43b735a30001, negotiated timeout = 10000
[junit4:junit4] 2> 2100 T727 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@528d8c58 name:ZooKeeperConnection Watcher:127.0.0.1:49200/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2100 T718 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2100 T718 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 2107 T718 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 2112 T718 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 2116 T718 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 2121 T718 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 2123 T718 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 2131 T718 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 2132 T718 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 2139 T718 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 2139 T718 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 2144 T718 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 2145 T718 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 2150 T718 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 2151 T718 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 2156 T718 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 2157 T718 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 2162 T718 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 2162 T718 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 2167 T718 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 2168 T718 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 2173 T718 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 2173 T718 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 2178 T725 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d43b735a30001
[junit4:junit4] 2> 2179 T727 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 2179 T718 oaz.ZooKeeper.close Session: 0x13d43b735a30001 closed
[junit4:junit4] 2> 2179 T720 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:35997 which had sessionid 0x13d43b735a30001
[junit4:junit4] 2> 2378 T718 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 2383 T718 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:21386
[junit4:junit4] 2> 2383 T718 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 2384 T718 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 2384 T718 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1362640714998
[junit4:junit4] 2> 2385 T718 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1362640714998/solr.xml
[junit4:junit4] 2> 2385 T718 oasc.CoreContainer.<init> New CoreContainer 536713171
[junit4:junit4] 2> 2386 T718 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1362640714998/'
[junit4:junit4] 2> 2386 T718 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1362640714998/'
[junit4:junit4] 2> 2438 T718 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 2439 T718 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 2439 T718 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 2440 T718 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 2440 T718 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 2441 T718 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 2441 T718 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 2441 T718 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 2442 T718 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 2442 T718 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 2467 T718 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 2486 T718 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:49200/solr
[junit4:junit4] 2> 2522 T718 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 2523 T718 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49200 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@73982201
[junit4:junit4] 2> 2524 T718 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2525 T737 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:49200. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 2525 T737 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:49200, initiating session
[junit4:junit4] 2> 2526 T720 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:40769
[junit4:junit4] 2> 2526 T720 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:40769
[junit4:junit4] 2> 2554 T724 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d43b735a30002 with negotiated timeout 20000 for client /140.211.11.196:40769
[junit4:junit4] 2> 2554 T737 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:49200, sessionid = 0x13d43b735a30002, negotiated timeout = 20000
[junit4:junit4] 2> 2554 T738 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@73982201 name:ZooKeeperConnection Watcher:127.0.0.1:49200 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2554 T718 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2557 T725 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d43b735a30002
[junit4:junit4] 2> 2565 T738 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 2565 T720 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:40769 which had sessionid 0x13d43b735a30002
[junit4:junit4] 2> 2565 T718 oaz.ZooKeeper.close Session: 0x13d43b735a30002 closed
[junit4:junit4] 2> 2570 T718 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 2586 T718 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49200/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@11cfefe1
[junit4:junit4] 2> 2587 T718 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 2588 T739 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:49200. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 2588 T739 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:49200, initiating session
[junit4:junit4] 2> 2589 T720 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:42285
[junit4:junit4] 2> 2589 T720 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:42285
[junit4:junit4] 2> 2591 T724 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d43b735a30003 with negotiated timeout 20000 for client /140.211.11.196:42285
[junit4:junit4] 2> 2591 T739 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:49200, sessionid = 0x13d43b735a30003, negotiated timeout = 20000
[junit4:junit4] 2> 2591 T740 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11cfefe1 name:ZooKeeperConnection Watcher:127.0.0.1:49200/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 2591 T718 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 2607 T725 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d43b735a30003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2619 T718 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 2623 T718 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:21386_qy
[junit4:junit4] 2> 2629 T725 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d43b735a30003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:21386_qy Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:21386_qy
[junit4:junit4] 2> 2630 T718 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:21386_qy
[junit4:junit4] 2> 2636 T718 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 2663 T725 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d43b735a30003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 2665 T718 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 2669 T718 oasc.Overseer.start Overseer (id=89302021775228931-127.0.0.1:21386_qy-n_0000000000) starting
[junit4:junit4] 2> 2670 T725 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d43b735a30003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2689 T725 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d43b735a30003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2690 T725 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d43b735a30003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2692 T725 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d43b735a30003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2701 T742 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 2702 T718 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 2706 T718 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 2710 T718 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 2741 T741 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 2751 T743 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1362640714998/collection1
[junit4:junit4] 2> 2752 T743 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 2753 T743 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 2753 T743 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 2755 T743 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1362640714998/collection1/'
[junit4:junit4] 2> 2756 T743 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1362640714998/collection1/lib/README' to classloader
[junit4:junit4] 2> 2757 T743 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1362640714998/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 2827 T743 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 2888 T743 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 2889 T743 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 2907 T743 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 3475 T743 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 3486 T743 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 3489 T743 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 3511 T743 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 3515 T743 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 3519 T743 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 3521 T743 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 3521 T743 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 3521 T743 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 3523 T743 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 3523 T743 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 3523 T743 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-controljetty-1362640714998/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1362640712825/control/data/
[junit4:junit4] 2> 3523 T743 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7826f9e5
[junit4:junit4] 2> 3524 T743 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 3524 T743 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1362640712825/control/data forceNew: false
[junit4:junit4] 2> 3525 T743 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1362640712825/control/data/index/
[junit4:junit4] 2> 3525 T743 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1362640712825/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 3525 T743 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1362640712825/control/data/index forceNew: false
[junit4:junit4] 2> 3528 T743 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@edad68c lockFactory=org.apache.lucene.store.NativeFSLockFactory@2b9be953),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 3528 T743 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 3530 T743 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 3530 T743 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 3531 T743 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 3531 T743 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 3531 T743 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 3532 T743 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 3532 T743 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 3532 T743 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 3532 T743 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 3537 T743 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 3541 T743 oass.SolrIndexSearcher.<init> Opening Searcher@41721870 main
[junit4:junit4] 2> 3541 T743 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1362640712825/control/data/tlog
[junit4:junit4] 2> 3542 T743 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 3542 T743 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 3545 T744 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@41721870 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 3546 T743 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 3546 T743 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3547 T725 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d43b735a30003 type:create cxid:0x55 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 4251 T741 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 4252 T741 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:21386_qy",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:21386/qy"}
[junit4:junit4] 2> 4252 T741 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 4279 T741 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 4280 T725 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d43b735a30003 type:create cxid:0x5d zxid:0x2d txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 4346 T740 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 4562 T743 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 4562 T743 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:21386/qy collection:control_collection shard:shard1
[junit4:junit4] 2> 4572 T743 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=10000&maxConnectionsPerHost=20&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 4589 T743 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 4610 T725 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d43b735a30003 type:delete cxid:0x77 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 4611 T743 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 4612 T725 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d43b735a30003 type:create cxid:0x78 zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4622 T743 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 4622 T743 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 4627 T743 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:21386/qy/collection1/
[junit4:junit4] 2> 4628 T743 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 4628 T743 oasc.SyncStrategy.syncToMe http://127.0.0.1:21386/qy/collection1/ has no replicas
[junit4:junit4] 2> 4628 T743 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:21386/qy/collection1/
[junit4:junit4] 2> 4629 T743 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 4636 T725 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d43b735a30003 type:create cxid:0x82 zxid:0x3c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 5853 T741 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 5906 T740 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 5973 T743 oasc.ZkController.register We are http://127.0.0.1:21386/qy/collection1/ and leader is http://127.0.0.1:21386/qy/collection1/
[junit4:junit4] 2> 5973 T743 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:21386/qy
[junit4:junit4] 2> 5973 T743 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 5973 T743 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 5974 T743 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 5991 T743 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 5992 T718 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4:junit4] 2> 5993 T718 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 5993 T718 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 6004 T718 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 6010 T718 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49200/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@5d095e2a
[junit4:junit4] 2> 6011 T718 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 6012 T746 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:49200. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 6012 T746 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:49200, initiating session
[junit4:junit4] 2> 6012 T720 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:58173
[junit4:junit4] 2> 6013 T720 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:58173
[junit4:junit4] 2> 6073 T724 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d43b735a30004 with negotiated timeout 10000 for client /140.211.11.196:58173
[junit4:junit4] 2> 6073 T746 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:49200, sessionid = 0x13d43b735a30004, negotiated timeout = 10000
[junit4:junit4] 2> 6073 T747 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5d095e2a name:ZooKeeperConnection Watcher:127.0.0.1:49200/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 6074 T718 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 6076 T718 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 6081 T718 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 6266 T718 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 6269 T718 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:28845
[junit4:junit4] 2> 6270 T718 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 6270 T718 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 6271 T718 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1362640718899
[junit4:junit4] 2> 6271 T718 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1362640718899/solr.xml
[junit4:junit4] 2> 6272 T718 oasc.CoreContainer.<init> New CoreContainer 919149054
[junit4:junit4] 2> 6272 T718 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1362640718899/'
[junit4:junit4] 2> 6273 T718 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1362640718899/'
[junit4:junit4] 2> 6323 T718 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 6324 T718 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 6324 T718 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 6324 T718 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 6325 T718 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 6325 T718 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 6326 T718 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 6326 T718 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 6326 T718 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 6327 T718 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 6347 T718 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 6367 T718 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:49200/solr
[junit4:junit4] 2> 6367 T718 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 6368 T718 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49200 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@be5214b
[junit4:junit4] 2> 6369 T718 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 6369 T757 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:49200. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 6370 T757 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:49200, initiating session
[junit4:junit4] 2> 6371 T720 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:10925
[junit4:junit4] 2> 6371 T720 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:10925
[junit4:junit4] 2> 6378 T724 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d43b735a30005 with negotiated timeout 20000 for client /140.211.11.196:10925
[junit4:junit4] 2> 6378 T757 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:49200, sessionid = 0x13d43b735a30005, negotiated timeout = 20000
[junit4:junit4] 2> 6378 T758 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@be5214b name:ZooKeeperConnection Watcher:127.0.0.1:49200 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 6379 T718 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 6380 T725 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d43b735a30005
[junit4:junit4] 2> 6396 T758 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 6396 T720 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:10925 which had sessionid 0x13d43b735a30005
[junit4:junit4] 2> 6396 T718 oaz.ZooKeeper.close Session: 0x13d43b735a30005 closed
[junit4:junit4] 2> 6397 T718 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 6407 T718 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49200/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@236352a5
[junit4:junit4] 2> 6408 T718 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 6409 T759 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:49200. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 6409 T759 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:49200, initiating session
[junit4:junit4] 2> 6409 T720 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:30974
[junit4:junit4] 2> 6410 T720 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:30974
[junit4:junit4] 2> 6411 T724 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d43b735a30006 with negotiated timeout 20000 for client /140.211.11.196:30974
[junit4:junit4] 2> 6412 T759 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:49200, sessionid = 0x13d43b735a30006, negotiated timeout = 20000
[junit4:junit4] 2> 6412 T760 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@236352a5 name:ZooKeeperConnection Watcher:127.0.0.1:49200/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 6412 T718 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 6413 T725 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d43b735a30006 type:create cxid:0x1 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 6415 T725 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d43b735a30006 type:create cxid:0x2 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 6424 T718 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 7429 T718 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:28845_qy
[junit4:junit4] 2> 7430 T725 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d43b735a30006 type:delete cxid:0xb zxid:0x4c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:28845_qy Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:28845_qy
[junit4:junit4] 2> 7434 T718 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:28845_qy
[junit4:junit4] 2> 7438 T740 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 7439 T747 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 7439 T760 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 7441 T740 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 7456 T741 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 7459 T741 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:21386_qy",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:21386/qy"}
[junit4:junit4] 2> 7461 T761 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1362640718899/collection1
[junit4:junit4] 2> 7461 T761 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 7462 T761 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 7462 T761 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 7465 T761 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1362640718899/collection1/'
[junit4:junit4] 2> 7466 T761 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1362640718899/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 7467 T761 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1362640718899/collection1/lib/README' to classloader
[junit4:junit4] 2> 7472 T760 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7472 T740 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7472 T747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7516 T761 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 7579 T761 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 7580 T761 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 7596 T761 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 8238 T761 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 8253 T761 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 8257 T761 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 8284 T761 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 8289 T761 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 8295 T761 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 8297 T761 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 8297 T761 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 8298 T761 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 8299 T761 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 8299 T761 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 8300 T761 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty1-1362640718899/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1362640712825/jetty1/
[junit4:junit4] 2> 8300 T761 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7826f9e5
[junit4:junit4] 2> 8301 T761 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 8301 T761 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1362640712825/jetty1 forceNew: false
[junit4:junit4] 2> 8302 T761 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1362640712825/jetty1/index/
[junit4:junit4] 2> 8302 T761 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1362640712825/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 8303 T761 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1362640712825/jetty1/index forceNew: false
[junit4:junit4] 2> 8305 T761 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@61ffb7dd lockFactory=org.apache.lucene.store.NativeFSLockFactory@410624b0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 8305 T761 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 8308 T761 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 8309 T761 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 8309 T761 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 8310 T761 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 8311 T761 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 8311 T761 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 8311 T761 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 8312 T761 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 8312 T761 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 8319 T761 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 8326 T761 oass.SolrIndexSearcher.<init> Opening Searcher@f75527 main
[junit4:junit4] 2> 8326 T761 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1362640712825/jetty1/tlog
[junit4:junit4] 2> 8327 T761 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 8327 T761 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 8332 T762 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@f75527 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 8334 T761 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 8334 T761 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 8980 T741 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8981 T741 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:28845_qy",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:28845/qy"}
[junit4:junit4] 2> 8981 T741 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4] 2> 8981 T741 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 8996 T760 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8996 T740 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8996 T747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9338 T761 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 9338 T761 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:28845/qy collection:collection1 shard:shard1
[junit4:junit4] 2> 9339 T761 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 9360 T725 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d43b735a30006 type:delete cxid:0x48 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 9366 T761 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 9367 T725 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d43b735a30006 type:create cxid:0x49 zxid:0x5d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 9370 T761 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 9371 T761 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 9371 T761 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:28845/qy/collection1/
[junit4:junit4] 2> 9371 T761 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 9371 T761 oasc.SyncStrategy.syncToMe http://127.0.0.1:28845/qy/collection1/ has no replicas
[junit4:junit4] 2> 9372 T761 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:28845/qy/collection1/
[junit4:junit4] 2> 9372 T761 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 9384 T725 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d43b735a30006 type:create cxid:0x53 zxid:0x61 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 10503 T741 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 10523 T760 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 10524 T747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 10524 T740 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 10560 T761 oasc.ZkController.register We are http://127.0.0.1:28845/qy/collection1/ and leader is http://127.0.0.1:28845/qy/collection1/
[junit4:junit4] 2> 10560 T761 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:28845/qy
[junit4:junit4] 2> 10560 T761 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 10560 T761 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 10560 T761 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 10601 T761 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 10603 T718 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4:junit4] 2> 10603 T718 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 10604 T718 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 10806 T718 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 10809 T718 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:44010
[junit4:junit4] 2> 10809 T718 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 10810 T718 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 10810 T718 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1362640723437
[junit4:junit4] 2> 10811 T718 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1362640723437/solr.xml
[junit4:junit4] 2> 10811 T718 oasc.CoreContainer.<init> New CoreContainer 567105986
[junit4:junit4] 2> 10812 T718 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1362640723437/'
[junit4:junit4] 2> 10812 T718 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1362640723437/'
[junit4:junit4] 2> 10862 T718 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 10863 T718 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 10863 T718 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 10864 T718 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 10864 T718 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 10865 T718 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 10865 T718 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 10866 T718 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 10866 T718 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 10866 T718 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 10888 T718 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 10912 T718 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:49200/solr
[junit4:junit4] 2> 10912 T718 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 10913 T718 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49200 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@64db0f23
[junit4:junit4] 2> 10914 T718 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 10914 T773 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:49200. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 10915 T773 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:49200, initiating session
[junit4:junit4] 2> 10916 T720 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:51357
[junit4:junit4] 2> 10916 T720 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:51357
[junit4:junit4] 2> 10955 T724 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d43b735a30007 with negotiated timeout 20000 for client /140.211.11.196:51357
[junit4:junit4] 2> 10955 T773 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:49200, sessionid = 0x13d43b735a30007, negotiated timeout = 20000
[junit4:junit4] 2> 10956 T774 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@64db0f23 name:ZooKeeperConnection Watcher:127.0.0.1:49200 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 10956 T718 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 10958 T725 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d43b735a30007
[junit4:junit4] 2> 10959 T774 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 10959 T720 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:51357 which had sessionid 0x13d43b735a30007
[junit4:junit4] 2> 10959 T718 oaz.ZooKeeper.close Session: 0x13d43b735a30007 closed
[junit4:junit4] 2> 10960 T718 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 10972 T718 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49200/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@639f122d
[junit4:junit4] 2> 10974 T718 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 10974 T775 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:49200. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 10974 T775 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:49200, initiating session
[junit4:junit4] 2> 10975 T720 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:53634
[junit4:junit4] 2> 10975 T720 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:53634
[junit4:junit4] 2> 10998 T724 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d43b735a30008 with negotiated timeout 20000 for client /140.211.11.196:53634
[junit4:junit4] 2> 10998 T775 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:49200, sessionid = 0x13d43b735a30008, negotiated timeout = 20000
[junit4:junit4] 2> 10999 T776 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@639f122d name:ZooKeeperConnection Watcher:127.0.0.1:49200/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 10999 T718 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 11000 T725 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d43b735a30008 type:create cxid:0x1 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 11023 T725 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d43b735a30008 type:create cxid:0x2 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 11026 T718 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 12031 T718 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44010_qy
[junit4:junit4] 2> 12032 T725 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d43b735a30008 type:delete cxid:0xb zxid:0x70 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:44010_qy Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:44010_qy
[junit4:junit4] 2> 12033 T718 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:44010_qy
[junit4:junit4] 2> 12036 T747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 12037 T740 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 12037 T760 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 12038 T776 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 12040 T747 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 12045 T760 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 12045 T740 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 12047 T741 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12048 T741 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:28845_qy",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:28845/qy"}
[junit4:junit4] 2> 12055 T777 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1362640723437/collection1
[junit4:junit4] 2> 12056 T777 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 12057 T747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12057 T776 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12057 T740 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12057 T760 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12057 T777 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 12058 T777 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 12064 T777 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1362640723437/collection1/'
[junit4:junit4] 2> 12066 T777 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1362640723437/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 12067 T777 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1362640723437/collection1/lib/README' to classloader
[junit4:junit4] 2> 12123 T777 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 12184 T777 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 12185 T777 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 12203 T777 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 12843 T777 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 12858 T777 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 12862 T777 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 12887 T777 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 12894 T777 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 12900 T777 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 12902 T777 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 12903 T777 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 12903 T777 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 12905 T777 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 12905 T777 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 12906 T777 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty2-1362640723437/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1362640712825/jetty2/
[junit4:junit4] 2> 12906 T777 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7826f9e5
[junit4:junit4] 2> 12906 T777 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 12907 T777 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1362640712825/jetty2 forceNew: false
[junit4:junit4] 2> 12907 T777 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1362640712825/jetty2/index/
[junit4:junit4] 2> 12908 T777 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1362640712825/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 12908 T777 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1362640712825/jetty2/index forceNew: false
[junit4:junit4] 2> 12911 T777 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@331da5fc lockFactory=org.apache.lucene.store.NativeFSLockFactory@5de59c16),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 12911 T777 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 12914 T777 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 12915 T777 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 12915 T777 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 12916 T777 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 12917 T777 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 12917 T777 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 12917 T777 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 12918 T777 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 12918 T777 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 12925 T777 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 12931 T777 oass.SolrIndexSearcher.<init> Opening Searcher@6c4d7266 main
[junit4:junit4] 2> 12932 T777 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1362640712825/jetty2/tlog
[junit4:junit4] 2> 12933 T777 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 12933 T777 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 12937 T778 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6c4d7266 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 12940 T777 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 12940 T777 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 13569 T741 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13571 T741 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:44010_qy",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:44010/qy"}
[junit4:junit4] 2> 13571 T741 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 13571 T741 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 13586 T747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13586 T776 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13586 T740 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13586 T760 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13943 T777 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 13943 T777 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:44010/qy collection:collection1 shard:shard1
[junit4:junit4] 2> 13948 T777 oasc.ZkController.register We are http://127.0.0.1:44010/qy/collection1/ and leader is http://127.0.0.1:28845/qy/collection1/
[junit4:junit4] 2> 13948 T777 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:44010/qy
[junit4:junit4] 2> 13949 T777 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 13949 T777 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C37 name=collection1 org.apache.solr.core.SolrCore@413ab162 url=http://127.0.0.1:44010/qy/collection1 node=127.0.0.1:44010_qy C37_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:44010_qy, base_url=http://127.0.0.1:44010/qy}
[junit4:junit4] 2> 13956 T779 C37 P44010 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 13956 T777 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13957 T779 C37 P44010 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 13957 T779 C37 P44010 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 13957 T779 C37 P44010 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 13958 T718 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4:junit4] 2> 13959 T718 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 13959 T779 C37 P44010 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 13959 T718 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 14178 T718 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 14181 T718 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:56431
[junit4:junit4] 2> 14181 T718 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 14182 T718 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 14182 T718 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1362640726793
[junit4:junit4] 2> 14183 T718 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1362640726793/solr.xml
[junit4:junit4] 2> 14183 T718 oasc.CoreContainer.<init> New CoreContainer 1933220550
[junit4:junit4] 2> 14184 T718 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1362640726793/'
[junit4:junit4] 2> 14184 T718 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1362640726793/'
[junit4:junit4] 2> 14233 T718 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 14234 T718 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 14234 T718 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 14235 T718 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 14235 T718 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 14236 T718 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 14236 T718 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 14236 T718 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 14237 T718 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 14237 T718 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 14257 T718 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 14276 T718 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:49200/solr
[junit4:junit4] 2> 14276 T718 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 14277 T718 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49200 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@4745874e
[junit4:junit4] 2> 14278 T718 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 14278 T790 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:49200. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 14279 T790 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:49200, initiating session
[junit4:junit4] 2> 14279 T720 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:26365
[junit4:junit4] 2> 14280 T720 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:26365
[junit4:junit4] 2> 14282 T724 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d43b735a30009 with negotiated timeout 20000 for client /140.211.11.196:26365
[junit4:junit4] 2> 14282 T790 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:49200, sessionid = 0x13d43b735a30009, negotiated timeout = 20000
[junit4:junit4] 2> 14282 T791 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4745874e name:ZooKeeperConnection Watcher:127.0.0.1:49200 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 14282 T718 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 14285 T725 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d43b735a30009
[junit4:junit4] 2> 14286 T791 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 14286 T720 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:26365 which had sessionid 0x13d43b735a30009
[junit4:junit4] 2> 14286 T718 oaz.ZooKeeper.close Session: 0x13d43b735a30009 closed
[junit4:junit4] 2> 14287 T718 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 14300 T718 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49200/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@63fba319
[junit4:junit4] 2> 14301 T718 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 14302 T792 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:49200. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 14303 T792 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:49200, initiating session
[junit4:junit4] 2> 14303 T720 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:31590
[junit4:junit4] 2> 14303 T720 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:31590
[junit4:junit4] 2> 14305 T724 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d43b735a3000a with negotiated timeout 20000 for client /140.211.11.196:31590
[junit4:junit4] 2> 14305 T792 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:49200, sessionid = 0x13d43b735a3000a, negotiated timeout = 20000
[junit4:junit4] 2> 14305 T793 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@63fba319 name:ZooKeeperConnection Watcher:127.0.0.1:49200/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 14305 T718 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 14312 T725 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d43b735a3000a type:create cxid:0x1 zxid:0x81 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 14314 T725 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d43b735a3000a type:create cxid:0x2 zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 14317 T718 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 15094 T741 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 15095 T741 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:44010_qy",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:44010/qy"}
[junit4:junit4] 2> 15119 T747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 15119 T760 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 15119 T776 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 15120 T740 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 15119 T793 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 15321 T718 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56431_qy
[junit4:junit4] 2> 15323 T725 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d43b735a3000a type:delete cxid:0xd zxid:0x87 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:56431_qy Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:56431_qy
[junit4:junit4] 2> 15324 T718 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56431_qy
[junit4:junit4] 2> 15327 T747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 15327 T740 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 15327 T776 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 15327 T793 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 15327 T760 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 15329 T747 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 15330 T740 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 15330 T776 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 15330 T760 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 15331 T793 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 15338 T794 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1362640726793/collection1
[junit4:junit4] 2> 15338 T794 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 15339 T794 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 15339 T794 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 15341 T794 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1362640726793/collection1/'
[junit4:junit4] 2> 15342 T794 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1362640726793/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 15343 T794 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1362640726793/collection1/lib/README' to classloader
[junit4:junit4] 2> 15390 T794 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 15448 T794 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 15450 T794 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 15467 T794 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 15986 T750 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:44010_qy_collection1&state=recovering&nodeName=127.0.0.1:44010_qy&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002
[junit4:junit4] 2> 16079 T794 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 16092 T794 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 16096 T794 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 16124 T794 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 16130 T794 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 16135 T794 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 16137 T794 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 16138 T794 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 16138 T794 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 16140 T794 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 16140 T794 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 16140 T794 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty3-1362640726793/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1362640712825/jetty3/
[junit4:junit4] 2> 16140 T794 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7826f9e5
[junit4:junit4] 2> 16141 T794 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 16142 T794 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1362640712825/jetty3 forceNew: false
[junit4:junit4] 2> 16142 T794 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1362640712825/jetty3/index/
[junit4:junit4] 2> 16142 T794 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1362640712825/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 16143 T794 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1362640712825/jetty3/index forceNew: false
[junit4:junit4] 2> 16145 T794 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1847d94f lockFactory=org.apache.lucene.store.NativeFSLockFactory@3e1b17d6),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 16145 T794 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 16148 T794 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 16149 T794 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 16149 T794 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 16150 T794 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 16151 T794 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 16151 T794 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 16151 T794 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 16152 T794 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 16152 T794 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 16159 T794 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 16165 T794 oass.SolrIndexSearcher.<init> Opening Searcher@6e5c74dc main
[junit4:junit4] 2> 16165 T794 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1362640712825/jetty3/tlog
[junit4:junit4] 2> 16166 T794 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 16166 T794 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 16171 T795 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6e5c74dc main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 16173 T794 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 16173 T794 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16627 T741 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16628 T741 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:56431_qy",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56431/qy"}
[junit4:junit4] 2> 16628 T741 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 16629 T741 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 16660 T747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16660 T760 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16660 T740 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16660 T793 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16660 T776 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17179 T794 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 17179 T794 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:56431/qy collection:collection1 shard:shard1
[junit4:junit4] 2> 17185 T794 oasc.ZkController.register We are http://127.0.0.1:56431/qy/collection1/ and leader is http://127.0.0.1:28845/qy/collection1/
[junit4:junit4] 2> 17185 T794 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56431/qy
[junit4:junit4] 2> 17185 T794 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 17185 T794 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C38 name=collection1 org.apache.solr.core.SolrCore@79777070 url=http://127.0.0.1:56431/qy/collection1 node=127.0.0.1:56431_qy C38_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:56431_qy, base_url=http://127.0.0.1:56431/qy}
[junit4:junit4] 2> 17186 T796 C38 P56431 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 17187 T796 C38 P56431 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 17187 T794 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17187 T796 C38 P56431 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 17188 T796 C38 P56431 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 17189 T718 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4:junit4] 2> 17189 T718 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 17189 T796 C38 P56431 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 17189 T718 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 17334 T718 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 17337 T718 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:33640
[junit4:junit4] 2> 17337 T718 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 17338 T718 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 17338 T718 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1362640730021
[junit4:junit4] 2> 17339 T718 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1362640730021/solr.xml
[junit4:junit4] 2> 17339 T718 oasc.CoreContainer.<init> New CoreContainer 1753834316
[junit4:junit4] 2> 17340 T718 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1362640730021/'
[junit4:junit4] 2> 17340 T718 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1362640730021/'
[junit4:junit4] 2> 17390 T718 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 17390 T718 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 17391 T718 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 17391 T718 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 17392 T718 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 17392 T718 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 17392 T718 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 17393 T718 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 17393 T718 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 17394 T718 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 17414 T718 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 17439 T718 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:49200/solr
[junit4:junit4] 2> 17439 T718 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 17440 T718 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49200 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1821dc93
[junit4:junit4] 2> 17441 T718 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 17442 T807 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:49200. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 17442 T807 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:49200, initiating session
[junit4:junit4] 2> 17443 T720 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:62693
[junit4:junit4] 2> 17443 T720 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:62693
[junit4:junit4] 2> 17445 T724 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d43b735a3000b with negotiated timeout 20000 for client /140.211.11.196:62693
[junit4:junit4] 2> 17445 T807 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:49200, sessionid = 0x13d43b735a3000b, negotiated timeout = 20000
[junit4:junit4] 2> 17446 T808 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1821dc93 name:ZooKeeperConnection Watcher:127.0.0.1:49200 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 17446 T718 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 17447 T725 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d43b735a3000b
[junit4:junit4] 2> 17455 T808 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 17455 T720 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:62693 which had sessionid 0x13d43b735a3000b
[junit4:junit4] 2> 17455 T718 oaz.ZooKeeper.close Session: 0x13d43b735a3000b closed
[junit4:junit4] 2> 17456 T718 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 17466 T718 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49200/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@3cad92b8
[junit4:junit4] 2> 17467 T718 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 17467 T809 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:49200. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 17468 T809 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:49200, initiating session
[junit4:junit4] 2> 17468 T720 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:26069
[junit4:junit4] 2> 17468 T720 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:26069
[junit4:junit4] 2> 17469 T724 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d43b735a3000c with negotiated timeout 20000 for client /140.211.11.196:26069
[junit4:junit4] 2> 17470 T809 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:49200, sessionid = 0x13d43b735a3000c, negotiated timeout = 20000
[junit4:junit4] 2> 17470 T810 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3cad92b8 name:ZooKeeperConnection Watcher:127.0.0.1:49200/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 17470 T718 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 17471 T725 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d43b735a3000c type:create cxid:0x1 zxid:0x94 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 17473 T725 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d43b735a3000c type:create cxid:0x2 zxid:0x95 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 17481 T718 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> C37_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:44010_qy, base_url=http://127.0.0.1:44010/qy}
[junit4:junit4] 2> 17988 T779 C37 P44010 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:28845/qy/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 17997 T779 C37 P44010 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4] 2> 18015 T779 C37 P44010 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:44010/qy START replicas=[http://127.0.0.1:28845/qy/collection1/] nUpdates=100
[junit4:junit4] 2> 18025 T779 C37 P44010 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 18026 T779 C37 P44010 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 18026 T779 C37 P44010 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 18026 T779 C37 P44010 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 18026 T779 C37 P44010 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 18027 T779 C37 P44010 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:28845/qy/collection1/. core=collection1
[junit4:junit4] 2> 18027 T779 C37 P44010 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C39 name=collection1 org.apache.solr.core.SolrCore@831a39a url=http://127.0.0.1:28845/qy/collection1 node=127.0.0.1:28845_qy C39_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:28845_qy, base_url=http://127.0.0.1:28845/qy, leader=true}
[junit4:junit4] 2> 18034 T752 C39 P28845 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 18062 T753 C39 P28845 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 18065 T753 C39 P28845 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@61ffb7dd lockFactory=org.apache.lucene.store.NativeFSLockFactory@410624b0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 18066 T753 C39 P28845 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 18066 T753 C39 P28845 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@61ffb7dd lockFactory=org.apache.lucene.store.NativeFSLockFactory@410624b0),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@61ffb7dd lockFactory=org.apache.lucene.store.NativeFSLockFactory@410624b0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 18067 T753 C39 P28845 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 18067 T753 C39 P28845 oass.SolrIndexSearcher.<init> Opening Searcher@49da30e5 realtime
[junit4:junit4] 2> 18068 T753 C39 P28845 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 18068 T753 C39 P28845 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 29
[junit4:junit4] 2> 18069 T779 C37 P44010 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 18069 T779 C37 P44010 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 18072 T754 C39 P28845 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 18072 T754 C39 P28845 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 18073 T779 C37 P44010 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 18073 T779 C37 P44010 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 18073 T779 C37 P44010 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 18075 T754 C39 P28845 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 18076 T779 C37 P44010 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 18077 T779 C37 P44010 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1362640712825/jetty2/index.20130306211850894 forceNew: false
[junit4:junit4] 2> 18077 T779 C37 P44010 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@6c9ebf46 lockFactory=org.apache.lucene.store.NativeFSLockFactory@b95903b) fullCopy=false
[junit4:junit4] 2> 18080 T754 C39 P28845 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 18081 T779 C37 P44010 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 18082 T779 C37 P44010 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 18082 T779 C37 P44010 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 18084 T779 C37 P44010 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@331da5fc lockFactory=org.apache.lucene.store.NativeFSLockFactory@5de59c16),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@331da5fc lockFactory=org.apache.lucene.store.NativeFSLockFactory@5de59c16),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 18084 T779 C37 P44010 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 18085 T779 C37 P44010 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 18085 T779 C37 P44010 oass.SolrIndexSearcher.<init> Opening Searcher@4ed98965 main
[junit4:junit4] 2> 18086 T778 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4ed98965 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 18087 T779 C37 P44010 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(org.apache.lucene.store.RAMDirectory@6c9ebf46 lockFactory=org.apache.lucene.store.NativeFSLockFactory@b95903b)
[junit4:junit4] 2> 18087 T779 C37 P44010 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 18087 T779 C37 P44010 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 18087 T779 C37 P44010 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 18088 T779 C37 P44010 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 18090 T779 C37 P44010 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 18172 T741 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 18173 T741 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:56431_qy",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56431/qy"}
[junit4:junit4] 2> 18203 T741 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:44010_qy",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:44010/qy"}
[junit4:junit4] 2> 18216 T747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18216 T810 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18216 T760 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18216 T793 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18216 T740 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18216 T776 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18486 T718 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33640_qy
[junit4:junit4] 2> 18487 T725 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d43b735a3000c type:delete cxid:0xd zxid:0x9e txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:33640_qy Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:33640_qy
[junit4:junit4] 2> 18488 T718 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:33640_qy
[junit4:junit4] 2> 18491 T747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18491 T793 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18491 T740 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18491 T760 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18491 T776 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18492 T810 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 18493 T810 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 18494 T747 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 18494 T793 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 18494 T740 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 18495 T760 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 18495 T776 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 18502 T813 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1362640730021/collection1
[junit4:junit4] 2> 18502 T813 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 18503 T813 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 18504 T813 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 18505 T813 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1362640730021/collection1/'
[junit4:junit4] 2> 18507 T813 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1362640730021/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 18507 T813 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1362640730021/collection1/lib/README' to classloader
[junit4:junit4] 2> 18556 T813 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 18618 T813 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 18620 T813 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 18635 T813 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 19207 T751 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:56431_qy_collection1&state=recovering&nodeName=127.0.0.1:56431_qy&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002
[junit4:junit4] 2> 19290 T813 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 19304 T813 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 19309 T813 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 19330 T813 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 19334 T813 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 19337 T813 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 19338 T813 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 19339 T813 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 19339 T813 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 19340 T813 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 19340 T813 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 19341 T813 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty4-1362640730021/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1362640712825/jetty4/
[junit4:junit4] 2> 19341 T813 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7826f9e5
[junit4:junit4] 2> 19341 T813 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 19342 T813 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1362640712825/jetty4 forceNew: false
[junit4:junit4] 2> 19342 T813 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1362640712825/jetty4/index/
[junit4:junit4] 2> 19342 T813 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1362640712825/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 19343 T813 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1362640712825/jetty4/index forceNew: false
[junit4:junit4] 2> 19344 T813 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6433aa85 lockFactory=org.apache.lucene.store.NativeFSLockFactory@71a1d30a),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 19345 T813 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 19347 T813 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 19347 T813 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 19347 T813 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 19348 T813 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 19348 T813 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 19348 T813 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 19348 T813 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 19349 T813 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 19349 T813 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 19354 T813 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 19358 T813 oass.SolrIndexSearcher.<init> Opening Searcher@76640885 main
[junit4:junit4] 2> 19358 T813 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.SyncSliceTest-1362640712825/jetty4/tlog
[junit4:junit4] 2> 19359 T813 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 19359 T813 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 19362 T814 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@76640885 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 19364 T813 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 19364 T813 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 19726 T741 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19727 T741 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:33640_qy",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:33640/qy"}
[junit4:junit4] 2> 19728 T741 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 19728 T741 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 19741 T760 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19741 T776 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19741 T793 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19741 T740 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19741 T810 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 19741 T747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 20392 T813 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 20392 T813 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:33640/qy collection:collection1 shard:shard1
[junit4:junit4] 2> 20397 T813 oasc.ZkController.register We are http://127.0.0.1:33640/qy/collection1/ and leader is http://127.0.0.1:28845/qy/collection1/
[junit4:junit4] 2> 20398 T813 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:33640/qy
[junit4:junit4] 2> 20398 T813 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 20398 T813 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C40 name=collection1 org.apache.solr.core.SolrCore@2909423b url=http://127.0.0.1:33640/qy/collection1 node=127.0.0.1:33640_qy C40_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:33640_qy, base_url=http://127.0.0.1:33640/qy}
[junit4:junit4] 2> 20398 T815 C40 P33640 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 20399 T815 C40 P33640 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 20399 T815 C40 P33640 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 20399 T813 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20400 T815 C40 P33640 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 20401 T718 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4:junit4] 2> 20402 T815 C40 P33640 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 20402 T718 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 20402 T718 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 20607 T718 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 20610 T718 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:46617
[junit4:junit4] 2> 20611 T718 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 20611 T718 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 20612 T718 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty5-1362640733240
[junit4:junit4] 2> 20612 T718 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty5-1362640733240/solr.xml
[junit4:junit4] 2> 20613 T718 oasc.CoreContainer.<init> New CoreContainer 163152346
[junit4:junit4] 2> 20613 T718 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty5-1362640733240/'
[junit4:junit4] 2> 20614 T718 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty5-1362640733240/'
[junit4:junit4] 2> 20662 T718 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 20663 T718 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 20663 T718 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 20663 T718 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 20664 T718 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 20664 T718 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 20665 T718 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 20665 T718 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 20666 T718 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 20666 T718 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 20688 T718 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 20706 T718 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:49200/solr
[junit4:junit4] 2> 20707 T718 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 20707 T718 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49200 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@5c921914
[junit4:junit4] 2> 20708 T718 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 20709 T826 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:49200. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 20710 T826 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:49200, initiating session
[junit4:junit4] 2> 20710 T720 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:15344
[junit4:junit4] 2> 20710 T720 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:15344
[junit4:junit4] 2> 20712 T724 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d43b735a3000d with negotiated timeout 20000 for client /140.211.11.196:15344
[junit4:junit4] 2> 20712 T826 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:49200, sessionid = 0x13d43b735a3000d, negotiated timeout = 20000
[junit4:junit4] 2> 20713 T827 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5c921914 name:ZooKeeperConnection Watcher:127.0.0.1:49200 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 20713 T718 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 20715 T725 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d43b735a3000d
[junit4:junit4] 2> 20716 T827 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 20716 T718 oaz.ZooKeeper.close Session: 0x13d43b735a3000d closed
[junit4:junit4] 2> 20716 T720 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:15344 which had sessionid 0x13d43b735a3000d
[junit4:junit4] 2> 20717 T718 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 20729 T718 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:49200/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@16d96b45
[junit4:junit4] 2> 20730 T718 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 20730 T828 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:49200. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 20731 T828 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:49200, initiating session
[junit4:junit4] 2> 20731 T720 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:49623
[junit4:junit4] 2> 20731 T720 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:49623
[junit4:junit4] 2> 20733 T724 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d43b735a3000e with negotiated timeout 20000 for client /140.211.11.196:49623
[junit4:junit4] 2> 20733 T828 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:49200, sessionid = 0x13d43b735a3000e, negotiated timeout = 20000
[junit4:junit4] 2> 20733 T829 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16d96b45 name:ZooKeeperConnection Watcher:127.0.0.1:49200/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 20733 T718 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 20734 T725 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d43b735a3000e type:create cxid:0x1 zxid:0xab txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 20736 T725 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d43b735a3000e type:create cxid:0x2 zxid:0xac txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 20745 T718 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> C38_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:56431_qy, base_url=http://127.0.0.1:56431/qy}
[junit4:junit4] 2> 21209 T796 C38 P56431 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:28845/qy/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 21209 T796 C38 P56431 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:56431/qy START replicas=[http://127.0.0.1:28845/qy/collection1/] nUpdates=100
[junit4:junit4] 2> 21210 T796 C38 P56431 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 21210 T796 C38 P56431 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 21210 T796 C38 P56431 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 21211 T796 C38 P56431 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 21211 T796 C38 P56431 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 21211 T796 C38 P56431 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:28845/qy/collection1/. core=collection1
[junit4:junit4] 2> 21211 T796 C38 P56431 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 21213 T752 C39 P28845 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 21223 T756 C39 P28845 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 21224 T756 C39 P28845 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@61ffb7dd lockFactory=org.apache.lucene.store.NativeFSLockFactory@410624b0),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@61ffb7dd lockFactory=org.apache.lucene.store.NativeFSLockFactory@410624b0),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 21225 T756 C39 P28845 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 21225 T756 C39 P28845 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 21226 T756 C39 P28845 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 3
[junit4:junit4] 2> 21226 T796 C38 P56431 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 21227 T796 C38 P56431 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 21229 T754 C39 P28845 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 21230 T796 C38 P56431 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4] 2> 21230 T796 C38 P56431 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 21230 T796 C38 P56431 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 21232 T754 C39 P28845 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=3&version=2} status=0 QTime=0
[junit4:junit4] 2> 21233 T796 C38 P56431 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 21233 T796 C38 P56431 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-1362640712825/jetty3/index.20130306211854051 forceNew: false
[junit4:junit4] 2> 21234 T796 C38 P56431 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@466668f9 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5399dd2a) fullCopy=false
[junit4:junit4] 2> 21236 T754 C39 P28845 REQ /replication {file=segments_3&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0
[junit4:junit4] 2> 21237 T796 C38 P56431 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 21238 T796 C38 P56431 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 21238 T796 C38 P56431 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 21240 T796 C38 P56431 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1847d94f lockFactory=org.apache.lucene.store.NativeFSLockFactory@3e1b17d6),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1847d94f lockFactory=org.apache.lucene.store.NativeFSLockFactory@3e1b17d6),segFN=segments_3,generation=3,filenames=[segments_3]
[junit4:junit4] 2> 21240 T796 C38 P56431 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[segments_3]
[junit4:junit4] 2> 21240 T796 C38 P56431 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 21241 T796 C38 P56431 oass.SolrIndexSearcher.<init> Opening Searcher@1e7a9a19 main
[junit4:junit4] 2> 21242 T795 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1e7a9a19 main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 21243 T796 C38 P56431 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(org.apache.lucene.store.RAMDirectory@466668f9 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5399dd2a)
[junit4:junit4] 2> 21243 T796 C38 P56431 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 21243 T796 C38 P56431 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 21243 T796 C38 P56431 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 21244 T796 C38 P56431 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 21246 T796 C38 P56431 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 21248 T741 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21249 T741 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:33640_qy",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:33640/qy"}
[junit4:junit4] 2> 21255 T741 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:56431_qy",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:56431/qy"}
[junit4:junit4] 2> 21269 T776 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21269 T793 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21269 T810 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21269 T829 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21270 T740 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21270 T760 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21270 T747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21424 T755 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=127.0.0.1:33640_qy_collection1&state=recovering&nodeName=127.0.0.1:33640_qy&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001
[junit4:junit4] 2> 21750 T718 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46617_qy
[junit4:junit4] 2> 21751 T725 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d43b735a3000e type:delete cxid:0xd zxid:0xb5 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:46617_qy Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:46617_qy
[junit4:junit4] 2> 21752 T718 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:46617_qy
[junit4:junit4] 2> 21755 T776 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21755 T793 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21755 T760 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21755 T740 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21755 T747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 21756 T829 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 21756 T810 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 21756 T829 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 21756 T810 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 21758 T793 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 21758 T760 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 21758 T776 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 21759 T740 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 21760 T747 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 21766 T832 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty5-1362640733240/collection1
[junit4:junit4] 2> 21766 T832 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 21767 T832 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 21767 T832 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 21769 T832 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty5-1362640733240/collection1/'
[junit4:junit4] 2> 21770 T832 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty5-1362640733240/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 21771 T832 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty5-1362640733240/collection1/lib/README' to classloader
[junit4:junit4] 2> 21818 T832 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 21876 T832 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 21877 T832 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 21888 T832 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 22457 T832 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 22466 T832 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 22469 T832 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 22487 T832 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 22490 T832 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 22494 T832 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 22495 T832 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 22495 T832 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 22495 T832 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 22497 T832 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 22497 T832 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 22497 T832 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.SyncSliceTest-jetty5-1362640733240/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1362640712825/jetty5/
[junit4:junit4] 2> 22497 T832 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7826f9e5
[junit4:junit4] 2> 22497 T832 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 22498 T832 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./o
[...truncated too long message...]
:73)
[junit4:junit4] 2> at org.apache.solr.core.SolrCore.close(SolrCore.java:975)
[junit4:junit4] 2> at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:235)
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {range_facet_l=Lucene41(blocksize=128), text=Pulsing41(freqCutoff=1 minBlockSize=28 maxBlockSize=130), _version_=PostingsFormat(name=MockRandom), rnd_b=PostingsFormat(name=TestBloomFilteredLucene41Postings), intDefault=PostingsFormat(name=MockRandom), id=PostingsFormat(name=TestBloomFilteredLucene41Postings), timestamp=Lucene41(blocksize=128), a_t=Lucene41(blocksize=128), range_facet_sl=PostingsFormat(name=TestBloomFilteredLucene41Postings), range_facet_si=Lucene41(blocksize=128), other_tl1=PostingsFormat(name=MockRandom), multiDefault=Lucene41(blocksize=128), a_si=PostingsFormat(name=MockRandom)}, docValues:{timestamp=DocValuesFormat(name=Asserting)}, sim=DefaultSimilarity, locale=sk_SK, timezone=Pacific/Johnston
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Sun Microsystems Inc. 1.6.0_32 (64-bit)/cpus=16,threads=4,free=100762984,total=488964096
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestReversedWildcardFilterFactory, ResourceLoaderTest, TestFastWriter, TestReplicationHandler, AlternateDirectoryTest, OverseerCollectionProcessorTest, TestRealTimeGet, SchemaVersionSpecificBehaviorTest, TestFuzzyAnalyzedSuggestions, DateFieldTest, SimpleFacetsTest, SyncSliceTest]
[junit4:junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=SyncSliceTest -Dtests.seed=C9DF8849654AE2AB -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/hudson/lucene-data/enwiki.random.lines.txt -Dtests.locale=sk_SK -Dtests.timezone=Pacific/Johnston -Dtests.file.encoding=ISO8859-1
[junit4:junit4] ERROR 0.00s J0 | SyncSliceTest (suite) <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: ERROR: SolrIndexSearcher opens=243 closes=242
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([C9DF8849654AE2AB]:0)
[junit4:junit4] > at org.junit.Assert.fail(Assert.java:93)
[junit4:junit4] > at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:246)
[junit4:junit4] > at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:97)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4:junit4] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4:junit4] > at java.lang.reflect.Method.invoke(Method.java:616)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4:junit4] > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
[junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:679)
[junit4:junit4] > Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.SyncSliceTest:
[junit4:junit4] > 1) Thread[id=852, name=searcherExecutor-398-thread-1, state=WAITING, group=TGRP-SyncSliceTest]
[junit4:junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4:junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4:junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4:junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
[junit4:junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
[junit4:junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
[junit4:junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:679)
[junit4:junit4] > 2) Thread[id=1132, name=RecoveryThread, state=TIMED_WAITING, group=TGRP-SyncSliceTest]
[junit4:junit4] > at java.lang.Thread.sleep(Native Method)
[junit4:junit4] > at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:490)
[junit4:junit4] > at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:223)
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([C9DF8849654AE2AB]:0)
[junit4:junit4] > Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4:junit4] > 1) Thread[id=852, name=searcherExecutor-398-thread-1, state=WAITING, group=TGRP-SyncSliceTest]
[junit4:junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4:junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4:junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4:junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:386)
[junit4:junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1043)
[junit4:junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1103)
[junit4:junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:679)
[junit4:junit4] > 2) Thread[id=1132, name=RecoveryThread, state=WAITING, group=TGRP-SyncSliceTest]
[junit4:junit4] > at java.lang.Object.wait(Native Method)
[junit4:junit4] > at java.lang.Thread.join(Thread.java:1203)
[junit4:junit4] > at java.lang.Thread.join(Thread.java:1256)
[junit4:junit4] > at org.apache.solr.update.DefaultSolrCoreState.cancelRecovery(DefaultSolrCoreState.java:250)
[junit4:junit4] > at org.apache.solr.update.DefaultSolrCoreState.close(DefaultSolrCoreState.java:277)
[junit4:junit4] > at org.apache.solr.update.SolrCoreState.decrefSolrCoreState(SolrCoreState.java:73)
[junit4:junit4] > at org.apache.solr.core.SolrCore.close(SolrCore.java:975)
[junit4:junit4] > at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:235)
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([C9DF8849654AE2AB]:0)
[junit4:junit4] Completed on J0 in 740.10s, 1 test, 1 failure, 2 errors <<< FAILURES!
[...truncated 579 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:388: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:361: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:183: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:449: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1213: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:877: There were test failures: 269 suites, 1135 tests, 3 suite-level errors, 753 ignored (3 assumptions)
Total time: 99 minutes 13 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 198 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/198/
1 tests failed.
FAILED: org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch
Error Message:
No registered leader was found, collection:collection1 slice:shard1
Stack Trace:
org.apache.solr.common.SolrException: No registered leader was found, collection:collection1 slice:shard1
at __randomizedtesting.SeedInfo.seed([1D7D918843D72334:9C9B1F9034884308]:0)
at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:430)
at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:295)
at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:116)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:679)
Build Log:
[...truncated 8633 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4] 2> 0 T2942 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 6 T2942 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362565485600
[junit4:junit4] 2> 7 T2942 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 8 T2943 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 10 T2943 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 10 T2943 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 10 T2943 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 10 T2943 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 11 T2943 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 109 T2942 oasc.ZkTestServer.run start zk server on port:52455
[junit4:junit4] 2> 109 T2942 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:52455 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@3303dccc
[junit4:junit4] 2> 110 T2942 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 110 T2948 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:52455. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 111 T2948 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:52455, initiating session
[junit4:junit4] 2> 111 T2944 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:52456
[junit4:junit4] 2> 111 T2944 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:52456
[junit4:junit4] 2> 112 T2946 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 113 T2946 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3f3b54250000 with negotiated timeout 10000 for client /140.211.11.196:52456
[junit4:junit4] 2> 113 T2948 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:52455, sessionid = 0x13d3f3b54250000, negotiated timeout = 10000
[junit4:junit4] 2> 114 T2949 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3303dccc name:ZooKeeperConnection Watcher:127.0.0.1:52455 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 114 T2942 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 114 T2942 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 117 T2947 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d3f3b54250000
[junit4:junit4] 2> 117 T2949 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 117 T2942 oaz.ZooKeeper.close Session: 0x13d3f3b54250000 closed
[junit4:junit4] 2> 118 T2944 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:52456 which had sessionid 0x13d3f3b54250000
[junit4:junit4] 2> 118 T2942 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:52455/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@7ffd4c12
[junit4:junit4] 2> 119 T2942 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 119 T2950 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:52455. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 119 T2950 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:52455, initiating session
[junit4:junit4] 2> 119 T2944 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:52457
[junit4:junit4] 2> 120 T2944 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:52457
[junit4:junit4] 2> 127 T2946 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3f3b54250001 with negotiated timeout 10000 for client /140.211.11.196:52457
[junit4:junit4] 2> 127 T2950 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:52455, sessionid = 0x13d3f3b54250001, negotiated timeout = 10000
[junit4:junit4] 2> 127 T2951 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7ffd4c12 name:ZooKeeperConnection Watcher:127.0.0.1:52455/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 127 T2942 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 128 T2942 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 131 T2942 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 141 T2942 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 143 T2942 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 145 T2942 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 146 T2942 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 156 T2942 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 157 T2942 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 260 T2942 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 261 T2942 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 263 T2942 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 264 T2942 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 274 T2942 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 275 T2942 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 278 T2942 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 278 T2942 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 281 T2942 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 282 T2942 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 285 T2942 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 286 T2942 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 288 T2942 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 289 T2942 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 296 T2947 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d3f3b54250001
[junit4:junit4] 2> 296 T2951 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 296 T2944 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:52457 which had sessionid 0x13d3f3b54250001
[junit4:junit4] 2> 296 T2942 oaz.ZooKeeper.close Session: 0x13d3f3b54250001 closed
[junit4:junit4] 2> 475 T2942 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 482 T2942 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:52458
[junit4:junit4] 2> 482 T2942 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 483 T2942 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 483 T2942 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362565485890
[junit4:junit4] 2> 484 T2942 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362565485890/solr.xml
[junit4:junit4] 2> 484 T2942 oasc.CoreContainer.<init> New CoreContainer 1234348255
[junit4:junit4] 2> 485 T2942 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362565485890/'
[junit4:junit4] 2> 485 T2942 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362565485890/'
[junit4:junit4] 2> 536 T2942 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 537 T2942 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 537 T2942 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 537 T2942 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 538 T2942 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 538 T2942 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 539 T2942 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 539 T2942 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 540 T2942 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 540 T2942 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 559 T2942 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 579 T2942 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:52455/solr
[junit4:junit4] 2> 579 T2942 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 580 T2942 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:52455 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@216af81e
[junit4:junit4] 2> 581 T2942 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 581 T2961 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:52455. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 582 T2961 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:52455, initiating session
[junit4:junit4] 2> 582 T2944 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:52460
[junit4:junit4] 2> 583 T2944 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:52460
[junit4:junit4] 2> 584 T2946 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3f3b54250002 with negotiated timeout 20000 for client /140.211.11.196:52460
[junit4:junit4] 2> 584 T2961 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:52455, sessionid = 0x13d3f3b54250002, negotiated timeout = 20000
[junit4:junit4] 2> 584 T2962 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@216af81e name:ZooKeeperConnection Watcher:127.0.0.1:52455 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 585 T2942 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 586 T2947 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d3f3b54250002
[junit4:junit4] 2> 587 T2962 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 587 T2944 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:52460 which had sessionid 0x13d3f3b54250002
[junit4:junit4] 2> 587 T2942 oaz.ZooKeeper.close Session: 0x13d3f3b54250002 closed
[junit4:junit4] 2> 587 T2942 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 596 T2942 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:52455/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@11b9cdf8
[junit4:junit4] 2> 597 T2942 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 598 T2963 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:52455. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 598 T2963 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:52455, initiating session
[junit4:junit4] 2> 598 T2944 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:52461
[junit4:junit4] 2> 599 T2944 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:52461
[junit4:junit4] 2> 600 T2946 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3f3b54250003 with negotiated timeout 20000 for client /140.211.11.196:52461
[junit4:junit4] 2> 600 T2963 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:52455, sessionid = 0x13d3f3b54250003, negotiated timeout = 20000
[junit4:junit4] 2> 600 T2964 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11b9cdf8 name:ZooKeeperConnection Watcher:127.0.0.1:52455/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 600 T2942 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 602 T2947 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3f3b54250003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 611 T2942 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 613 T2942 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52458_
[junit4:junit4] 2> 614 T2947 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3f3b54250003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:52458_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:52458_
[junit4:junit4] 2> 615 T2942 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52458_
[junit4:junit4] 2> 625 T2942 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 638 T2947 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3f3b54250003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 639 T2942 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 642 T2942 oasc.Overseer.start Overseer (id=89297091664609283-127.0.0.1:52458_-n_0000000000) starting
[junit4:junit4] 2> 643 T2947 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3f3b54250003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 650 T2947 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3f3b54250003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 651 T2947 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3f3b54250003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 653 T2947 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3f3b54250003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 661 T2966 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 662 T2942 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 671 T2942 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 673 T2965 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 677 T2967 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362565485890/collection1
[junit4:junit4] 2> 677 T2967 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 678 T2967 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 678 T2967 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 679 T2967 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362565485890/collection1/'
[junit4:junit4] 2> 681 T2967 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362565485890/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 681 T2967 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362565485890/collection1/lib/README' to classloader
[junit4:junit4] 2> 734 T2967 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 797 T2967 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 898 T2967 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 904 T2967 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 1509 T2967 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1520 T2967 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1524 T2967 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1537 T2967 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1542 T2967 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1546 T2967 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1547 T2967 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1548 T2967 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 1548 T2967 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1549 T2967 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1549 T2967 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 1549 T2967 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362565485890/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/control/data/
[junit4:junit4] 2> 1550 T2967 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1420c906
[junit4:junit4] 2> 1550 T2967 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1551 T2967 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/control/data forceNew:false
[junit4:junit4] 2> 1551 T2967 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/control/data
[junit4:junit4] 2> 1551 T2967 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/control/data/index/
[junit4:junit4] 2> 1552 T2967 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1552 T2967 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/control/data/index forceNew:false
[junit4:junit4] 2> 1556 T2967 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4edb6222 lockFactory=org.apache.lucene.store.NativeFSLockFactory@238e7d5e),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 1556 T2967 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 1557 T2967 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/control/data/index
[junit4:junit4] 2> 1560 T2967 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1560 T2967 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1560 T2967 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1561 T2967 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1561 T2967 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1562 T2967 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1562 T2967 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1562 T2967 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1563 T2967 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1570 T2967 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1576 T2967 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/control/data
[junit4:junit4] 2> 1576 T2967 oass.SolrIndexSearcher.<init> Opening Searcher@5c4c2306 main
[junit4:junit4] 2> 1576 T2967 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/control/data/tlog
[junit4:junit4] 2> 1577 T2967 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1577 T2967 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1580 T2968 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5c4c2306 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1582 T2967 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1582 T2967 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1582 T2947 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3f3b54250003 type:create cxid:0x50 zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 2176 T2965 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2177 T2965 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:52458_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52458"}
[junit4:junit4] 2> 2177 T2965 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 2177 T2965 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 2178 T2947 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3f3b54250003 type:create cxid:0x58 zxid:0x2c txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 2194 T2964 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 2596 T2967 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 2596 T2967 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52458 collection:control_collection shard:shard1
[junit4:junit4] 2> 2597 T2967 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 2612 T2947 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3f3b54250003 type:delete cxid:0x72 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 2613 T2967 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 2614 T2947 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3f3b54250003 type:create cxid:0x73 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2616 T2967 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 2616 T2967 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 2616 T2967 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52458/collection1/
[junit4:junit4] 2> 2616 T2967 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 2616 T2967 oasc.SyncStrategy.syncToMe http://127.0.0.1:52458/collection1/ has no replicas
[junit4:junit4] 2> 2617 T2967 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52458/collection1/
[junit4:junit4] 2> 2617 T2967 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 2620 T2947 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3f3b54250003 type:create cxid:0x7d zxid:0x3b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3697 T2965 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3717 T2964 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3744 T2967 oasc.ZkController.register We are http://127.0.0.1:52458/collection1/ and leader is http://127.0.0.1:52458/collection1/
[junit4:junit4] 2> 3744 T2967 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52458
[junit4:junit4] 2> 3744 T2967 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 3744 T2967 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 3745 T2967 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 3747 T2967 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3748 T2942 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4:junit4] 2> 3748 T2942 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 3749 T2942 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 3764 T2942 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 3765 T2942 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:52455/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@23bfc6b9
[junit4:junit4] 2> 3766 T2942 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 3766 T2970 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:52455. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 3767 T2970 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:52455, initiating session
[junit4:junit4] 2> 3767 T2944 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:52466
[junit4:junit4] 2> 3767 T2944 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:52466
[junit4:junit4] 2> 3768 T2946 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3f3b54250004 with negotiated timeout 10000 for client /140.211.11.196:52466
[junit4:junit4] 2> 3768 T2970 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:52455, sessionid = 0x13d3f3b54250004, negotiated timeout = 10000
[junit4:junit4] 2> 3769 T2971 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@23bfc6b9 name:ZooKeeperConnection Watcher:127.0.0.1:52455/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 3769 T2942 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 3770 T2942 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 3771 T2942 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 3991 T2942 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 3995 T2942 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:52468
[junit4:junit4] 2> 3996 T2942 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 3996 T2942 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 3997 T2942 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362565489365
[junit4:junit4] 2> 3997 T2942 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362565489365/solr.xml
[junit4:junit4] 2> 3997 T2942 oasc.CoreContainer.<init> New CoreContainer 82516167
[junit4:junit4] 2> 3998 T2942 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362565489365/'
[junit4:junit4] 2> 3998 T2942 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362565489365/'
[junit4:junit4] 2> 4053 T2942 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 4054 T2942 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 4054 T2942 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 4055 T2942 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 4055 T2942 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 4056 T2942 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 4056 T2942 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 4057 T2942 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 4057 T2942 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 4058 T2942 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 4076 T2942 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 4094 T2942 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:52455/solr
[junit4:junit4] 2> 4095 T2942 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 4095 T2942 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:52455 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@bef07c1
[junit4:junit4] 2> 4096 T2942 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4097 T2981 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:52455. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 4098 T2981 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:52455, initiating session
[junit4:junit4] 2> 4098 T2944 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:52471
[junit4:junit4] 2> 4098 T2944 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:52471
[junit4:junit4] 2> 4100 T2946 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3f3b54250005 with negotiated timeout 20000 for client /140.211.11.196:52471
[junit4:junit4] 2> 4100 T2981 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:52455, sessionid = 0x13d3f3b54250005, negotiated timeout = 20000
[junit4:junit4] 2> 4100 T2982 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@bef07c1 name:ZooKeeperConnection Watcher:127.0.0.1:52455 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4100 T2942 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4101 T2947 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d3f3b54250005
[junit4:junit4] 2> 4103 T2944 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:52471 which had sessionid 0x13d3f3b54250005
[junit4:junit4] 2> 4103 T2982 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 4103 T2942 oaz.ZooKeeper.close Session: 0x13d3f3b54250005 closed
[junit4:junit4] 2> 4103 T2942 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 4112 T2942 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:52455/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@3c49bbe9
[junit4:junit4] 2> 4113 T2942 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4113 T2983 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:52455. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 4114 T2983 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:52455, initiating session
[junit4:junit4] 2> 4114 T2944 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:52472
[junit4:junit4] 2> 4114 T2944 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:52472
[junit4:junit4] 2> 4116 T2946 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3f3b54250006 with negotiated timeout 20000 for client /140.211.11.196:52472
[junit4:junit4] 2> 4116 T2983 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:52455, sessionid = 0x13d3f3b54250006, negotiated timeout = 20000
[junit4:junit4] 2> 4116 T2984 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3c49bbe9 name:ZooKeeperConnection Watcher:127.0.0.1:52455/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4116 T2942 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4117 T2947 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3f3b54250006 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4118 T2947 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3f3b54250006 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4128 T2942 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 5130 T2942 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52468_
[junit4:junit4] 2> 5131 T2947 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3f3b54250006 type:delete cxid:0x9 zxid:0x4b txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:52468_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:52468_
[junit4:junit4] 2> 5132 T2942 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52468_
[junit4:junit4] 2> 5134 T2964 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 5135 T2971 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5135 T2984 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5136 T2964 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5149 T2985 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362565489365/collection1
[junit4:junit4] 2> 5149 T2985 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 5150 T2985 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 5150 T2985 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 5151 T2985 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362565489365/collection1/'
[junit4:junit4] 2> 5153 T2985 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362565489365/collection1/lib/README' to classloader
[junit4:junit4] 2> 5153 T2985 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362565489365/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 5205 T2985 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 5228 T2965 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 5229 T2965 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:52458_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52458"}
[junit4:junit4] 2> 5239 T2964 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5239 T2971 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5239 T2984 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5273 T2985 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 5374 T2985 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 5380 T2985 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 6027 T2985 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 6038 T2985 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 6043 T2985 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 6055 T2985 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 6060 T2985 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 6064 T2985 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 6065 T2985 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 6065 T2985 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 6066 T2985 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 6066 T2985 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 6067 T2985 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 6067 T2985 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362565489365/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty1/
[junit4:junit4] 2> 6067 T2985 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1420c906
[junit4:junit4] 2> 6068 T2985 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 6068 T2985 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty1 forceNew:false
[junit4:junit4] 2> 6069 T2985 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty1
[junit4:junit4] 2> 6069 T2985 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty1/index/
[junit4:junit4] 2> 6070 T2985 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 6070 T2985 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty1/index forceNew:false
[junit4:junit4] 2> 6072 T2985 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c966792 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6b2d901d),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 6073 T2985 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 6073 T2985 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty1/index
[junit4:junit4] 2> 6075 T2985 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 6076 T2985 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 6076 T2985 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 6077 T2985 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 6077 T2985 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 6078 T2985 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 6078 T2985 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 6078 T2985 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 6079 T2985 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 6086 T2985 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 6091 T2985 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty1
[junit4:junit4] 2> 6092 T2985 oass.SolrIndexSearcher.<init> Opening Searcher@6849a3a9 main
[junit4:junit4] 2> 6092 T2985 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty1/tlog
[junit4:junit4] 2> 6093 T2985 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 6093 T2985 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 6097 T2986 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6849a3a9 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 6099 T2985 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 6099 T2985 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 6743 T2965 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6744 T2965 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:52468_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52468"}
[junit4:junit4] 2> 6744 T2965 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 6745 T2965 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 6756 T2964 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6756 T2971 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6756 T2984 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7101 T2985 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 7101 T2985 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52468 collection:collection1 shard:shard1
[junit4:junit4] 2> 7102 T2985 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 7123 T2947 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3f3b54250006 type:delete cxid:0x46 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 7124 T2985 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 7125 T2947 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3f3b54250006 type:create cxid:0x47 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7133 T2985 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 7133 T2985 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 7133 T2985 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52468/collection1/
[junit4:junit4] 2> 7134 T2985 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 7134 T2985 oasc.SyncStrategy.syncToMe http://127.0.0.1:52468/collection1/ has no replicas
[junit4:junit4] 2> 7134 T2985 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52468/collection1/
[junit4:junit4] 2> 7134 T2985 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 7144 T2947 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3f3b54250006 type:create cxid:0x51 zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8268 T2965 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8386 T2971 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8386 T2984 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8386 T2964 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8428 T2985 oasc.ZkController.register We are http://127.0.0.1:52468/collection1/ and leader is http://127.0.0.1:52468/collection1/
[junit4:junit4] 2> 8428 T2985 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52468
[junit4:junit4] 2> 8428 T2985 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 8428 T2985 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 8429 T2985 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 8430 T2985 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8431 T2942 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4:junit4] 2> 8432 T2942 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 8433 T2942 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 8658 T2942 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 8661 T2942 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:52479
[junit4:junit4] 2> 8662 T2942 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 8662 T2942 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 8663 T2942 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362565494042
[junit4:junit4] 2> 8663 T2942 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362565494042/solr.xml
[junit4:junit4] 2> 8664 T2942 oasc.CoreContainer.<init> New CoreContainer 1621945510
[junit4:junit4] 2> 8664 T2942 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362565494042/'
[junit4:junit4] 2> 8665 T2942 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362565494042/'
[junit4:junit4] 2> 8721 T2942 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 8722 T2942 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 8722 T2942 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 8723 T2942 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 8723 T2942 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 8724 T2942 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 8724 T2942 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 8725 T2942 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 8725 T2942 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 8725 T2942 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 8748 T2942 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 8768 T2942 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:52455/solr
[junit4:junit4] 2> 8769 T2942 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 8769 T2942 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:52455 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@6fe3cf7a
[junit4:junit4] 2> 8770 T2942 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8771 T2997 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:52455. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 8772 T2997 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:52455, initiating session
[junit4:junit4] 2> 8772 T2944 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:52480
[junit4:junit4] 2> 8772 T2944 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:52480
[junit4:junit4] 2> 8774 T2946 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3f3b54250007 with negotiated timeout 20000 for client /140.211.11.196:52480
[junit4:junit4] 2> 8775 T2997 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:52455, sessionid = 0x13d3f3b54250007, negotiated timeout = 20000
[junit4:junit4] 2> 8775 T2998 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6fe3cf7a name:ZooKeeperConnection Watcher:127.0.0.1:52455 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8775 T2942 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8776 T2947 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d3f3b54250007
[junit4:junit4] 2> 8790 T2998 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 8790 T2944 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:52480 which had sessionid 0x13d3f3b54250007
[junit4:junit4] 2> 8790 T2942 oaz.ZooKeeper.close Session: 0x13d3f3b54250007 closed
[junit4:junit4] 2> 8791 T2942 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 8802 T2942 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:52455/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@54865620
[junit4:junit4] 2> 8803 T2942 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8803 T2999 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:52455. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 8804 T2999 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:52455, initiating session
[junit4:junit4] 2> 8804 T2944 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:52481
[junit4:junit4] 2> 8805 T2944 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:52481
[junit4:junit4] 2> 8806 T2946 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3f3b54250008 with negotiated timeout 20000 for client /140.211.11.196:52481
[junit4:junit4] 2> 8806 T2999 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:52455, sessionid = 0x13d3f3b54250008, negotiated timeout = 20000
[junit4:junit4] 2> 8806 T3000 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@54865620 name:ZooKeeperConnection Watcher:127.0.0.1:52455/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8806 T2942 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8807 T2947 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3f3b54250008 type:create cxid:0x1 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8809 T2947 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3f3b54250008 type:create cxid:0x2 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8810 T2942 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 9813 T2942 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52479_
[junit4:junit4] 2> 9814 T2947 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3f3b54250008 type:delete cxid:0x9 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:52479_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:52479_
[junit4:junit4] 2> 9816 T2942 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52479_
[junit4:junit4] 2> 9818 T2984 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9818 T2964 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9818 T3000 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9818 T2971 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9819 T2971 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9819 T2964 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9819 T2984 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9838 T3001 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362565494042/collection1
[junit4:junit4] 2> 9839 T3001 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 9839 T3001 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 9839 T3001 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 9840 T3001 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362565494042/collection1/'
[junit4:junit4] 2> 9841 T3001 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362565494042/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 9841 T3001 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362565494042/collection1/lib/README' to classloader
[junit4:junit4] 2> 9874 T3001 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 9901 T2965 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9902 T2965 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:52468_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52468"}
[junit4:junit4] 2> 9912 T2964 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9912 T2984 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9912 T3000 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9912 T3001 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 9912 T2971 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9914 T3001 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 9918 T3001 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 10339 T3001 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 10352 T3001 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 10355 T3001 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 10365 T3001 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 10368 T3001 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 10371 T3001 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 10372 T3001 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 10374 T3001 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 10374 T3001 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 10375 T3001 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 10375 T3001 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 10375 T3001 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362565494042/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty2/
[junit4:junit4] 2> 10375 T3001 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1420c906
[junit4:junit4] 2> 10376 T3001 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 10376 T3001 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty2 forceNew:false
[junit4:junit4] 2> 10376 T3001 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty2
[junit4:junit4] 2> 10376 T3001 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty2/index/
[junit4:junit4] 2> 10377 T3001 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 10377 T3001 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty2/index forceNew:false
[junit4:junit4] 2> 10379 T3001 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@a8e29a5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@46960613),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 10379 T3001 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 10380 T3001 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty2/index
[junit4:junit4] 2> 10382 T3001 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 10382 T3001 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 10382 T3001 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 10383 T3001 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 10383 T3001 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 10383 T3001 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 10384 T3001 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 10384 T3001 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 10384 T3001 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 10389 T3001 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 10393 T3001 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty2
[junit4:junit4] 2> 10393 T3001 oass.SolrIndexSearcher.<init> Opening Searcher@27a908db main
[junit4:junit4] 2> 10394 T3001 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty2/tlog
[junit4:junit4] 2> 10394 T3001 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 10394 T3001 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 10397 T3002 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@27a908db main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 10398 T3001 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 10399 T3001 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 11416 T2965 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11417 T2965 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:52479_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52479"}
[junit4:junit4] 2> 11417 T2965 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 11417 T2965 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 11422 T3000 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11422 T2964 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11422 T2984 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11422 T2971 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12402 T3001 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 12402 T3001 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52479 collection:collection1 shard:shard2
[junit4:junit4] 2> 12403 T3001 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 12422 T2947 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3f3b54250008 type:delete cxid:0x45 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4] 2> 12423 T3001 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 12423 T2947 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3f3b54250008 type:create cxid:0x46 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12434 T3001 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 12434 T3001 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 12435 T3001 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52479/collection1/
[junit4:junit4] 2> 12435 T3001 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 12435 T3001 oasc.SyncStrategy.syncToMe http://127.0.0.1:52479/collection1/ has no replicas
[junit4:junit4] 2> 12435 T3001 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52479/collection1/
[junit4:junit4] 2> 12435 T3001 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 12438 T2947 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3f3b54250008 type:create cxid:0x4f zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12935 T2965 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 12957 T2971 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12957 T2984 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12957 T3000 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12957 T2964 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13000 T3001 oasc.ZkController.register We are http://127.0.0.1:52479/collection1/ and leader is http://127.0.0.1:52479/collection1/
[junit4:junit4] 2> 13000 T3001 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52479
[junit4:junit4] 2> 13000 T3001 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 13000 T3001 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 13000 T3001 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 13001 T3001 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13002 T2942 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4:junit4] 2> 13003 T2942 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 13003 T2942 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 13204 T2942 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 13208 T2942 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:52488
[junit4:junit4] 2> 13208 T2942 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 13209 T2942 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 13209 T2942 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362565498609
[junit4:junit4] 2> 13210 T2942 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362565498609/solr.xml
[junit4:junit4] 2> 13210 T2942 oasc.CoreContainer.<init> New CoreContainer 632858796
[junit4:junit4] 2> 13211 T2942 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362565498609/'
[junit4:junit4] 2> 13211 T2942 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362565498609/'
[junit4:junit4] 2> 13261 T2942 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 13262 T2942 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 13262 T2942 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 13263 T2942 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 13263 T2942 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 13263 T2942 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 13264 T2942 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 13264 T2942 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 13265 T2942 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 13265 T2942 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 13284 T2942 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 13302 T2942 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:52455/solr
[junit4:junit4] 2> 13303 T2942 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 13303 T2942 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:52455 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@1dcbf91a
[junit4:junit4] 2> 13304 T2942 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 13305 T3013 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:52455. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 13306 T3013 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:52455, initiating session
[junit4:junit4] 2> 13306 T2944 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:52489
[junit4:junit4] 2> 13306 T2944 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:52489
[junit4:junit4] 2> 13308 T2946 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3f3b54250009 with negotiated timeout 20000 for client /140.211.11.196:52489
[junit4:junit4] 2> 13308 T3013 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:52455, sessionid = 0x13d3f3b54250009, negotiated timeout = 20000
[junit4:junit4] 2> 13308 T3014 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1dcbf91a name:ZooKeeperConnection Watcher:127.0.0.1:52455 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 13308 T2942 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 13309 T2947 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d3f3b54250009
[junit4:junit4] 2> 13340 T3014 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 13340 T2944 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:52489 which had sessionid 0x13d3f3b54250009
[junit4:junit4] 2> 13340 T2942 oaz.ZooKeeper.close Session: 0x13d3f3b54250009 closed
[junit4:junit4] 2> 13341 T2942 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 13350 T2942 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:52455/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@3099f67
[junit4:junit4] 2> 13351 T2942 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 13351 T3015 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:52455. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 13352 T3015 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:52455, initiating session
[junit4:junit4] 2> 13352 T2944 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:52490
[junit4:junit4] 2> 13352 T2944 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:52490
[junit4:junit4] 2> 13353 T2946 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3f3b5425000a with negotiated timeout 20000 for client /140.211.11.196:52490
[junit4:junit4] 2> 13353 T3015 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:52455, sessionid = 0x13d3f3b5425000a, negotiated timeout = 20000
[junit4:junit4] 2> 13353 T3016 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3099f67 name:ZooKeeperConnection Watcher:127.0.0.1:52455/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 13354 T2942 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 13354 T2947 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3f3b5425000a type:create cxid:0x1 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 13361 T2947 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3f3b5425000a type:create cxid:0x2 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 13362 T2942 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 14364 T2942 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52488_
[junit4:junit4] 2> 14365 T2947 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3f3b5425000a type:delete cxid:0x9 zxid:0x91 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:52488_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:52488_
[junit4:junit4] 2> 14368 T2942 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52488_
[junit4:junit4] 2> 14370 T2964 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14370 T2984 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14370 T2971 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14371 T3016 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14371 T3000 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14371 T2971 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14371 T3000 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14372 T2964 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14372 T2984 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14386 T3017 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362565498609/collection1
[junit4:junit4] 2> 14387 T3017 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 14387 T3017 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 14387 T3017 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 14389 T3017 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362565498609/collection1/'
[junit4:junit4] 2> 14390 T3017 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362565498609/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 14390 T3017 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362565498609/collection1/lib/README' to classloader
[junit4:junit4] 2> 14437 T3017 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 14462 T2965 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14463 T2965 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:52479_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52479"}
[junit4:junit4] 2> 14475 T2971 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14475 T3016 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14475 T3000 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14475 T2984 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14475 T2964 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14493 T3017 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 14594 T3017 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 14601 T3017 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 15241 T3017 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 15250 T3017 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 15252 T3017 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 15261 T3017 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15264 T3017 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15267 T3017 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15268 T3017 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 15269 T3017 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 15269 T3017 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15269 T3017 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 15270 T3017 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 15270 T3017 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362565498609/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty3/
[junit4:junit4] 2> 15270 T3017 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1420c906
[junit4:junit4] 2> 15270 T3017 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 15271 T3017 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty3 forceNew:false
[junit4:junit4] 2> 15271 T3017 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty3
[junit4:junit4] 2> 15271 T3017 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty3/index/
[junit4:junit4] 2> 15272 T3017 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 15272 T3017 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty3/index forceNew:false
[junit4:junit4] 2> 15274 T3017 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@39c5333 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e1f766e),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 15274 T3017 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 15274 T3017 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty3/index
[junit4:junit4] 2> 15276 T3017 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 15276 T3017 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 15276 T3017 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 15277 T3017 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 15277 T3017 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 15277 T3017 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 15278 T3017 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 15278 T3017 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 15278 T3017 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 15283 T3017 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 15286 T3017 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty3
[junit4:junit4] 2> 15287 T3017 oass.SolrIndexSearcher.<init> Opening Searcher@793630c7 main
[junit4:junit4] 2> 15287 T3017 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty3/tlog
[junit4:junit4] 2> 15287 T3017 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 15288 T3017 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 15290 T3017 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty3
[junit4:junit4] 2> 15292 T3018 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@793630c7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 15292 T3017 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 15293 T3017 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 15979 T2965 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 15980 T2965 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:52488_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52488"}
[junit4:junit4] 2> 15980 T2965 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 15980 T2965 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 16000 T2964 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16000 T2984 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16000 T3000 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16000 T2971 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16000 T3016 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16304 T3017 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 16304 T3017 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52488 collection:collection1 shard:shard1
[junit4:junit4] 2> 16307 T3017 oasc.ZkController.register We are http://127.0.0.1:52488/collection1/ and leader is http://127.0.0.1:52468/collection1/
[junit4:junit4] 2> 16307 T3017 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52488
[junit4:junit4] 2> 16307 T3017 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 16308 T3017 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C123 name=collection1 org.apache.solr.core.SolrCore@42871e10 url=http://127.0.0.1:52488/collection1 node=127.0.0.1:52488_ C123_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:52488_, base_url=http://127.0.0.1:52488}
[junit4:junit4] 2> 16308 T3019 C123 P52488 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 16308 T3017 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16309 T3019 C123 P52488 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 16310 T3019 C123 P52488 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 16310 T3019 C123 P52488 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16310 T2942 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4:junit4] 2> 16311 T3019 C123 P52488 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16311 T2942 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 16312 T2942 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16327 T2942 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16328 T2942 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16338 T2975 oasc.CoreContainer.create Creating SolrCore 'onenodecollectioncore' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362565489365/onenodecollectioncore
[junit4:junit4] 2> 16338 T2975 oasc.ZkController.createCollectionZkNode Check for collection zkNode:onenodecollection
[junit4:junit4] 2> 16339 T2975 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:onenodecollection
[junit4:junit4] 2> 16339 T2975 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 16340 T2975 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 16341 T2975 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection
[junit4:junit4] 2> 16343 T2975 oasc.ZkController.readConfigName Load collection config from:/collections/onenodecollection
[junit4:junit4] 2> 16344 T2975 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362565489365/onenodecollectioncore/'
[junit4:junit4] 2> 16405 T2975 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 16468 T2975 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 16569 T2975 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 16575 T2975 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 17178 T2975 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 17189 T2975 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 17193 T2975 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 17206 T2975 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 17211 T2975 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 17215 T2975 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 17216 T2975 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 17217 T2975 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 17217 T2975 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 17218 T2975 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 17218 T2975 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 17219 T2975 oasc.SolrCore.<init> [onenodecollectioncore] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362565489365/onenodecollectioncore/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362565485600/onenodecollection/
[junit4:junit4] 2> 17219 T2975 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1420c906
[junit4:junit4] 2> 17220 T2975 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 17221 T2975 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362565485600/onenodecollection forceNew:false
[junit4:junit4] 2> 17221 T2975 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362565485600/onenodecollection
[junit4:junit4] 2> 17222 T2975 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362565485600/onenodecollection/index/
[junit4:junit4] 2> 17222 T2975 oasc.SolrCore.initIndex WARNING [onenodecollectioncore] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362565485600/onenodecollection/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 17223 T2975 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362565485600/onenodecollection/index forceNew:false
[junit4:junit4] 2> 17226 T2975 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@24ab29e4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@160adbed),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 17226 T2975 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 17227 T2975 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362565485600/onenodecollection/index
[junit4:junit4] 2> 17229 T2975 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 17229 T2975 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 17230 T2975 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 17231 T2975 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 17231 T2975 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 17231 T2975 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 17232 T2975 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 17232 T2975 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 17233 T2975 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 17240 T2975 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 17246 T2975 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362565485600/onenodecollection
[junit4:junit4] 2> 17246 T2975 oass.SolrIndexSearcher.<init> Opening Searcher@2af0b7e4 main
[junit4:junit4] 2> 17247 T2975 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362565485600/onenodecollection/tlog
[junit4:junit4] 2> 17283 T2975 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 17284 T2975 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 17314 T2975 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362565485600/onenodecollection
[junit4:junit4] 2> 17315 T3021 oasc.SolrCore.registerSearcher [onenodecollectioncore] Registered new searcher Searcher@2af0b7e4 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 17316 T2975 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4] 2> 17516 T2965 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17517 T2965 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:52488_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52488"}
[junit4:junit4] 2> 17521 T2965 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "node_name":"127.0.0.1:52468_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52468"}
[junit4:junit4] 2> 17521 T2965 oasc.Overseer$ClusterStateUpdater.createCollection Create collection onenodecollection with numShards 1
[junit4:junit4] 2> 17521 T2965 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 17534 T2964 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17534 T2971 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17534 T2984 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17534 T3000 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17534 T3016 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18330 T2974 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {coreNodeName=4&state=recovering&nodeName=127.0.0.1:52488_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002
[junit4:junit4] 2> 18516 T2975 oasc.CoreContainer.registerCore registering core: onenodecollectioncore
[junit4:junit4] 2> 18516 T2975 oasc.ZkController.register Register replica - core:onenodecollectioncore address:http://127.0.0.1:52468 collection:onenodecollection shard:shard1
[junit4:junit4] 2> 18517 T2975 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leader_elect/shard1/election
[junit4:junit4] 2> 18532 T2947 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3f3b54250006 type:delete cxid:0x9f zxid:0xac txntype:-1 reqpath:n/a Error Path:/solr/collections/onenodecollection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/onenodecollection/leaders
[junit4:junit4] 2> 18533 T2975 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 18533 T2947 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3f3b54250006 type:create cxid:0xa0 zxid:0xad txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 18544 T2975 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 18544 T2975 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 18545 T2975 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52468/onenodecollectioncore/
[junit4:junit4] 2> 18545 T2975 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 18545 T2975 oasc.SyncStrategy.syncToMe http://127.0.0.1:52468/onenodecollectioncore/ has no replicas
[junit4:junit4] 2> 18546 T2975 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52468/onenodecollectioncore/
[junit4:junit4] 2> 18546 T2975 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leaders/shard1
[junit4:junit4] 2> 18550 T2947 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d3f3b54250006 type:create cxid:0xaa zxid:0xb1 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 19047 T2965 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19070 T2964 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 19070 T2984 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 19070 T2971 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 19070 T3016 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 19070 T3000 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 19113 T2975 oasc.ZkController.register We are http://127.0.0.1:52468/onenodecollectioncore/ and leader is http://127.0.0.1:52468/onenodecollectioncore/
[junit4:junit4] 2> 19113 T2975 oasc.ZkController.register No LogReplay needed for core=onenodecollectioncore baseURL=http://127.0.0.1:52468
[junit4:junit4] 2> 19113 T2975 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 19114 T2975 oasc.ZkController.publish publishing core=onenodecollectioncore state=active
[junit4:junit4] 2> 19115 T2975 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19116 T2975 oass.SolrDispatchFilter.handleAdminRequest /admin/cores {numShards=1&roles=none&name=onenodecollectioncore&action=CREATE&collection=onenodecollection&dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362565485600/onenodecollection&wt=javabin&version=2} status=0 QTime=2778
[junit4:junit4] 2> 19117 T2942 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: onenodecollection failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 19118 T2942 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20119 T2942 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C123_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:52488_, base_url=http://127.0.0.1:52488}
[junit4:junit4] 2> 20332 T3019 C123 P52488 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:52468/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 20332 T3019 C123 P52488 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:52488 START replicas=[http://127.0.0.1:52468/collection1/] nUpdates=100
[junit4:junit4] 2> 20333 T3019 C123 P52488 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 20333 T3019 C123 P52488 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 20333 T3019 C123 P52488 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 20333 T3019 C123 P52488 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 20333 T3019 C123 P52488 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 20334 T3019 C123 P52488 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:52468/collection1/. core=collection1
[junit4:junit4] 2> 20334 T3019 C123 P52488 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C124 name=collection1 org.apache.solr.core.SolrCore@19a585f url=http://127.0.0.1:52468/collection1 node=127.0.0.1:52468_ C124_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:52468_, base_url=http://127.0.0.1:52468, leader=true}
[junit4:junit4] 2> 20340 T2976 C124 P52468 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 20349 T2977 C124 P52468 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 20349 T2977 C124 P52468 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty1
[junit4:junit4] 2> 20351 T2977 C124 P52468 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c966792 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6b2d901d),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 20352 T2977 C124 P52468 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 20353 T2977 C124 P52468 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c966792 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6b2d901d),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c966792 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6b2d901d),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 20353 T2977 C124 P52468 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 20353 T2977 C124 P52468 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty1
[junit4:junit4] 2> 20354 T2977 C124 P52468 oass.SolrIndexSearcher.<init> Opening Searcher@5a5b6afd realtime
[junit4:junit4] 2> 20354 T2977 C124 P52468 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 20355 T2977 C124 P52468 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 20355 T3019 C123 P52488 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 20356 T3019 C123 P52488 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 20357 T2978 C124 P52468 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 20358 T2978 C124 P52468 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 20358 T3019 C123 P52488 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 20358 T3019 C123 P52488 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 20359 T3019 C123 P52488 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 20361 T2978 C124 P52468 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty1
[junit4:junit4] 2> 20361 T2978 C124 P52468 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty1/index
[junit4:junit4] 2> 20362 T2978 C124 P52468 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=1
[junit4:junit4] 2> 20362 T3019 C123 P52488 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 20363 T3019 C123 P52488 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty3/index.20130306062505956 forceNew:false
[junit4:junit4] 2> 20364 T3019 C123 P52488 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty3
[junit4:junit4] 2> 20364 T3019 C123 P52488 oash.SnapPuller.fetchLatestIndex Starting download to BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@7babd0e3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@38198a03) fullCopy=false
[junit4:junit4] 2> 20366 T2978 C124 P52468 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 20367 T3019 C123 P52488 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty3/index
[junit4:junit4] 2> 20367 T3019 C123 P52488 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 20368 T3019 C123 P52488 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty3
[junit4:junit4] 2> 20368 T3019 C123 P52488 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty3
[junit4:junit4] 2> 20368 T3019 C123 P52488 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 20369 T3019 C123 P52488 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 20369 T3019 C123 P52488 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty3
[junit4:junit4] 2> 20370 T3019 C123 P52488 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@39c5333 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e1f766e),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@39c5333 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e1f766e),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 20371 T3019 C123 P52488 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 20371 T3019 C123 P52488 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 20371 T3019 C123 P52488 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty3
[junit4:junit4] 2> 20372 T3019 C123 P52488 oass.SolrIndexSearcher.<init> Opening Searcher@596b2557 main
[junit4:junit4] 2> 20373 T3018 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@596b2557 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 20373 T3018 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty3/index
[junit4:junit4] 2> 20373 T3019 C123 P52488 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files BaseDirectoryWrapper(org.apache.lucene.store.RAMDirectory@7babd0e3 lockFactory=org.apache.lucene.store.NativeFSLockFactory@38198a03)
[junit4:junit4] 2> 20373 T3019 C123 P52488 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty3/index.20130306062505956
[junit4:junit4] 2> 20374 T3019 C123 P52488 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty3/index
[junit4:junit4] 2> 20374 T3019 C123 P52488 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 20374 T3019 C123 P52488 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 20374 T3019 C123 P52488 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 20374 T3019 C123 P52488 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 20379 T3019 C123 P52488 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 20582 T2965 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20583 T2965 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "node_name":"127.0.0.1:52468_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52468"}
[junit4:junit4] 2> 20586 T2965 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:52488_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52488"}
[junit4:junit4] 2> 20598 T2964 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 20598 T2984 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 20599 T3016 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 20599 T2971 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 20599 T3000 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 21121 T2942 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21122 T2942 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: onenodecollection
[junit4:junit4] 2> 21123 T2942 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C125 name=onenodecollectioncore org.apache.solr.core.SolrCore@562bb6f9 url=http://127.0.0.1:52468/onenodecollectioncore node=127.0.0.1:52468_ C125_STATE=coll:onenodecollection core:onenodecollectioncore props:{shard=shard1, roles=none, state=active, core=onenodecollectioncore, collection=onenodecollection, node_name=127.0.0.1:52468_, base_url=http://127.0.0.1:52468, leader=true}
[junit4:junit4] 2> 21142 T2979 C125 P52468 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362565485600/onenodecollection
[junit4:junit4] 2> 21144 T2979 C125 P52468 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@24ab29e4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@160adbed),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 21145 T2979 C125 P52468 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 21147 T2979 C125 P52468 /update {wt=javabin&version=2} {add=[1 (1428753488790159360)]} 0 5
[junit4:junit4] 2> 21153 T2979 C125 P52468 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 21181 T2979 C125 P52468 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@24ab29e4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@160adbed),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@24ab29e4 lockFactory=org.apache.lucene.store.NativeFSLockFactory@160adbed),segFN=segments_2,generation=2,filenames=[_0_Asserting_0.tim, _0_MockRandom_0.tib, _0.fnm, _0_TestBloomFilteredLucene41Postings_0.blm, _0_Disk_0.dvdd, _0_Asserting_0.tip, _0_TestBloomFilteredLucene41Postings_0.tim, _0_TestBloomFilteredLucene41Postings_0.tip, _0.nvm, _0_TestBloomFilteredLucene41Postings_0.pos, _0_Disk_0.dvdm, _0_MockRandom_0.sd, _0_MockRandom_0.tiv, _0_MockRandom_0.doc, _0_MockRandom_0.pos, _0_SimpleText_0.pst, _0.nvd, _0_TestBloomFilteredLucene41Postings_0.doc, segments_2, _0.fdx, _0.si, _0_Asserting_0.pos, _0_Asserting_0.doc, _0.fdt]
[junit4:junit4] 2> 21182 T2979 C125 P52468 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[_0_Asserting_0.tim, _0_MockRandom_0.tib, _0.fnm, _0_TestBloomFilteredLucene41Postings_0.blm, _0_Disk_0.dvdd, _0_Asserting_0.tip, _0_TestBloomFilteredLucene41Postings_0.tim, _0_TestBloomFilteredLucene41Postings_0.tip, _0.nvm, _0_TestBloomFilteredLucene41Postings_0.pos, _0_Disk_0.dvdm, _0_MockRandom_0.sd, _0_MockRandom_0.tiv, _0_MockRandom_0.doc, _0_MockRandom_0.pos, _0_SimpleText_0.pst, _0.nvd, _0_TestBloomFilteredLucene41Postings_0.doc, segments_2, _0.fdx, _0.si, _0_Asserting_0.pos, _0_Asserting_0.doc, _0.fdt]
[junit4:junit4] 2> 21182 T2979 C125 P52468 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362565485600/onenodecollection
[junit4:junit4] 2> 21221 T2979 C125 P52468 oass.SolrIndexSearcher.<init> Opening Searcher@3b0ad99c main
[junit4:junit4] 2> 21222 T2979 C125 P52468 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 21222 T3021 oasc.SolrCore.registerSearcher [onenodecollectioncore] Registered new searcher Searcher@3b0ad99c main{StandardDirectoryReader(segments_2:3 _0(5.0):C1)}
[junit4:junit4] 2> 21223 T3021 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362565485600/onenodecollection/index
[junit4:junit4] 2> 21223 T2979 C125 P52468 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 70
[junit4:junit4] 2> 21227 T2979 C125 P52468 REQ /select {q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=1
[junit4:junit4] 2> 21228 T2942 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 21241 T2979 C125 P52468 REQ /select {q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=0
[junit4:junit4] 2> ASYNC NEW_CORE C126 name=collection1 org.apache.solr.core.SolrCore@4c596efd url=http://127.0.0.1:52458/collection1 node=127.0.0.1:52458_ C126_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:52458_, base_url=http://127.0.0.1:52458, leader=true}
[junit4:junit4] 2> 21249 T2954 C126 P52458 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/control/data
[junit4:junit4] 2> 21251 T2954 C126 P52458 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4edb6222 lockFactory=org.apache.lucene.store.NativeFSLockFactory@238e7d5e),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 21252 T2954 C126 P52458 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 21256 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[1 (1428753488902356992)]} 0 7
[junit4:junit4] 2> C123_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:52488_, base_url=http://127.0.0.1:52488}
[junit4:junit4] 2> 21278 T3006 C123 P52488 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1428753488921231360)]} 0 2
[junit4:junit4] 2> 21279 T2980 C124 P52468 /update {wt=javabin&version=2} {add=[1 (1428753488921231360)]} 0 12
[junit4:junit4] 2> 21282 T2954 C126 P52458 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 21287 T2954 C126 P52458 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4edb6222 lockFactory=org.apache.lucene.store.NativeFSLockFactory@238e7d5e),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4edb6222 lockFactory=org.apache.lucene.store.NativeFSLockFactory@238e7d5e),segFN=segments_2,generation=2,filenames=[_0_Asserting_0.tim, _0_Asserting_0.tip, _0_TestBloomFilteredLucene41Postings_0.tim, _0_TestBloomFilteredLucene41Postings_0.tip, _0_TestBloomFilteredLucene41Postings_0.pos, _0.nvd, _0_SimpleText_0.pst, _0.si, _0_Asserting_0.doc, _0_MockRandom_0.tib, _0.fnm, _0_Disk_0.dvdd, _0_TestBloomFilteredLucene41Postings_0.blm, _0.nvm, _0_Disk_0.dvdm, _0_MockRandom_0.skp, _0_MockRandom_0.sd, _0_MockRandom_0.frq, _0_MockRandom_0.tiv, _0_MockRandom_0.doc, _0_MockRandom_0.pos, segments_2, _0_TestBloomFilteredLucene41Postings_0.doc, _0.fdx, _0_MockRandom_0.pyl, _0_Asserting_0.pos, _0.fdt]
[junit4:junit4] 2> 21288 T2954 C126 P52458 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[_0_Asserting_0.tim, _0_Asserting_0.tip, _0_TestBloomFilteredLucene41Postings_0.tim, _0_TestBloomFilteredLucene41Postings_0.tip, _0_TestBloomFilteredLucene41Postings_0.pos, _0.nvd, _0_SimpleText_0.pst, _0.si, _0_Asserting_0.doc, _0_MockRandom_0.tib, _0.fnm, _0_Disk_0.dvdd, _0_TestBloomFilteredLucene41Postings_0.blm, _0.nvm, _0_Disk_0.dvdm, _0_MockRandom_0.skp, _0_MockRandom_0.sd, _0_MockRandom_0.frq, _0_MockRandom_0.tiv, _0_MockRandom_0.doc, _0_MockRandom_0.pos, segments_2, _0_TestBloomFilteredLucene41Postings_0.doc, _0.fdx, _0_MockRandom_0.pyl, _0_Asserting_0.pos, _0.fdt]
[junit4:junit4] 2> 21288 T2954 C126 P52458 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/control/data
[junit4:junit4] 2> 21291 T2954 C126 P52458 oass.SolrIndexSearcher.<init> Opening Searcher@32bd9676 main
[junit4:junit4] 2> 21291 T2954 C126 P52458 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 21292 T2968 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@32bd9676 main{StandardDirectoryReader(segments_2:3 _0(5.0):C1)}
[junit4:junit4] 2> 21292 T2968 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/control/data/index
[junit4:junit4] 2> 21292 T2954 C126 P52458 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 10
[junit4:junit4] 2> ASYNC NEW_CORE C127 name=collection1 org.apache.solr.core.SolrCore@1f8b90fc url=http://127.0.0.1:52479/collection1 node=127.0.0.1:52479_ C127_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:52479_, base_url=http://127.0.0.1:52479, leader=true}
[junit4:junit4] 2> 21299 T2992 C127 P52479 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 21300 T2992 C127 P52479 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty2
[junit4:junit4] 2> 21302 T2992 C127 P52479 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@a8e29a5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@46960613),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 21303 T2992 C127 P52479 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 21303 T2992 C127 P52479 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@a8e29a5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@46960613),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@a8e29a5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@46960613),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 21304 T2992 C127 P52479 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 21304 T2992 C127 P52479 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty2
[junit4:junit4] 2> 21305 T2992 C127 P52479 oass.SolrIndexSearcher.<init> Opening Searcher@4e9eda00 main
[junit4:junit4] 2> 21305 T2992 C127 P52479 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 21306 T3002 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4e9eda00 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 21306 T3002 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty2/index
[junit4:junit4] 2> 21306 T2992 C127 P52479 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:52468/collection1/, StdNode: http://127.0.0.1:52488/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 21309 T2974 C124 P52468 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 21309 T3007 C123 P52488 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 21315 T3007 C123 P52488 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@39c5333 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e1f766e),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@39c5333 lockFactory=org.apache.lucene.store.NativeFSLockFactory@e1f766e),segFN=segments_3,generation=3,filenames=[_0_Asserting_0.tim, _0_Asserting_0.tip, _0_TestBloomFilteredLucene41Postings_0.tim, _0_TestBloomFilteredLucene41Postings_0.tip, _0_TestBloomFilteredLucene41Postings_0.pos, _0.nvd, _0_SimpleText_0.pst, _0.si, _0_Asserting_0.doc, _0_MockRandom_0.tib, _0.fnm, _0_Disk_0.dvdd, _0_TestBloomFilteredLucene41Postings_0.blm, _0.nvm, _0_Disk_0.dvdm, _0_MockRandom_0.skp, _0_MockRandom_0.sd, _0_MockRandom_0.frq, _0_MockRandom_0.tiv, _0_MockRandom_0.doc, _0_MockRandom_0.pos, _0_TestBloomFilteredLucene41Postings_0.doc, _0.fdx, _0_MockRandom_0.pyl, _0_Asserting_0.pos, _0.fdt, segments_3]
[junit4:junit4] 2> 21316 T3007 C123 P52488 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0_Asserting_0.tim, _0_Asserting_0.tip, _0_TestBloomFilteredLucene41Postings_0.tim, _0_TestBloomFilteredLucene41Postings_0.tip, _0_TestBloomFilteredLucene41Postings_0.pos, _0.nvd, _0_SimpleText_0.pst, _0.si, _0_Asserting_0.doc, _0_MockRandom_0.tib, _0.fnm, _0_Disk_0.dvdd, _0_TestBloomFilteredLucene41Postings_0.blm, _0.nvm, _0_Disk_0.dvdm, _0_MockRandom_0.skp, _0_MockRandom_0.sd, _0_MockRandom_0.frq, _0_MockRandom_0.tiv, _0_MockRandom_0.doc, _0_MockRandom_0.pos, _0_TestBloomFilteredLucene41Postings_0.doc, _0.fdx, _0_MockRandom_0.pyl, _0_Asserting_0.pos, _0.fdt, segments_3]
[junit4:junit4] 2> 21316 T3007 C123 P52488 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty3
[junit4:junit4] 2> 21318 T3007 C123 P52488 oass.SolrIndexSearcher.<init> Opening Searcher@671a823a main
[junit4:junit4] 2> 21319 T3007 C123 P52488 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 21319 T3018 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@671a823a main{StandardDirectoryReader(segments_3:3:nrt _0(5.0):C1)}
[junit4:junit4] 2> 21319 T3018 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty3/index
[junit4:junit4] 2> 21320 T3007 C123 P52488 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 11
[junit4:junit4] 2> 21344 T2974 C124 P52468 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c966792 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6b2d901d),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4c966792 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6b2d901d),segFN=segments_3,generation=3,filenames=[_0_Asserting_0.tim, _0_Asserting_0.tip, _0_TestBloomFilteredLucene41Postings_0.tim, _0_TestBloomFilteredLucene41Postings_0.tip, _0_TestBloomFilteredLucene41Postings_0.pos, _0.nvd, _0_SimpleText_0.pst, _0.si, _0_Asserting_0.doc, _0.fnm, _0_TestBloomFilteredLucene41Postings_0.blm, _0_Disk_0.dvdd, _0.nvm, _0_Disk_0.dvdm, _0_MockRandom_0.skp, _0_MockRandom_0.sd, _0_MockRandom_0.frq, _0_MockRandom_0.tip, _0_MockRandom_0.doc, _0_MockRandom_0.pos, _0_TestBloomFilteredLucene41Postings_0.doc, _0.fdx, _0_Asserting_0.pos, _0_MockRandom_0.pyl, _0_MockRandom_0.tim, _0.fdt, segments_3]
[junit4:junit4] 2> 21345 T2974 C124 P52468 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0_Asserting_0.tim, _0_Asserting_0.tip, _0_TestBloomFilteredLucene41Postings_0.tim, _0_TestBloomFilteredLucene41Postings_0.tip, _0_TestBloomFilteredLucene41Postings_0.pos, _0.nvd, _0_SimpleText_0.pst, _0.si, _0_Asserting_0.doc, _0.fnm, _0_TestBloomFilteredLucene41Postings_0.blm, _0_Disk_0.dvdd, _0.nvm, _0_Disk_0.dvdm, _0_MockRandom_0.skp, _0_MockRandom_0.sd, _0_MockRandom_0.frq, _0_MockRandom_0.tip, _0_MockRandom_0.doc, _0_MockRandom_0.pos, _0_TestBloomFilteredLucene41Postings_0.doc, _0.fdx, _0_Asserting_0.pos, _0_MockRandom_0.pyl, _0_MockRandom_0.tim, _0.fdt, segments_3]
[junit4:junit4] 2> 21345 T2974 C124 P52468 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty1
[junit4:junit4] 2> 21347 T2974 C124 P52468 oass.SolrIndexSearcher.<init> Opening Searcher@5fe1ce48 main
[junit4:junit4] 2> 21347 T2974 C124 P52468 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty1/index
[junit4:junit4] 2> 21348 T2974 C124 P52468 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 21348 T2986 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5fe1ce48 main{StandardDirectoryReader(segments_3:3:nrt _0(5.0):C1)}
[junit4:junit4] 2> 21349 T2986 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty1/index
[junit4:junit4] 2> 21349 T2974 C124 P52468 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 40
[junit4:junit4] 2> 21350 T2992 C127 P52479 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 51
[junit4:junit4] 2> 21351 T2942 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 21352 T2942 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21352 T2942 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> 21356 T2954 C126 P52458 REQ /select {q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=1
[junit4:junit4] 2> 21356 T2942 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:52455/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@61ae0a25
[junit4:junit4] 2> 21357 T2942 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 21358 T3028 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:52455. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 21358 T3028 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:52455, initiating session
[junit4:junit4] 2> 21358 T2944 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:52537
[junit4:junit4] 2> 21359 T2944 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:52537
[junit4:junit4] 2> 21360 T2946 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d3f3b5425000b with negotiated timeout 10000 for client /140.211.11.196:52537
[junit4:junit4] 2> 21360 T3028 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:52455, sessionid = 0x13d3f3b5425000b, negotiated timeout = 10000
[junit4:junit4] 2> 21360 T3029 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@61ae0a25 name:ZooKeeperConnection Watcher:127.0.0.1:52455/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 21361 T2942 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 21361 T2942 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 21363 T2947 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d3f3b5425000b
[junit4:junit4] 2> 21365 T3029 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 21365 T2944 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:52537 which had sessionid 0x13d3f3b5425000b
[junit4:junit4] 2> 21365 T2942 oaz.ZooKeeper.close Session: 0x13d3f3b5425000b closed
[junit4:junit4] 2> 21367 T2977 C124 P52468 REQ /select {q=*:*&distrib=false&wt=javabin&version=2} hits=1 status=0 QTime=0
[junit4:junit4] 2> 21369 T2993 C127 P52479 REQ /select {q=*:*&distrib=false&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4:junit4] 2> 21375 T2994 C127 P52479 REQ /select {NOW=1362565506965&shard.url=127.0.0.1:52479/collection1/&fl=id,score&start=0&q=*:*&distrib=false&wt=javabin&isShard=true&fsv=true&version=2&rows=10} hits=0 status=0 QTime=0
[junit4:junit4] 2> 21375 T3032 C124 P52468 REQ /select {NOW=1362565506965&shard.url=127.0.0.1:52468/collection1/|127.0.0.1:52488/collection1/&fl=id,score&start=0&q=*:*&distrib=false&wt=javabin&isShard=true&fsv=true&version=2&rows=10} hits=1 status=0 QTime=0
[junit4:junit4] 2> 21383 T3032 C124 P52468 REQ /select {NOW=1362565506965&shard.url=127.0.0.1:52468/collection1/|127.0.0.1:52488/collection1/&ids=1&q=*:*&distrib=false&wt=javabin&isShard=true&version=2} status=0 QTime=5
[junit4:junit4] 2> 21383 T2992 C127 P52479 REQ /select {q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=11
[junit4:junit4] 2> 21388 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[2 (1428753489046011904)]} 0 2
[junit4:junit4] 2> 21395 T2995 C127 P52479 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[2 (1428753489053351936)]} 0 3
[junit4:junit4] 2> 21395 T2980 C124 P52468 /update {wt=javabin&version=2} {add=[2]} 0 4
[junit4:junit4] 2> 21399 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[3 (1428753489058594816)]} 0 1
[junit4:junit4] 2> 21405 T2995 C127 P52479 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[3 (1428753489064886272)]} 0 1
[junit4:junit4] 2> 21406 T2980 C124 P52468 /update {wt=javabin&version=2} {add=[3]} 0 4
[junit4:junit4] 2> 21410 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[4 (1428753489070129152)]} 0 1
[junit4:junit4] 2> 21432 T3006 C123 P52488 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[4 (1428753489076420608)]} 0 3
[junit4:junit4] 2> 21433 T2974 C124 P52468 /update {distrib.from=http://127.0.0.1:52479/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[4 (1428753489076420608)]} 0 18
[junit4:junit4] 2> 21433 T2992 C127 P52479 /update {wt=javabin&version=2} {add=[4]} 0 20
[junit4:junit4] 2> 21437 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[5 (1428753489098440704)]} 0 1
[junit4:junit4] 2> 21442 T2992 C127 P52479 /update {wt=javabin&version=2} {add=[5 (1428753489102635008)]} 0 2
[junit4:junit4] 2> 21448 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[6 (1428753489107877888)]} 0 3
[junit4:junit4] 2> 21453 T2995 C127 P52479 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[6 (1428753489115217920)]} 0 1
[junit4:junit4] 2> 21454 T2980 C124 P52468 /update {wt=javabin&version=2} {add=[6]} 0 4
[junit4:junit4] 2> 21458 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[7 (1428753489120460800)]} 0 1
[junit4:junit4] 2> 21462 T2992 C127 P52479 /update {wt=javabin&version=2} {add=[7 (1428753489124655104)]} 0 1
[junit4:junit4] 2> 21466 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[8 (1428753489128849408)]} 0 1
[junit4:junit4] 2> 21473 T3006 C123 P52488 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[8 (1428753489133043712)]} 0 1
[junit4:junit4] 2> 21474 T2980 C124 P52468 /update {wt=javabin&version=2} {add=[8 (1428753489133043712)]} 0 5
[junit4:junit4] 2> 21478 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[9 (1428753489141432320)]} 0 1
[junit4:junit4] 2> 21483 T2992 C127 P52479 /update {wt=javabin&version=2} {add=[9 (1428753489145626624)]} 0 2
[junit4:junit4] 2> 21487 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[10 (1428753489150869504)]} 0 1
[junit4:junit4] 2> 21494 T3006 C123 P52488 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10 (1428753489155063808)]} 0 1
[junit4:junit4] 2> 21495 T2980 C124 P52468 /update {wt=javabin&version=2} {add=[10 (1428753489155063808)]} 0 5
[junit4:junit4] 2> 21499 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[11 (1428753489163452416)]} 0 1
[junit4:junit4] 2> 21506 T3006 C123 P52488 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[11 (1428753489167646720)]} 0 1
[junit4:junit4] 2> 21507 T2980 C124 P52468 /update {wt=javabin&version=2} {add=[11 (1428753489167646720)]} 0 5
[junit4:junit4] 2> 21511 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[12 (1428753489176035328)]} 0 1
[junit4:junit4] 2> 21520 T3006 C123 P52488 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[12 (1428753489182326784)]} 0 1
[junit4:junit4] 2> 21521 T2974 C124 P52468 /update {distrib.from=http://127.0.0.1:52479/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[12 (1428753489182326784)]} 0 5
[junit4:junit4] 2> 21521 T2992 C127 P52479 /update {wt=javabin&version=2} {add=[12]} 0 7
[junit4:junit4] 2> 21525 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[13 (1428753489190715392)]} 0 1
[junit4:junit4] 2> 21532 T3006 C123 P52488 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[13 (1428753489194909696)]} 0 1
[junit4:junit4] 2> 21533 T2980 C124 P52468 /update {wt=javabin&version=2} {add=[13 (1428753489194909696)]} 0 5
[junit4:junit4] 2> 21536 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[14 (1428753489202249728)]} 0 1
[junit4:junit4] 2> 21545 T3006 C123 P52488 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[14 (1428753489208541184)]} 0 1
[junit4:junit4] 2> 21546 T2974 C124 P52468 /update {distrib.from=http://127.0.0.1:52479/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[14 (1428753489208541184)]} 0 5
[junit4:junit4] 2> 21546 T2992 C127 P52479 /update {wt=javabin&version=2} {add=[14]} 0 7
[junit4:junit4] 2> 21550 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[15 (1428753489216929792)]} 0 1
[junit4:junit4] 2> 21557 T3006 C123 P52488 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[15 (1428753489221124096)]} 0 1
[junit4:junit4] 2> 21558 T2980 C124 P52468 /update {wt=javabin&version=2} {add=[15 (1428753489221124096)]} 0 5
[junit4:junit4] 2> 21561 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[16 (1428753489228464128)]} 0 1
[junit4:junit4] 2> 21570 T3006 C123 P52488 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[16 (1428753489234755584)]} 0 1
[junit4:junit4] 2> 21571 T2974 C124 P52468 /update {distrib.from=http://127.0.0.1:52479/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[16 (1428753489234755584)]} 0 5
[junit4:junit4] 2> 21571 T2992 C127 P52479 /update {wt=javabin&version=2} {add=[16]} 0 7
[junit4:junit4] 2> 21577 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[17 (1428753489243144192)]} 0 3
[junit4:junit4] 2> 21585 T2995 C127 P52479 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[17 (1428753489251532800)]} 0 3
[junit4:junit4] 2> 21585 T2980 C124 P52468 /update {wt=javabin&version=2} {add=[17]} 0 6
[junit4:junit4] 2> 21589 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[100 (1428753489257824256)]} 0 1
[junit4:junit4] 2> 21598 T3006 C123 P52488 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[100 (1428753489264115712)]} 0 1
[junit4:junit4] 2> 21599 T2974 C124 P52468 /update {distrib.from=http://127.0.0.1:52479/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[100 (1428753489264115712)]} 0 5
[junit4:junit4] 2> 21599 T2992 C127 P52479 /update {wt=javabin&version=2} {add=[100]} 0 7
[junit4:junit4] 2> 21603 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[101 (1428753489272504320)]} 0 1
[junit4:junit4] 2> 21610 T3006 C123 P52488 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[101 (1428753489276698624)]} 0 1
[junit4:junit4] 2> 21611 T2980 C124 P52468 /update {wt=javabin&version=2} {add=[101 (1428753489276698624)]} 0 5
[junit4:junit4] 2> 21614 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[102 (1428753489284038656)]} 0 1
[junit4:junit4] 2> 21631 T3006 C123 P52488 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[102 (1428753489297670144)]} 0 1
[junit4:junit4] 2> 21632 T2974 C124 P52468 /update {distrib.from=http://127.0.0.1:52479/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[102 (1428753489297670144)]} 0 6
[junit4:junit4] 2> 21632 T2992 C127 P52479 /update {wt=javabin&version=2} {add=[102]} 0 9
[junit4:junit4] 2> 21636 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[103 (1428753489307107328)]} 0 1
[junit4:junit4] 2> 21642 T2995 C127 P52479 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[103 (1428753489313398784)]} 0 1
[junit4:junit4] 2> 21643 T2980 C124 P52468 /update {wt=javabin&version=2} {add=[103]} 0 4
[junit4:junit4] 2> 21646 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[104 (1428753489317593088)]} 0 1
[junit4:junit4] 2> 21653 T2995 C127 P52479 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[104 (1428753489324933120)]} 0 1
[junit4:junit4] 2> 21654 T2980 C124 P52468 /update {wt=javabin&version=2} {add=[104]} 0 5
[junit4:junit4] 2> 21657 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[105 (1428753489329127424)]} 0 1
[junit4:junit4] 2> 21661 T2992 C127 P52479 /update {wt=javabin&version=2} {add=[105 (1428753489333321728)]} 0 1
[junit4:junit4] 2> 21665 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[106 (1428753489337516032)]} 0 1
[junit4:junit4] 2> 21671 T2995 C127 P52479 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[106 (1428753489343807488)]} 0 1
[junit4:junit4] 2> 21672 T2980 C124 P52468 /update {wt=javabin&version=2} {add=[106]} 0 4
[junit4:junit4] 2> 21676 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[107 (1428753489349050368)]} 0 1
[junit4:junit4] 2> 21683 T3006 C123 P52488 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[107 (1428753489353244672)]} 0 1
[junit4:junit4] 2> 21684 T2980 C124 P52468 /update {wt=javabin&version=2} {add=[107 (1428753489353244672)]} 0 5
[junit4:junit4] 2> 21688 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[108 (1428753489361633280)]} 0 1
[junit4:junit4] 2> 21695 T3006 C123 P52488 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[108 (1428753489365827584)]} 0 1
[junit4:junit4] 2> 21696 T2980 C124 P52468 /update {wt=javabin&version=2} {add=[108 (1428753489365827584)]} 0 5
[junit4:junit4] 2> 21700 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[109 (1428753489374216192)]} 0 1
[junit4:junit4] 2> 21709 T3006 C123 P52488 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[109 (1428753489380507648)]} 0 1
[junit4:junit4] 2> 21710 T2974 C124 P52468 /update {distrib.from=http://127.0.0.1:52479/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[109 (1428753489380507648)]} 0 5
[junit4:junit4] 2> 21710 T2992 C127 P52479 /update {wt=javabin&version=2} {add=[109]} 0 7
[junit4:junit4] 2> 21714 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[110 (1428753489388896256)]} 0 1
[junit4:junit4] 2> 21723 T3006 C123 P52488 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[110 (1428753489395187712)]} 0 1
[junit4:junit4] 2> 21724 T2974 C124 P52468 /update {distrib.from=http://127.0.0.1:52479/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[110 (1428753489395187712)]} 0 5
[junit4:junit4] 2> 21724 T2992 C127 P52479 /update {wt=javabin&version=2} {add=[110]} 0 7
[junit4:junit4] 2> 21728 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[111 (1428753489403576320)]} 0 1
[junit4:junit4] 2> 21737 T3006 C123 P52488 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[111 (1428753489409867776)]} 0 1
[junit4:junit4] 2> 21738 T2974 C124 P52468 /update {distrib.from=http://127.0.0.1:52479/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[111 (1428753489409867776)]} 0 5
[junit4:junit4] 2> 21738 T2992 C127 P52479 /update {wt=javabin&version=2} {add=[111]} 0 7
[junit4:junit4] 2> 21742 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[112 (1428753489418256384)]} 0 1
[junit4:junit4] 2> 21746 T2992 C127 P52479 /update {wt=javabin&version=2} {add=[112 (1428753489422450688)]} 0 1
[junit4:junit4] 2> 21750 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[113 (1428753489426644992)]} 0 1
[junit4:junit4] 2> 21759 T3006 C123 P52488 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[113 (1428753489432936448)]} 0 1
[junit4:junit4] 2> 21760 T2974 C124 P52468 /update {distrib.from=http://127.0.0.1:52479/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[113 (1428753489432936448)]} 0 5
[junit4:junit4] 2> 21760 T2992 C127 P52479 /update {wt=javabin&version=2} {add=[113]} 0 7
[junit4:junit4] 2> 21764 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[114 (1428753489441325056)]} 0 1
[junit4:junit4] 2> 21771 T3006 C123 P52488 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[114 (1428753489445519360)]} 0 1
[junit4:junit4] 2> 21772 T2980 C124 P52468 /update {wt=javabin&version=2} {add=[114 (1428753489445519360)]} 0 5
[junit4:junit4] 2> 21775 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[115 (1428753489452859392)]} 0 1
[junit4:junit4] 2> 21781 T2995 C127 P52479 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[115 (1428753489459150848)]} 0 1
[junit4:junit4] 2> 21781 T2980 C124 P52468 /update {wt=javabin&version=2} {add=[115]} 0 3
[junit4:junit4] 2> 21785 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[116 (1428753489463345152)]} 0 1
[junit4:junit4] 2> 21791 T2995 C127 P52479 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[116 (1428753489469636608)]} 0 1
[junit4:junit4] 2> 21791 T2980 C124 P52468 /update {wt=javabin&version=2} {add=[116]} 0 3
[junit4:junit4] 2> 21795 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[117 (1428753489473830912)]} 0 1
[junit4:junit4] 2> 21801 T2995 C127 P52479 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[117 (1428753489480122368)]} 0 1
[junit4:junit4] 2> 21801 T2980 C124 P52468 /update {wt=javabin&version=2} {add=[117]} 0 3
[junit4:junit4] 2> 21805 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[118 (1428753489484316672)]} 0 1
[junit4:junit4] 2> 21812 T3006 C123 P52488 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[118 (1428753489488510976)]} 0 1
[junit4:junit4] 2> 21812 T2980 C124 P52468 /update {wt=javabin&version=2} {add=[118 (1428753489488510976)]} 0 4
[junit4:junit4] 2> 21816 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[119 (1428753489495851008)]} 0 1
[junit4:junit4] 2> 21821 T2995 C127 P52479 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[119 (1428753489501093888)]} 0 1
[junit4:junit4] 2> 21821 T2980 C124 P52468 /update {wt=javabin&version=2} {add=[119]} 0 3
[junit4:junit4] 2> 21825 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[120 (1428753489505288192)]} 0 1
[junit4:junit4] 2> 21829 T2992 C127 P52479 /update {wt=javabin&version=2} {add=[120 (1428753489509482496)]} 0 1
[junit4:junit4] 2> 21833 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[121 (1428753489513676800)]} 0 1
[junit4:junit4] 2> 21837 T2992 C127 P52479 /update {wt=javabin&version=2} {add=[121 (1428753489517871104)]} 0 1
[junit4:junit4] 2> 21841 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[122 (1428753489522065408)]} 0 1
[junit4:junit4] 2> 21850 T3006 C123 P52488 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[122 (1428753489528356864)]} 0 1
[junit4:junit4] 2> 21850 T2974 C124 P52468 /update {distrib.from=http://127.0.0.1:52479/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[122 (1428753489528356864)]} 0 4
[junit4:junit4] 2> 21851 T2992 C127 P52479 /update {wt=javabin&version=2} {add=[122]} 0 7
[junit4:junit4] 2> 21855 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[123 (1428753489536745472)]} 0 1
[junit4:junit4] 2> 21864 T3006 C123 P52488 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[123 (1428753489543036928)]} 0 1
[junit4:junit4] 2> 21865 T2974 C124 P52468 /update {distrib.from=http://127.0.0.1:52479/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[123 (1428753489543036928)]} 0 5
[junit4:junit4] 2> 21865 T2992 C127 P52479 /update {wt=javabin&version=2} {add=[123]} 0 7
[junit4:junit4] 2> 21869 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[124 (1428753489551425536)]} 0 1
[junit4:junit4] 2> 21878 T3006 C123 P52488 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[124 (1428753489557716992)]} 0 1
[junit4:junit4] 2> 21879 T2974 C124 P52468 /update {distrib.from=http://127.0.0.1:52479/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[124 (1428753489557716992)]} 0 5
[junit4:junit4] 2> 21879 T2992 C127 P52479 /update {wt=javabin&version=2} {add=[124]} 0 7
[junit4:junit4] 2> 21883 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[125 (1428753489566105600)]} 0 1
[junit4:junit4] 2> 21889 T3006 C123 P52488 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[125 (1428753489569251328)]} 0 1
[junit4:junit4] 2> 21890 T2980 C124 P52468 /update {wt=javabin&version=2} {add=[125 (1428753489569251328)]} 0 5
[junit4:junit4] 2> 21893 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[126 (1428753489576591360)]} 0 1
[junit4:junit4] 2> 21898 T2995 C127 P52479 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[126 (1428753489581834240)]} 0 1
[junit4:junit4] 2> 21899 T2980 C124 P52468 /update {wt=javabin&version=2} {add=[126]} 0 4
[junit4:junit4] 2> 21902 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[127 (1428753489586028544)]} 0 1
[junit4:junit4] 2> 21906 T2992 C127 P52479 /update {wt=javabin&version=2} {add=[127 (1428753489590222848)]} 0 1
[junit4:junit4] 2> 21910 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[128 (1428753489594417152)]} 0 1
[junit4:junit4] 2> 21913 T2992 C127 P52479 /update {wt=javabin&version=2} {add=[128 (1428753489597562880)]} 0 1
[junit4:junit4] 2> 21917 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[129 (1428753489601757184)]} 0 1
[junit4:junit4] 2> 21924 T3006 C123 P52488 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[129 (1428753489605951488)]} 0 1
[junit4:junit4] 2> 21924 T2980 C124 P52468 /update {wt=javabin&version=2} {add=[129 (1428753489605951488)]} 0 4
[junit4:junit4] 2> 21928 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[130 (1428753489613291520)]} 0 1
[junit4:junit4] 2> 21934 T2995 C127 P52479 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[130 (1428753489619582976)]} 0 1
[junit4:junit4] 2> 21934 T2980 C124 P52468 /update {wt=javabin&version=2} {add=[130]} 0 3
[junit4:junit4] 2> 21938 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[131 (1428753489623777280)]} 0 1
[junit4:junit4] 2> 21944 T2995 C127 P52479 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[131 (1428753489630068736)]} 0 1
[junit4:junit4] 2> 21945 T2980 C124 P52468 /update {wt=javabin&version=2} {add=[131]} 0 4
[junit4:junit4] 2> 21948 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[132 (1428753489634263040)]} 0 1
[junit4:junit4] 2> 21955 T3006 C123 P52488 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[132 (1428753489638457344)]} 0 1
[junit4:junit4] 2> 21956 T2980 C124 P52468 /update {wt=javabin&version=2} {add=[132 (1428753489638457344)]} 0 5
[junit4:junit4] 2> 21959 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[133 (1428753489645797376)]} 0 1
[junit4:junit4] 2> 21966 T3006 C123 P52488 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[133 (1428753489649991680)]} 0 1
[junit4:junit4] 2> 21967 T2980 C124 P52468 /update {wt=javabin&version=2} {add=[133 (1428753489649991680)]} 0 5
[junit4:junit4] 2> 21970 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[134 (1428753489657331712)]} 0 1
[junit4:junit4] 2> 21974 T2992 C127 P52479 /update {wt=javabin&version=2} {add=[134 (1428753489661526016)]} 0 1
[junit4:junit4] 2> 21978 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[135 (1428753489665720320)]} 0 1
[junit4:junit4] 2> 21987 T3006 C123 P52488 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[135 (1428753489672011776)]} 0 1
[junit4:junit4] 2> 21988 T2974 C124 P52468 /update {distrib.from=http://127.0.0.1:52479/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[135 (1428753489672011776)]} 0 5
[junit4:junit4] 2> 21988 T2992 C127 P52479 /update {wt=javabin&version=2} {add=[135]} 0 7
[junit4:junit4] 2> 21992 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[136 (1428753489680400384)]} 0 1
[junit4:junit4] 2> 21998 T2995 C127 P52479 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[136 (1428753489686691840)]} 0 1
[junit4:junit4] 2> 21999 T2980 C124 P52468 /update {wt=javabin&version=2} {add=[136]} 0 4
[junit4:junit4] 2> 22002 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[137 (1428753489690886144)]} 0 1
[junit4:junit4] 2> 22008 T2995 C127 P52479 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[137 (1428753489697177600)]} 0 1
[junit4:junit4] 2> 22008 T2980 C124 P52468 /update {wt=javabin&version=2} {add=[137]} 0 3
[junit4:junit4] 2> 22012 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[138 (1428753489701371904)]} 0 1
[junit4:junit4] 2> 22019 T3006 C123 P52488 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[138 (1428753489705566208)]} 0 1
[junit4:junit4] 2> 22020 T2980 C124 P52468 /update {wt=javabin&version=2} {add=[138 (1428753489705566208)]} 0 5
[junit4:junit4] 2> 22024 T2954 C126 P52458 /update {wt=javabin&version=2} {add=[139 (1428753489713954816)]} 0 1
[junit4:junit4] 2> 22030 T2995 C127 P52479 /update {distrib.from=http://127.0.0.1:52468/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[139 (1428753489720246272)]} 0 1
[junit4:junit4] 2> 22030 T2980 C124 P52468 /update {wt=javabin&version=2} {add=[139]} 0 3
[junit4:junit4] 2> 22034 T2954 C126 P52458 /u
[...truncated too long message...]
junit4:junit4] 2> 86843 T3016 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty3/index.20130306062505956
[junit4:junit4] 2> 86844 T3016 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty3/index
[junit4:junit4] 2> 86844 T3016 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty3/index
[junit4:junit4] 2> 86844 T3016 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty3
[junit4:junit4] 2> 86844 T3016 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362565485599/jetty3
[junit4:junit4] 2> 86844 T3016 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 86845 T3016 oasc.LeaderElector$1.process WARNING org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election/89297091664609290-4-n_0000000001
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:153)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:150)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:150)
[junit4:junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:63)
[junit4:junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:243)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> 86845 T3016 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 86846 T3016 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 86846 T3016 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 86846 T3016 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 86846 T3016 oascc.ZkStateReader$2.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 86846 T3016 oasc.LeaderElector$1.process WARNING org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:236)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:233)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:233)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> 86847 T3016 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {foo_b=PostingsFormat(name=TestBloomFilteredLucene41Postings), n_f1=PostingsFormat(name=SimpleText), foo_d=PostingsFormat(name=MockRandom), foo_f=PostingsFormat(name=TestBloomFilteredLucene41Postings), n_tl1=PostingsFormat(name=SimpleText), n_d1=PostingsFormat(name=Asserting), rnd_b=PostingsFormat(name=MockRandom), intDefault=PostingsFormat(name=Asserting), n_td1=PostingsFormat(name=SimpleText), timestamp=PostingsFormat(name=Asserting), id=PostingsFormat(name=MockRandom), range_facet_sl=PostingsFormat(name=TestBloomFilteredLucene41Postings), range_facet_si=PostingsFormat(name=SimpleText), oddField_s=PostingsFormat(name=TestBloomFilteredLucene41Postings), multiDefault=PostingsFormat(name=SimpleText), n_tf1=PostingsFormat(name=Asserting), n_dt1=PostingsFormat(name=SimpleText), range_facet_l=PostingsFormat(name=Asserting), n_ti1=PostingsFormat(name=MockRandom), text=PostingsFormat(name=TestBloomFilteredLucene41Postings), _version_=PostingsFormat(name=Asserting), SubjectTerms_mfacet=PostingsFormat(name=Asserting), a_t=PostingsFormat(name=Asserting), n_tdt1=PostingsFormat(name=Asserting), other_tl1=PostingsFormat(name=Asserting), n_l1=PostingsFormat(name=Asserting), a_si=PostingsFormat(name=SimpleText)}, docValues:{timestamp=DocValuesFormat(name=Disk)}, sim=DefaultSimilarity, locale=es_PE, timezone=America/Aruba
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Sun Microsystems Inc. 1.6.0_32 (64-bit)/cpus=16,threads=3,free=154916096,total=318373888
[junit4:junit4] 2> NOTE: All tests run in this JVM: [IndexSchemaTest, TestStressRecovery, TestPhraseSuggestions, JsonLoaderTest, UnloadDistributedZkTest, SimpleFacetsTest, BasicDistributedZkTest, FastVectorHighlighterTest, DirectSolrConnectionTest, CoreAdminHandlerTest, CSVRequestHandlerTest, FieldMutatingUpdateProcessorTest, AutoCommitTest, TestGroupingSearch, TermVectorComponentTest, ResponseLogComponentTest, TestValueSourceCache, UUIDFieldTest, DateFieldTest, TestPHPSerializedResponseWriter, TestDocumentBuilder, FileBasedSpellCheckerTest, UpdateRequestProcessorFactoryTest, WordBreakSolrSpellCheckerTest, ChaosMonkeyNothingIsSafeTest, SuggesterFSTTest, TestConfig, SchemaVersionSpecificBehaviorTest, TestRemoteStreaming, TestCopyFieldCollectionResource, SyncSliceTest, SuggesterTest, DistributedSpellCheckComponentTest, TestRealTimeGet, PrimitiveFieldTypeTest, QueryParsingTest, SliceStateUpdateTest, SpellingQueryConverterTest, SpatialFilterTest, TestDynamicFieldCollectionResource, ReturnFieldsTest, TestTrie, RAMDirectoryFactoryTest, MoreLikeThisHandlerTest, TestPropInjectDefaults, TestFastWriter, OverseerTest, TestFastLRUCache, TestSearchPerf, TestSweetSpotSimilarityFactory, LukeRequestHandlerTest, TestIBSimilarityFactory, ShardRoutingTest, OverseerCollectionProcessorTest, ClusterStateUpdateTest, ExternalFileFieldSortTest, ZkCLITest, SolrIndexSplitterTest, AnalysisAfterCoreReloadTest, ScriptEngineTest, TestFaceting, SliceStateTest, BadComponentTest, CircularListTest, LeaderElectionTest, CacheHeaderTest, BasicDistributedZk2Test]
[junit4:junit4] Completed on J0 in 87.59s, 1 test, 1 error <<< FAILURES!
[...truncated 430 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:388: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:361: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:183: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:449: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1213: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:877: There were test failures: 268 suites, 1134 tests, 1 error, 25 ignored (6 assumptions)
Total time: 96 minutes 27 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 197 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/197/
2 tests failed.
REGRESSION: org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch
Error Message:
No registered leader was found, collection:collection1 slice:shard1
Stack Trace:
org.apache.solr.common.SolrException: No registered leader was found, collection:collection1 slice:shard1
at __randomizedtesting.SeedInfo.seed([744E9E1DE12C83C7:F5A810059673E3FB]:0)
at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:430)
at org.apache.solr.cloud.BasicDistributedZk2Test.brindDownShardIndexSomeDocsAndRecover(BasicDistributedZk2Test.java:295)
at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:116)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:679)
REGRESSION: org.apache.solr.core.OpenCloseCoreStressTest.test10MinutesNew
Error Message:
Core 00004_core bad! expected:<364> but was:<360>
Stack Trace:
java.lang.AssertionError: Core 00004_core bad! expected:<364> but was:<360>
at __randomizedtesting.SeedInfo.seed([744E9E1DE12C83C7:4E6B263C93E26973]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.solr.core.OpenCloseCoreStressTest.checkResults(OpenCloseCoreStressTest.java:308)
at org.apache.solr.core.OpenCloseCoreStressTest.doStress(OpenCloseCoreStressTest.java:210)
at org.apache.solr.core.OpenCloseCoreStressTest.test10MinutesNew(OpenCloseCoreStressTest.java:142)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:679)
Build Log:
[...truncated 8567 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4] 2> 0 T2437 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 4 T2437 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362468504124
[junit4:junit4] 2> 6 T2437 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 6 T2438 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 10 T2438 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 10 T2438 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 11 T2438 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 11 T2438 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 12 T2438 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 107 T2437 oasc.ZkTestServer.run start zk server on port:29817
[junit4:junit4] 2> 107 T2437 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:29817 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@667f7eb5
[junit4:junit4] 2> 108 T2437 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 109 T2443 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:29817. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 109 T2443 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:29817, initiating session
[junit4:junit4] 2> 109 T2439 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:14343
[junit4:junit4] 2> 110 T2439 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:14343
[junit4:junit4] 2> 110 T2441 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 113 T2441 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d397382440000 with negotiated timeout 10000 for client /140.211.11.196:14343
[junit4:junit4] 2> 113 T2443 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:29817, sessionid = 0x13d397382440000, negotiated timeout = 10000
[junit4:junit4] 2> 113 T2444 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@667f7eb5 name:ZooKeeperConnection Watcher:127.0.0.1:29817 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 113 T2437 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 114 T2437 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 116 T2442 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d397382440000
[junit4:junit4] 2> 117 T2444 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 117 T2437 oaz.ZooKeeper.close Session: 0x13d397382440000 closed
[junit4:junit4] 2> 118 T2439 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:14343 which had sessionid 0x13d397382440000
[junit4:junit4] 2> 118 T2437 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:29817/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@68995e20
[junit4:junit4] 2> 119 T2437 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 119 T2445 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:29817. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 119 T2445 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:29817, initiating session
[junit4:junit4] 2> 120 T2439 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:63397
[junit4:junit4] 2> 120 T2439 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:63397
[junit4:junit4] 2> 121 T2441 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d397382440001 with negotiated timeout 10000 for client /140.211.11.196:63397
[junit4:junit4] 2> 121 T2445 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:29817, sessionid = 0x13d397382440001, negotiated timeout = 10000
[junit4:junit4] 2> 121 T2446 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@68995e20 name:ZooKeeperConnection Watcher:127.0.0.1:29817/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 122 T2437 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 122 T2437 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 140 T2437 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 153 T2437 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 158 T2437 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 170 T2437 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 171 T2437 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 176 T2437 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 177 T2437 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 181 T2437 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 182 T2437 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 185 T2437 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 186 T2437 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 196 T2437 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 197 T2437 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 200 T2437 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 200 T2437 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 203 T2437 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 204 T2437 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 207 T2437 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 208 T2437 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 210 T2437 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 211 T2437 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 213 T2442 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d397382440001
[junit4:junit4] 2> 221 T2446 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 221 T2439 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:63397 which had sessionid 0x13d397382440001
[junit4:junit4] 2> 221 T2437 oaz.ZooKeeper.close Session: 0x13d397382440001 closed
[junit4:junit4] 2> 537 T2437 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 541 T2437 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:22379
[junit4:junit4] 2> 542 T2437 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 543 T2437 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 543 T2437 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362468504340
[junit4:junit4] 2> 544 T2437 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362468504340/solr.xml
[junit4:junit4] 2> 544 T2437 oasc.CoreContainer.<init> New CoreContainer 843431934
[junit4:junit4] 2> 545 T2437 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362468504340/'
[junit4:junit4] 2> 545 T2437 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362468504340/'
[junit4:junit4] 2> 628 T2437 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 628 T2437 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 629 T2437 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 629 T2437 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 630 T2437 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 630 T2437 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 630 T2437 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 631 T2437 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 631 T2437 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 632 T2437 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 658 T2437 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 681 T2437 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:29817/solr
[junit4:junit4] 2> 682 T2437 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 682 T2437 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:29817 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@61a25e1
[junit4:junit4] 2> 684 T2437 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 684 T2456 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:29817. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 685 T2456 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:29817, initiating session
[junit4:junit4] 2> 685 T2439 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:16583
[junit4:junit4] 2> 685 T2439 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:16583
[junit4:junit4] 2> 687 T2441 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d397382440002 with negotiated timeout 20000 for client /140.211.11.196:16583
[junit4:junit4] 2> 687 T2456 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:29817, sessionid = 0x13d397382440002, negotiated timeout = 20000
[junit4:junit4] 2> 687 T2457 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@61a25e1 name:ZooKeeperConnection Watcher:127.0.0.1:29817 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 687 T2437 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 688 T2442 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d397382440002
[junit4:junit4] 2> 689 T2457 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 690 T2439 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:16583 which had sessionid 0x13d397382440002
[junit4:junit4] 2> 689 T2437 oaz.ZooKeeper.close Session: 0x13d397382440002 closed
[junit4:junit4] 2> 690 T2437 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 701 T2437 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:29817/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@7484623a
[junit4:junit4] 2> 702 T2437 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 703 T2458 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:29817. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 703 T2458 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:29817, initiating session
[junit4:junit4] 2> 704 T2439 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:16795
[junit4:junit4] 2> 704 T2439 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:16795
[junit4:junit4] 2> 705 T2441 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d397382440003 with negotiated timeout 20000 for client /140.211.11.196:16795
[junit4:junit4] 2> 705 T2458 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:29817, sessionid = 0x13d397382440003, negotiated timeout = 20000
[junit4:junit4] 2> 705 T2459 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7484623a name:ZooKeeperConnection Watcher:127.0.0.1:29817/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 706 T2437 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 708 T2442 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d397382440003 type:create cxid:0x2 zxid:0x1a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 716 T2437 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 718 T2437 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:22379_
[junit4:junit4] 2> 719 T2442 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d397382440003 type:delete cxid:0x8 zxid:0x1c txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:22379_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:22379_
[junit4:junit4] 2> 720 T2437 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:22379_
[junit4:junit4] 2> 730 T2437 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 744 T2442 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d397382440003 type:delete cxid:0x16 zxid:0x21 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 752 T2437 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 763 T2437 oasc.Overseer.start Overseer (id=89290735886794755-127.0.0.1:22379_-n_0000000000) starting
[junit4:junit4] 2> 764 T2442 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d397382440003 type:create cxid:0x1b zxid:0x23 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 775 T2442 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d397382440003 type:create cxid:0x1c zxid:0x24 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 786 T2442 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d397382440003 type:create cxid:0x1d zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 787 T2442 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d397382440003 type:create cxid:0x1e zxid:0x26 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 788 T2461 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 789 T2437 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 802 T2437 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 804 T2460 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 809 T2462 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362468504340/collection1
[junit4:junit4] 2> 809 T2462 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 810 T2462 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 810 T2462 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 812 T2462 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362468504340/collection1/'
[junit4:junit4] 2> 814 T2462 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362468504340/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 814 T2462 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362468504340/collection1/lib/README' to classloader
[junit4:junit4] 2> 885 T2462 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 958 T2462 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 959 T2462 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 966 T2462 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 1730 T2462 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 1751 T2462 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1758 T2462 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1774 T2462 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1781 T2462 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1787 T2462 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1788 T2462 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1789 T2462 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 1789 T2462 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 1790 T2462 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 1791 T2462 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 1791 T2462 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1362468504340/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/control/data/
[junit4:junit4] 2> 1792 T2462 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4ee14d81
[junit4:junit4] 2> 1792 T2462 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1793 T2462 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/control/data forceNew:false
[junit4:junit4] 2> 1793 T2462 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/control/data
[junit4:junit4] 2> 1794 T2462 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/control/data/index/
[junit4:junit4] 2> 1795 T2462 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1796 T2462 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/control/data/index forceNew:false
[junit4:junit4] 2> 1801 T2462 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@548fbbd0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@36dc6d88),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 1801 T2462 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 1802 T2462 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/control/data/index
[junit4:junit4] 2> 1805 T2462 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1805 T2462 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1806 T2462 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1807 T2462 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1807 T2462 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1808 T2462 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1808 T2462 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1809 T2462 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1809 T2462 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1825 T2462 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1835 T2462 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/control/data
[junit4:junit4] 2> 1836 T2462 oass.SolrIndexSearcher.<init> Opening Searcher@16fc0ca4 main
[junit4:junit4] 2> 1837 T2462 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/control/data/tlog
[junit4:junit4] 2> 1838 T2462 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1838 T2462 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1843 T2463 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@16fc0ca4 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1845 T2462 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1845 T2462 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1846 T2442 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d397382440003 type:create cxid:0x50 zxid:0x29 txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue Error:KeeperErrorCode = NoNode for /solr/overseer/queue
[junit4:junit4] 2> 2307 T2460 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2308 T2460 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:22379_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22379"}
[junit4:junit4] 2> 2308 T2460 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 2309 T2460 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 2309 T2442 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d397382440003 type:create cxid:0x58 zxid:0x2c txntype:-1 reqpath:n/a Error Path:/solr/overseer/queue-work Error:KeeperErrorCode = NoNode for /solr/overseer/queue-work
[junit4:junit4] 2> 2345 T2459 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 2859 T2462 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 2859 T2462 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:22379 collection:control_collection shard:shard1
[junit4:junit4] 2> 2860 T2462 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 2894 T2442 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d397382440003 type:delete cxid:0x72 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/collections/control_collection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/control_collection/leaders
[junit4:junit4] 2> 2901 T2462 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 2901 T2442 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d397382440003 type:create cxid:0x73 zxid:0x37 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2919 T2462 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 2920 T2462 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 2920 T2462 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:22379/collection1/
[junit4:junit4] 2> 2920 T2462 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 2920 T2462 oasc.SyncStrategy.syncToMe http://127.0.0.1:22379/collection1/ has no replicas
[junit4:junit4] 2> 2921 T2462 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:22379/collection1/
[junit4:junit4] 2> 2921 T2462 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 2924 T2442 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d397382440003 type:create cxid:0x7d zxid:0x3b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3859 T2460 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3886 T2459 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3904 T2462 oasc.ZkController.register We are http://127.0.0.1:22379/collection1/ and leader is http://127.0.0.1:22379/collection1/
[junit4:junit4] 2> 3904 T2462 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:22379
[junit4:junit4] 2> 3904 T2462 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 3904 T2462 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 3904 T2462 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 4058 T2462 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 4059 T2437 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4:junit4] 2> 4060 T2437 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 4060 T2437 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 4075 T2437 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 4076 T2437 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:29817/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@71926e66
[junit4:junit4] 2> 4077 T2437 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4077 T2465 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:29817. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 4078 T2465 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:29817, initiating session
[junit4:junit4] 2> 4078 T2439 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:55046
[junit4:junit4] 2> 4078 T2439 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:55046
[junit4:junit4] 2> 4088 T2441 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d397382440004 with negotiated timeout 10000 for client /140.211.11.196:55046
[junit4:junit4] 2> 4088 T2465 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:29817, sessionid = 0x13d397382440004, negotiated timeout = 10000
[junit4:junit4] 2> 4088 T2466 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@71926e66 name:ZooKeeperConnection Watcher:127.0.0.1:29817/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4089 T2437 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4089 T2437 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 4091 T2437 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 4286 T2437 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 4289 T2437 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:57232
[junit4:junit4] 2> 4290 T2437 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 4291 T2437 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 4291 T2437 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362468508210
[junit4:junit4] 2> 4291 T2437 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362468508210/solr.xml
[junit4:junit4] 2> 4292 T2437 oasc.CoreContainer.<init> New CoreContainer 543453996
[junit4:junit4] 2> 4293 T2437 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362468508210/'
[junit4:junit4] 2> 4293 T2437 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362468508210/'
[junit4:junit4] 2> 4359 T2437 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 4360 T2437 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 4360 T2437 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 4360 T2437 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 4361 T2437 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 4361 T2437 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 4362 T2437 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 4362 T2437 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 4363 T2437 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 4363 T2437 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 4388 T2437 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 4409 T2437 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:29817/solr
[junit4:junit4] 2> 4410 T2437 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 4410 T2437 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:29817 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@4bb329ac
[junit4:junit4] 2> 4411 T2437 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4412 T2476 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:29817. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 4413 T2476 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:29817, initiating session
[junit4:junit4] 2> 4413 T2439 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:41952
[junit4:junit4] 2> 4413 T2439 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:41952
[junit4:junit4] 2> 4455 T2441 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d397382440005 with negotiated timeout 20000 for client /140.211.11.196:41952
[junit4:junit4] 2> 4455 T2476 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:29817, sessionid = 0x13d397382440005, negotiated timeout = 20000
[junit4:junit4] 2> 4455 T2477 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4bb329ac name:ZooKeeperConnection Watcher:127.0.0.1:29817 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4456 T2437 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4457 T2442 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d397382440005
[junit4:junit4] 2> 4473 T2477 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 4473 T2439 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:41952 which had sessionid 0x13d397382440005
[junit4:junit4] 2> 4473 T2437 oaz.ZooKeeper.close Session: 0x13d397382440005 closed
[junit4:junit4] 2> 4474 T2437 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 4485 T2437 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:29817/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@3e3aae18
[junit4:junit4] 2> 4486 T2437 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 4486 T2478 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:29817. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 4487 T2478 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:29817, initiating session
[junit4:junit4] 2> 4487 T2439 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:20416
[junit4:junit4] 2> 4487 T2439 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:20416
[junit4:junit4] 2> 4527 T2441 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d397382440006 with negotiated timeout 20000 for client /140.211.11.196:20416
[junit4:junit4] 2> 4527 T2478 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:29817, sessionid = 0x13d397382440006, negotiated timeout = 20000
[junit4:junit4] 2> 4528 T2479 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3e3aae18 name:ZooKeeperConnection Watcher:127.0.0.1:29817/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 4528 T2437 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 4529 T2442 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d397382440006 type:create cxid:0x1 zxid:0x49 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4551 T2442 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d397382440006 type:create cxid:0x2 zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 4609 T2437 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 5394 T2460 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 5395 T2460 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "node_name":"127.0.0.1:22379_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:22379"}
[junit4:junit4] 2> 5407 T2479 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 5407 T2459 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 5407 T2466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 5612 T2437 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57232_
[junit4:junit4] 2> 5613 T2442 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d397382440006 type:delete cxid:0xb zxid:0x4f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:57232_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:57232_
[junit4:junit4] 2> 5614 T2437 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57232_
[junit4:junit4] 2> 5617 T2479 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 5617 T2459 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 5617 T2466 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5617 T2466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 5618 T2479 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5618 T2459 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 5630 T2480 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362468508210/collection1
[junit4:junit4] 2> 5630 T2480 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 5631 T2480 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 5631 T2480 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 5632 T2480 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362468508210/collection1/'
[junit4:junit4] 2> 5635 T2480 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362468508210/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 5636 T2480 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362468508210/collection1/lib/README' to classloader
[junit4:junit4] 2> 5693 T2480 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 5760 T2480 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 5761 T2480 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 5767 T2480 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 6465 T2480 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 6480 T2480 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 6485 T2480 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 6501 T2480 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 6507 T2480 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 6513 T2480 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 6514 T2480 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 6514 T2480 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 6514 T2480 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 6515 T2480 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 6516 T2480 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 6516 T2480 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362468508210/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty1/
[junit4:junit4] 2> 6516 T2480 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4ee14d81
[junit4:junit4] 2> 6517 T2480 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 6517 T2480 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty1 forceNew:false
[junit4:junit4] 2> 6518 T2480 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty1
[junit4:junit4] 2> 6518 T2480 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty1/index/
[junit4:junit4] 2> 6519 T2480 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 6519 T2480 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty1/index forceNew:false
[junit4:junit4] 2> 6522 T2480 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@23a4d690 lockFactory=org.apache.lucene.store.NativeFSLockFactory@47dae062),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 6522 T2480 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 6523 T2480 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty1/index
[junit4:junit4] 2> 6525 T2480 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 6526 T2480 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 6526 T2480 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 6527 T2480 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 6527 T2480 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 6527 T2480 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 6528 T2480 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 6528 T2480 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 6529 T2480 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 6541 T2480 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 6550 T2480 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty1
[junit4:junit4] 2> 6550 T2480 oass.SolrIndexSearcher.<init> Opening Searcher@42017816 main
[junit4:junit4] 2> 6551 T2480 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty1/tlog
[junit4:junit4] 2> 6552 T2480 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 6552 T2480 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 6555 T2481 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@42017816 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 6557 T2480 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 6557 T2480 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 6912 T2460 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6913 T2460 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:57232_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57232"}
[junit4:junit4] 2> 6913 T2460 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 6913 T2460 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 6936 T2459 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6936 T2466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 6936 T2479 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 7560 T2480 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 7560 T2480 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:57232 collection:collection1 shard:shard1
[junit4:junit4] 2> 7561 T2480 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 7577 T2442 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d397382440006 type:delete cxid:0x48 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 7578 T2480 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 7578 T2442 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d397382440006 type:create cxid:0x49 zxid:0x5c txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 7590 T2480 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 7590 T2480 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 7590 T2480 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:57232/collection1/
[junit4:junit4] 2> 7590 T2480 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 7590 T2480 oasc.SyncStrategy.syncToMe http://127.0.0.1:57232/collection1/ has no replicas
[junit4:junit4] 2> 7591 T2480 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:57232/collection1/
[junit4:junit4] 2> 7591 T2480 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 7595 T2442 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d397382440006 type:create cxid:0x53 zxid:0x60 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8451 T2460 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8489 T2459 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8489 T2479 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8489 T2466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 8523 T2480 oasc.ZkController.register We are http://127.0.0.1:57232/collection1/ and leader is http://127.0.0.1:57232/collection1/
[junit4:junit4] 2> 8523 T2480 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:57232
[junit4:junit4] 2> 8523 T2480 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 8523 T2480 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 8523 T2480 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 8525 T2480 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8526 T2437 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4:junit4] 2> 8527 T2437 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 8527 T2437 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 8777 T2437 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 8780 T2437 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:50008
[junit4:junit4] 2> 8781 T2437 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 8781 T2437 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 8782 T2437 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362468512663
[junit4:junit4] 2> 8782 T2437 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362468512663/solr.xml
[junit4:junit4] 2> 8782 T2437 oasc.CoreContainer.<init> New CoreContainer 1483436980
[junit4:junit4] 2> 8783 T2437 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362468512663/'
[junit4:junit4] 2> 8784 T2437 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362468512663/'
[junit4:junit4] 2> 8852 T2437 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 8853 T2437 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 8853 T2437 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 8854 T2437 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 8855 T2437 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 8855 T2437 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 8856 T2437 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 8856 T2437 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 8857 T2437 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 8858 T2437 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 8890 T2437 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 8912 T2437 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:29817/solr
[junit4:junit4] 2> 8913 T2437 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 8913 T2437 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:29817 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@4c75dcca
[junit4:junit4] 2> 8914 T2437 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8915 T2492 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:29817. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 8915 T2492 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:29817, initiating session
[junit4:junit4] 2> 8916 T2439 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:20342
[junit4:junit4] 2> 8916 T2439 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:20342
[junit4:junit4] 2> 8918 T2441 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d397382440007 with negotiated timeout 20000 for client /140.211.11.196:20342
[junit4:junit4] 2> 8918 T2492 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:29817, sessionid = 0x13d397382440007, negotiated timeout = 20000
[junit4:junit4] 2> 8919 T2493 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4c75dcca name:ZooKeeperConnection Watcher:127.0.0.1:29817 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8919 T2437 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8920 T2442 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d397382440007
[junit4:junit4] 2> 8927 T2493 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 8927 T2439 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:20342 which had sessionid 0x13d397382440007
[junit4:junit4] 2> 8927 T2437 oaz.ZooKeeper.close Session: 0x13d397382440007 closed
[junit4:junit4] 2> 8928 T2437 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 8937 T2437 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:29817/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@4a105332
[junit4:junit4] 2> 8938 T2437 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 8938 T2494 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:29817. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 8938 T2494 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:29817, initiating session
[junit4:junit4] 2> 8939 T2439 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:44686
[junit4:junit4] 2> 8939 T2439 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:44686
[junit4:junit4] 2> 8947 T2441 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d397382440008 with negotiated timeout 20000 for client /140.211.11.196:44686
[junit4:junit4] 2> 8947 T2494 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:29817, sessionid = 0x13d397382440008, negotiated timeout = 20000
[junit4:junit4] 2> 8947 T2495 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4a105332 name:ZooKeeperConnection Watcher:127.0.0.1:29817/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 8947 T2437 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 8948 T2442 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d397382440008 type:create cxid:0x1 zxid:0x6d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8952 T2442 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d397382440008 type:create cxid:0x2 zxid:0x6e txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8960 T2437 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 9963 T2437 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50008_
[junit4:junit4] 2> 9964 T2442 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d397382440008 type:delete cxid:0x9 zxid:0x6f txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:50008_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:50008_
[junit4:junit4] 2> 9965 T2437 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50008_
[junit4:junit4] 2> 9967 T2479 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9967 T2459 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 9968 T2466 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9968 T2495 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9968 T2466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 9969 T2479 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9969 T2459 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 9981 T2496 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362468512663/collection1
[junit4:junit4] 2> 9981 T2496 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 9982 T2496 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 9982 T2496 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 9983 T2496 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362468512663/collection1/'
[junit4:junit4] 2> 9984 T2496 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362468512663/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 9985 T2496 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362468512663/collection1/lib/README' to classloader
[junit4:junit4] 2> 10005 T2460 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 10006 T2460 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:57232_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57232"}
[junit4:junit4] 2> 10011 T2459 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10011 T2495 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10011 T2479 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10011 T2466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 10032 T2496 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 10092 T2496 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 10092 T2496 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 10098 T2496 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 11180 T3 oasc.CoreContainer.finalize SEVERE CoreContainer was not shutdown prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!! instance=1370648045
[junit4:junit4] 2> 11237 T2496 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 11250 T2496 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 11255 T2496 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 11268 T2496 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 11274 T2496 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 11278 T2496 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 11279 T2496 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 11280 T2496 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 11280 T2496 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 11281 T2496 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 11281 T2496 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 11282 T2496 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1362468512663/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty2/
[junit4:junit4] 2> 11282 T2496 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4ee14d81
[junit4:junit4] 2> 11282 T2496 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 11283 T2496 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty2 forceNew:false
[junit4:junit4] 2> 11283 T2496 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty2
[junit4:junit4] 2> 11283 T2496 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty2/index/
[junit4:junit4] 2> 11284 T2496 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 11285 T2496 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty2/index forceNew:false
[junit4:junit4] 2> 11374 T2496 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@788c8575 lockFactory=org.apache.lucene.store.NativeFSLockFactory@422f7845),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 11374 T2496 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 11375 T2496 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty2/index
[junit4:junit4] 2> 11377 T2496 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 11378 T2496 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 11378 T2496 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 11379 T2496 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 11379 T2496 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 11380 T2496 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 11380 T2496 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 11380 T2496 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 11381 T2496 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 11390 T2496 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 11400 T2496 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty2
[junit4:junit4] 2> 11401 T2496 oass.SolrIndexSearcher.<init> Opening Searcher@3a470f99 main
[junit4:junit4] 2> 11401 T2496 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty2/tlog
[junit4:junit4] 2> 11402 T2496 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 11403 T2496 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 11407 T2497 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3a470f99 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 11408 T2496 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 11409 T2496 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 11522 T2460 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 11523 T2460 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:50008_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50008"}
[junit4:junit4] 2> 11523 T2460 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 11524 T2460 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 11534 T2459 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11534 T2466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11534 T2495 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 11534 T2479 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 12411 T2496 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 12411 T2496 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50008 collection:collection1 shard:shard2
[junit4:junit4] 2> 12412 T2496 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 12428 T2442 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d397382440008 type:delete cxid:0x45 zxid:0x7e txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4] 2> 12430 T2496 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 12430 T2442 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d397382440008 type:create cxid:0x46 zxid:0x7f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 12441 T2496 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 12441 T2496 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 12441 T2496 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50008/collection1/
[junit4:junit4] 2> 12441 T2496 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 12442 T2496 oasc.SyncStrategy.syncToMe http://127.0.0.1:50008/collection1/ has no replicas
[junit4:junit4] 2> 12442 T2496 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50008/collection1/
[junit4:junit4] 2> 12442 T2496 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 12445 T2442 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d397382440008 type:create cxid:0x4f zxid:0x82 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 13039 T2460 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13062 T2459 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13062 T2495 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13063 T2466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13062 T2479 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 13110 T2496 oasc.ZkController.register We are http://127.0.0.1:50008/collection1/ and leader is http://127.0.0.1:50008/collection1/
[junit4:junit4] 2> 13110 T2496 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50008
[junit4:junit4] 2> 13110 T2496 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 13110 T2496 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 13111 T2496 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 13113 T2496 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 13114 T2437 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4:junit4] 2> 13114 T2437 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 13115 T2437 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 13451 T2437 oejs.Server.doStart jetty-8.1.8.v20121106
[junit4:junit4] 2> 13454 T2437 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:51029
[junit4:junit4] 2> 13455 T2437 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 13455 T2437 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 13456 T2437 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362468517251
[junit4:junit4] 2> 13456 T2437 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362468517251/solr.xml
[junit4:junit4] 2> 13457 T2437 oasc.CoreContainer.<init> New CoreContainer 1996505736
[junit4:junit4] 2> 13457 T2437 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362468517251/'
[junit4:junit4] 2> 13458 T2437 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362468517251/'
[junit4:junit4] 2> 13520 T2437 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 13520 T2437 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 13521 T2437 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 13521 T2437 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 13522 T2437 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 13522 T2437 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 13522 T2437 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 13523 T2437 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 13523 T2437 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 13524 T2437 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 13548 T2437 oasc.CoreContainer.load Registering Log Listener
[junit4:junit4] 2> 13580 T2437 oasc.CoreContainer.initZooKeeper Zookeeper client=127.0.0.1:29817/solr
[junit4:junit4] 2> 13581 T2437 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 13582 T2437 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:29817 sessionTimeout=60000 watcher=org.apache.solr.common.cloud.ConnectionManager@43a8a594
[junit4:junit4] 2> 13583 T2437 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 13584 T2508 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:29817. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 13585 T2508 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:29817, initiating session
[junit4:junit4] 2> 13585 T2439 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:37318
[junit4:junit4] 2> 13585 T2439 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:37318
[junit4:junit4] 2> 13587 T2441 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d397382440009 with negotiated timeout 20000 for client /140.211.11.196:37318
[junit4:junit4] 2> 13587 T2508 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:29817, sessionid = 0x13d397382440009, negotiated timeout = 20000
[junit4:junit4] 2> 13587 T2509 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@43a8a594 name:ZooKeeperConnection Watcher:127.0.0.1:29817 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 13587 T2437 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 13588 T2442 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d397382440009
[junit4:junit4] 2> 13589 T2509 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 13589 T2439 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:37318 which had sessionid 0x13d397382440009
[junit4:junit4] 2> 13589 T2437 oaz.ZooKeeper.close Session: 0x13d397382440009 closed
[junit4:junit4] 2> 13590 T2437 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 13608 T2437 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:29817/solr sessionTimeout=30000 watcher=org.apache.solr.common.cloud.ConnectionManager@3cfb5c21
[junit4:junit4] 2> 13609 T2437 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 13609 T2510 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:29817. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 13610 T2510 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:29817, initiating session
[junit4:junit4] 2> 13610 T2439 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:39731
[junit4:junit4] 2> 13611 T2439 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:39731
[junit4:junit4] 2> 13612 T2441 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d39738244000a with negotiated timeout 20000 for client /140.211.11.196:39731
[junit4:junit4] 2> 13612 T2510 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:29817, sessionid = 0x13d39738244000a, negotiated timeout = 20000
[junit4:junit4] 2> 13612 T2511 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3cfb5c21 name:ZooKeeperConnection Watcher:127.0.0.1:29817/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 13612 T2437 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 13613 T2442 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d39738244000a type:create cxid:0x1 zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 13614 T2442 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d39738244000a type:create cxid:0x2 zxid:0x90 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 13616 T2437 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 14585 T2460 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 14586 T2460 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:50008_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50008"}
[junit4:junit4] 2> 14596 T2511 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14596 T2495 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14596 T2466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14596 T2459 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14596 T2479 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14619 T2437 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51029_
[junit4:junit4] 2> 14620 T2442 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d39738244000a type:delete cxid:0xb zxid:0x95 txntype:-1 reqpath:n/a Error Path:/solr/live_nodes/127.0.0.1:51029_ Error:KeeperErrorCode = NoNode for /solr/live_nodes/127.0.0.1:51029_
[junit4:junit4] 2> 14621 T2437 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51029_
[junit4:junit4] 2> 14623 T2459 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14623 T2511 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14623 T2479 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 14624 T2466 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14624 T2495 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14624 T2466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14624 T2495 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 14625 T2511 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14626 T2459 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14631 T2479 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 14641 T2512 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362468517251/collection1
[junit4:junit4] 2> 14642 T2512 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 14642 T2512 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 14643 T2512 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 14644 T2512 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362468517251/collection1/'
[junit4:junit4] 2> 14645 T2512 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362468517251/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 14646 T2512 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362468517251/collection1/lib/README' to classloader
[junit4:junit4] 2> 14698 T2512 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 14773 T2512 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 14775 T2512 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 14781 T2512 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 15419 T2512 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 15426 T2512 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 15432 T2512 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 15440 T2512 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15444 T2512 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 15446 T2512 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15447 T2512 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 15447 T2512 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 15447 T2512 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 15448 T2512 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 15448 T2512 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 15448 T2512 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1362468517251/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty3/
[junit4:junit4] 2> 15448 T2512 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4ee14d81
[junit4:junit4] 2> 15449 T2512 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 15449 T2512 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty3 forceNew:false
[junit4:junit4] 2> 15449 T2512 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty3
[junit4:junit4] 2> 15450 T2512 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty3/index/
[junit4:junit4] 2> 15450 T2512 oasc.SolrCore.initIndex WARNING [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 15450 T2512 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty3/index forceNew:false
[junit4:junit4] 2> 15452 T2512 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2193be98 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6cbf8763),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 15452 T2512 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 15453 T2512 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty3/index
[junit4:junit4] 2> 15454 T2512 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 15454 T2512 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 15454 T2512 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 15455 T2512 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 15455 T2512 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 15455 T2512 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 15455 T2512 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 15456 T2512 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 15456 T2512 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 15463 T2512 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 15469 T2512 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty3
[junit4:junit4] 2> 15469 T2512 oass.SolrIndexSearcher.<init> Opening Searcher@31fefefc main
[junit4:junit4] 2> 15469 T2512 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty3/tlog
[junit4:junit4] 2> 15470 T2512 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 15470 T2512 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 15473 T2513 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@31fefefc main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 15474 T2512 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 15474 T2512 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16101 T2460 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16102 T2460 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:51029_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51029"}
[junit4:junit4] 2> 16102 T2460 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 16102 T2460 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 16116 T2459 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16116 T2479 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16116 T2511 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16116 T2495 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16116 T2466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 16476 T2512 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 16476 T2512 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51029 collection:collection1 shard:shard1
[junit4:junit4] 2> 16479 T2512 oasc.ZkController.register We are http://127.0.0.1:51029/collection1/ and leader is http://127.0.0.1:57232/collection1/
[junit4:junit4] 2> 16479 T2512 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51029
[junit4:junit4] 2> 16480 T2512 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 16480 T2512 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C113 name=collection1 org.apache.solr.core.SolrCore@6427512b url=http://127.0.0.1:51029/collection1 node=127.0.0.1:51029_ C113_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:51029_, base_url=http://127.0.0.1:51029}
[junit4:junit4] 2> 16480 T2514 C113 P51029 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 16481 T2512 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16481 T2514 C113 P51029 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 16481 T2514 C113 P51029 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 16482 T2514 C113 P51029 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 16482 T2437 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4:junit4] 2> 16483 T2437 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 16483 T2514 C113 P51029 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16483 T2437 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16505 T2437 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 16506 T2437 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 16519 T2470 oasc.CoreContainer.create Creating SolrCore 'onenodecollectioncore' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362468508210/onenodecollectioncore
[junit4:junit4] 2> 16519 T2470 oasc.ZkController.createCollectionZkNode Check for collection zkNode:onenodecollection
[junit4:junit4] 2> 16520 T2470 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:onenodecollection
[junit4:junit4] 2> 16521 T2470 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 16522 T2470 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 16522 T2470 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection
[junit4:junit4] 2> 16525 T2470 oasc.ZkController.readConfigName Load collection config from:/collections/onenodecollection
[junit4:junit4] 2> 16527 T2470 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362468508210/onenodecollectioncore/'
[junit4:junit4] 2> 16630 T2470 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 16697 T2470 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 16698 T2470 oass.IndexSchema.readSchema Reading Solr Schema
[junit4:junit4] 2> 16705 T2470 oass.IndexSchema.readSchema Schema name=test
[junit4:junit4] 2> 17390 T2470 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 17399 T2470 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 17402 T2470 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 17413 T2470 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 17417 T2470 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 17421 T2470 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 17421 T2470 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 17422 T2470 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 17422 T2470 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 17423 T2470 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 17423 T2470 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARNING Expected key, got STRING
[junit4:junit4] 2> 17424 T2470 oasc.SolrCore.<init> [onenodecollectioncore] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1362468508210/onenodecollectioncore/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362468504124/onenodecollection/
[junit4:junit4] 2> 17424 T2470 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4ee14d81
[junit4:junit4] 2> 17424 T2470 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 17425 T2470 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362468504124/onenodecollection forceNew:false
[junit4:junit4] 2> 17425 T2470 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362468504124/onenodecollection
[junit4:junit4] 2> 17425 T2470 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362468504124/onenodecollection/index/
[junit4:junit4] 2> 17426 T2470 oasc.SolrCore.initIndex WARNING [onenodecollectioncore] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362468504124/onenodecollection/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 17426 T2470 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362468504124/onenodecollection/index forceNew:false
[junit4:junit4] 2> 17429 T2470 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6976f328 lockFactory=org.apache.lucene.store.NativeFSLockFactory@d615a7c),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 17429 T2470 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 17430 T2470 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362468504124/onenodecollection/index
[junit4:junit4] 2> 17431 T2470 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 17431 T2470 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 17432 T2470 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 17432 T2470 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 17432 T2470 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 17433 T2470 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 17433 T2470 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 17433 T2470 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 17434 T2470 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 17440 T2470 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 17446 T2470 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362468504124/onenodecollection
[junit4:junit4] 2> 17446 T2470 oass.SolrIndexSearcher.<init> Opening Searcher@60dc14b3 main
[junit4:junit4] 2> 17446 T2470 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362468504124/onenodecollection/tlog
[junit4:junit4] 2> 17447 T2470 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 17448 T2470 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 17450 T2470 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362468504124/onenodecollection
[junit4:junit4] 2> 17450 T2516 oasc.SolrCore.registerSearcher [onenodecollectioncore] Registered new searcher Searcher@60dc14b3 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 17451 T2470 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4] 2> 17621 T2460 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 17622 T2460 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:51029_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51029"}
[junit4:junit4] 2> 17637 T2460 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "node_name":"127.0.0.1:57232_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57232"}
[junit4:junit4] 2> 17637 T2460 oasc.Overseer$ClusterStateUpdater.createCollection Create collection onenodecollection with numShards 1
[junit4:junit4] 2> 17637 T2460 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 17664 T2459 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17664 T2495 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17664 T2511 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17664 T2479 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 17664 T2466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 18453 T2470 oasc.CoreContainer.registerCore registering core: onenodecollectioncore
[junit4:junit4] 2> 18453 T2470 oasc.ZkController.register Register replica - core:onenodecollectioncore address:http://127.0.0.1:57232 collection:onenodecollection shard:shard1
[junit4:junit4] 2> 18454 T2470 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leader_elect/shard1/election
[junit4:junit4] 2> 18469 T2442 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d397382440006 type:delete cxid:0xa1 zxid:0xac txntype:-1 reqpath:n/a Error Path:/solr/collections/onenodecollection/leaders Error:KeeperErrorCode = NoNode for /solr/collections/onenodecollection/leaders
[junit4:junit4] 2> 18471 T2470 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 18471 T2442 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d397382440006 type:create cxid:0xa2 zxid:0xad txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 18484 T2470 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 18485 T2470 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 18485 T2470 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:57232/onenodecollectioncore/
[junit4:junit4] 2> 18485 T2470 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 18485 T2470 oasc.SyncStrategy.syncToMe http://127.0.0.1:57232/onenodecollectioncore/ has no replicas
[junit4:junit4] 2> 18486 T2470 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:57232/onenodecollectioncore/
[junit4:junit4] 2> 18486 T2470 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leaders/shard1
[junit4:junit4] 2> 18490 T2442 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d397382440006 type:create cxid:0xac zxid:0xb1 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 19177 T2460 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19262 T2459 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 19262 T2495 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 19262 T2511 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 19262 T2479 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 19262 T2466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 19316 T2470 oasc.ZkController.register We are http://127.0.0.1:57232/onenodecollectioncore/ and leader is http://127.0.0.1:57232/onenodecollectioncore/
[junit4:junit4] 2> 19316 T2470 oasc.ZkController.register No LogReplay needed for core=onenodecollectioncore baseURL=http://127.0.0.1:57232
[junit4:junit4] 2> 19316 T2470 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 19317 T2470 oasc.ZkController.publish publishing core=onenodecollectioncore state=active
[junit4:junit4] 2> 19331 T2470 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 19333 T2437 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: onenodecollection failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 19334 T2437 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20336 T2437 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C113_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:51029_, base_url=http://127.0.0.1:51029}
[junit4:junit4] 2> 20508 T2514 C113 P51029 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:57232/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 20508 T2514 C113 P51029 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:51029 START replicas=[http://127.0.0.1:57232/collection1/] nUpdates=100
[junit4:junit4] 2> 20508 T2514 C113 P51029 oasu.PeerSync.sync WARNING no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 20509 T2514 C113 P51029 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 20509 T2514 C113 P51029 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 20509 T2514 C113 P51029 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 20509 T2514 C113 P51029 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 20509 T2514 C113 P51029 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:57232/collection1/. core=collection1
[junit4:junit4] 2> 20510 T2514 C113 P51029 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C114 name=collection1 org.apache.solr.core.SolrCore@4f7034d4 url=http://127.0.0.1:57232/collection1 node=127.0.0.1:57232_ C114_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:57232_, base_url=http://127.0.0.1:57232, leader=true}
[junit4:junit4] 2> 20516 T2471 C114 P57232 REQ /get {getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0
[junit4:junit4] 2> 20530 T2472 C114 P57232 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 20530 T2472 C114 P57232 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty1
[junit4:junit4] 2> 20533 T2472 C114 P57232 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@23a4d690 lockFactory=org.apache.lucene.store.NativeFSLockFactory@47dae062),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 20533 T2472 C114 P57232 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 20534 T2472 C114 P57232 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@23a4d690 lockFactory=org.apache.lucene.store.NativeFSLockFactory@47dae062),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@23a4d690 lockFactory=org.apache.lucene.store.NativeFSLockFactory@47dae062),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 20535 T2472 C114 P57232 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 20535 T2472 C114 P57232 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty1
[junit4:junit4] 2> 20536 T2472 C114 P57232 oass.SolrIndexSearcher.<init> Opening Searcher@6370c634 realtime
[junit4:junit4] 2> 20536 T2472 C114 P57232 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 20536 T2472 C114 P57232 /update {waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 6
[junit4:junit4] 2> 20537 T2514 C113 P51029 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 20537 T2514 C113 P51029 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 20539 T2473 C114 P57232 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 20539 T2473 C114 P57232 REQ /replication {command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 20540 T2514 C113 P51029 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 20540 T2514 C113 P51029 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 20540 T2514 C113 P51029 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 20543 T2473 C114 P57232 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty1
[junit4:junit4] 2> 20544 T2473 C114 P57232 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty1/index
[junit4:junit4] 2> 20544 T2473 C114 P57232 REQ /replication {command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=1
[junit4:junit4] 2> 20545 T2514 C113 P51029 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 20546 T2514 C113 P51029 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty3/index.20130305172844664 forceNew:false
[junit4:junit4] 2> 20546 T2514 C113 P51029 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty3
[junit4:junit4] 2> 20546 T2514 C113 P51029 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@10c9ae8b lockFactory=org.apache.lucene.store.NativeFSLockFactory@19d01d97) fullCopy=false
[junit4:junit4] 2> 20549 T2473 C114 P57232 REQ /replication {file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 20550 T2514 C113 P51029 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty3/index
[junit4:junit4] 2> 20551 T2514 C113 P51029 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 20551 T2514 C113 P51029 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty3
[junit4:junit4] 2> 20552 T2514 C113 P51029 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty3
[junit4:junit4] 2> 20552 T2514 C113 P51029 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 20552 T2514 C113 P51029 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 20552 T2514 C113 P51029 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty3
[junit4:junit4] 2> 20554 T2514 C113 P51029 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2193be98 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6cbf8763),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2193be98 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6cbf8763),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 20554 T2514 C113 P51029 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 20555 T2514 C113 P51029 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 20555 T2514 C113 P51029 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty3
[junit4:junit4] 2> 20555 T2514 C113 P51029 oass.SolrIndexSearcher.<init> Opening Searcher@23aaf7d3 main
[junit4:junit4] 2> 20556 T2513 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@23aaf7d3 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 20556 T2513 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty3/index
[junit4:junit4] 2> 20557 T2514 C113 P51029 oash.SnapPuller.fetchLatestIndex removing temporary index download directory files MockDirWrapper(org.apache.lucene.store.RAMDirectory@10c9ae8b lockFactory=org.apache.lucene.store.NativeFSLockFactory@19d01d97)
[junit4:junit4] 2> 20557 T2514 C113 P51029 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty3/index.20130305172844664
[junit4:junit4] 2> 20557 T2514 C113 P51029 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty3/index
[junit4:junit4] 2> 20557 T2514 C113 P51029 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 20557 T2514 C113 P51029 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 20557 T2514 C113 P51029 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 20558 T2514 C113 P51029 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 20559 T2514 C113 P51029 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 20833 T2460 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 20835 T2460 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"onenodecollectioncore",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "node_name":"127.0.0.1:57232_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57232"}
[junit4:junit4] 2> 20851 T2460 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:51029_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51029"}
[junit4:junit4] 2> 20862 T2459 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 20862 T2479 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 20862 T2495 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 20862 T2511 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 20862 T2466 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 21338 T2437 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21340 T2437 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: onenodecollection
[junit4:junit4] 2> 21340 T2437 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C115 name=onenodecollectioncore org.apache.solr.core.SolrCore@3a3b97a6 url=http://127.0.0.1:57232/onenodecollectioncore node=127.0.0.1:57232_ C115_STATE=coll:onenodecollection core:onenodecollectioncore props:{shard=shard1, roles=none, state=active, core=onenodecollectioncore, collection=onenodecollection, node_name=127.0.0.1:57232_, base_url=http://127.0.0.1:57232, leader=true}
[junit4:junit4] 2> 21394 T2474 C115 P57232 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362468504124/onenodecollection
[junit4:junit4] 2> 21397 T2474 C115 P57232 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6976f328 lockFactory=org.apache.lucene.store.NativeFSLockFactory@d615a7c),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 21398 T2474 C115 P57232 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 21401 T2474 C115 P57232 /update {wt=javabin&version=2} {add=[1 (1428651796608319488)]} 0 8
[junit4:junit4] 2> 21411 T2474 C115 P57232 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 21421 T2474 C115 P57232 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6976f328 lockFactory=org.apache.lucene.store.NativeFSLockFactory@d615a7c),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6976f328 lockFactory=org.apache.lucene.store.NativeFSLockFactory@d615a7c),segFN=segments_2,generation=2,filenames=[_0_Lucene41WithOrds_0.tib, _0_TestBloomFilteredLucene41Postings_0.tim, _0_Lucene41WithOrds_0.tii, _0_Pulsing41_1.tip, _0_Lucene41WithOrds_0.pos, _0_TestBloomFilteredLucene41Postings_0.tip, _0_TestBloomFilteredLucene41Postings_0.pos, _0_Pulsing41_1.tim, _0_Pulsing41_0.tim, _0_Pulsing41_0.tip, _0.nvd, _0_CheapBastard_0.dvdd, _0.si, _0_CheapBastard_0.dvdm, _0.fnm, _0_Lucene41WithOrds_0.doc, _0_TestBloomFilteredLucene41Postings_0.blm, _0.nvm, _0_Pulsing41_0.doc, _0_Pulsing41_0.pos, segments_2, _0_TestBloomFilteredLucene41Postings_0.doc, _0.fdx, _0_Pulsing41_1.doc, _0_Pulsing41_1.pos, _0.fdt]
[junit4:junit4] 2> 21421 T2474 C115 P57232 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[_0_Lucene41WithOrds_0.tib, _0_TestBloomFilteredLucene41Postings_0.tim, _0_Lucene41WithOrds_0.tii, _0_Pulsing41_1.tip, _0_Lucene41WithOrds_0.pos, _0_TestBloomFilteredLucene41Postings_0.tip, _0_TestBloomFilteredLucene41Postings_0.pos, _0_Pulsing41_1.tim, _0_Pulsing41_0.tim, _0_Pulsing41_0.tip, _0.nvd, _0_CheapBastard_0.dvdd, _0.si, _0_CheapBastard_0.dvdm, _0.fnm, _0_Lucene41WithOrds_0.doc, _0_TestBloomFilteredLucene41Postings_0.blm, _0.nvm, _0_Pulsing41_0.doc, _0_Pulsing41_0.pos, segments_2, _0_TestBloomFilteredLucene41Postings_0.doc, _0.fdx, _0_Pulsing41_1.doc, _0_Pulsing41_1.pos, _0.fdt]
[junit4:junit4] 2> 21422 T2474 C115 P57232 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362468504124/onenodecollection
[junit4:junit4] 2> 21424 T2474 C115 P57232 oass.SolrIndexSearcher.<init> Opening Searcher@4b314615 main
[junit4:junit4] 2> 21424 T2474 C115 P57232 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 21425 T2516 oasc.SolrCore.registerSearcher [onenodecollectioncore] Registered new searcher Searcher@4b314615 main{StandardDirectoryReader(segments_2:3 _0(5.0):C1)}
[junit4:junit4] 2> 21425 T2516 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1362468504124/onenodecollection/index
[junit4:junit4] 2> 21426 T2474 C115 P57232 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 15
[junit4:junit4] 2> 21431 T2474 C115 P57232 REQ /select {q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=1
[junit4:junit4] 2> 21432 T2437 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 21447 T2474 C115 P57232 REQ /select {q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=0
[junit4:junit4] 2> ASYNC NEW_CORE C116 name=collection1 org.apache.solr.core.SolrCore@43696df3 url=http://127.0.0.1:22379/collection1 node=127.0.0.1:22379_ C116_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:22379_, base_url=http://127.0.0.1:22379, leader=true}
[junit4:junit4] 2> 21458 T2449 C116 P22379 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/control/data
[junit4:junit4] 2> 21460 T2449 C116 P22379 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@548fbbd0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@36dc6d88),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 21461 T2449 C116 P22379 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 21464 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[1 (1428651796675428352)]} 0 7
[junit4:junit4] 2> C113_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:51029_, base_url=http://127.0.0.1:51029}
[junit4:junit4] 2> 21490 T2501 C113 P51029 /update {distrib.from=http://127.0.0.1:57232/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1428651796694302720)]} 0 3
[junit4:junit4] 2> 21490 T2475 C114 P57232 /update {wt=javabin&version=2} {add=[1 (1428651796694302720)]} 0 14
[junit4:junit4] 2> 21493 T2449 C116 P22379 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 21498 T2449 C116 P22379 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@548fbbd0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@36dc6d88),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@548fbbd0 lockFactory=org.apache.lucene.store.NativeFSLockFactory@36dc6d88),segFN=segments_2,generation=2,filenames=[_0_Lucene41WithOrds_0.tib, _0_TestBloomFilteredLucene41Postings_0.tim, _0_Lucene41WithOrds_0.tii, _0_Pulsing41_1.tip, _0_Lucene41WithOrds_0.pos, _0_TestBloomFilteredLucene41Postings_0.tip, _0_TestBloomFilteredLucene41Postings_0.pos, _0_Pulsing41_1.tim, _0_Pulsing41_0.tim, _0_Pulsing41_0.tip, _0.nvd, _0_CheapBastard_0.dvdd, _0.si, _0_CheapBastard_0.dvdm, _0.fnm, _0_Lucene41WithOrds_0.doc, _0_TestBloomFilteredLucene41Postings_0.blm, _0.nvm, _0_Pulsing41_0.doc, _0_Pulsing41_0.pos, segments_2, _0_TestBloomFilteredLucene41Postings_0.doc, _0.fdx, _0_Pulsing41_1.doc, _0_Pulsing41_1.pos, _0.fdt]
[junit4:junit4] 2> 21499 T2449 C116 P22379 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[_0_Lucene41WithOrds_0.tib, _0_TestBloomFilteredLucene41Postings_0.tim, _0_Lucene41WithOrds_0.tii, _0_Pulsing41_1.tip, _0_Lucene41WithOrds_0.pos, _0_TestBloomFilteredLucene41Postings_0.tip, _0_TestBloomFilteredLucene41Postings_0.pos, _0_Pulsing41_1.tim, _0_Pulsing41_0.tim, _0_Pulsing41_0.tip, _0.nvd, _0_CheapBastard_0.dvdd, _0.si, _0_CheapBastard_0.dvdm, _0.fnm, _0_Lucene41WithOrds_0.doc, _0_TestBloomFilteredLucene41Postings_0.blm, _0.nvm, _0_Pulsing41_0.doc, _0_Pulsing41_0.pos, segments_2, _0_TestBloomFilteredLucene41Postings_0.doc, _0.fdx, _0_Pulsing41_1.doc, _0_Pulsing41_1.pos, _0.fdt]
[junit4:junit4] 2> 21499 T2449 C116 P22379 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/control/data
[junit4:junit4] 2> 21501 T2449 C116 P22379 oass.SolrIndexSearcher.<init> Opening Searcher@2bb64d41 main
[junit4:junit4] 2> 21502 T2449 C116 P22379 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 21502 T2463 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2bb64d41 main{StandardDirectoryReader(segments_2:3 _0(5.0):C1)}
[junit4:junit4] 2> 21503 T2463 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/control/data/index
[junit4:junit4] 2> 21503 T2449 C116 P22379 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 10
[junit4:junit4] 2> 21506 T2475 C114 P57232 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 21518 T2475 C114 P57232 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@23a4d690 lockFactory=org.apache.lucene.store.NativeFSLockFactory@47dae062),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@23a4d690 lockFactory=org.apache.lucene.store.NativeFSLockFactory@47dae062),segFN=segments_3,generation=3,filenames=[_0_Lucene41WithOrds_0.tib, _0_TestBloomFilteredLucene41Postings_0.tim, _0_Lucene41WithOrds_0.tii, _0_Pulsing41_1.tip, _0_Lucene41WithOrds_0.pos, _0_TestBloomFilteredLucene41Postings_0.tip, _0_TestBloomFilteredLucene41Postings_0.pos, _0_Pulsing41_1.tim, _0_Pulsing41_0.tim, _0_Pulsing41_0.tip, _0.nvd, _0_CheapBastard_0.dvdd, _0.si, _0_CheapBastard_0.dvdm, _0.fnm, _0_Lucene41WithOrds_0.doc, _0_TestBloomFilteredLucene41Postings_0.blm, _0.nvm, _0_Pulsing41_0.doc, _0_Pulsing41_0.pos, _0_TestBloomFilteredLucene41Postings_0.doc, _0.fdx, _0_Pulsing41_1.doc, _0_Pulsing41_1.pos, _0.fdt, segments_3]
[junit4:junit4] 2> 21519 T2475 C114 P57232 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0_Lucene41WithOrds_0.tib, _0_TestBloomFilteredLucene41Postings_0.tim, _0_Lucene41WithOrds_0.tii, _0_Pulsing41_1.tip, _0_Lucene41WithOrds_0.pos, _0_TestBloomFilteredLucene41Postings_0.tip, _0_TestBloomFilteredLucene41Postings_0.pos, _0_Pulsing41_1.tim, _0_Pulsing41_0.tim, _0_Pulsing41_0.tip, _0.nvd, _0_CheapBastard_0.dvdd, _0.si, _0_CheapBastard_0.dvdm, _0.fnm, _0_Lucene41WithOrds_0.doc, _0_TestBloomFilteredLucene41Postings_0.blm, _0.nvm, _0_Pulsing41_0.doc, _0_Pulsing41_0.pos, _0_TestBloomFilteredLucene41Postings_0.doc, _0.fdx, _0_Pulsing41_1.doc, _0_Pulsing41_1.pos, _0.fdt, segments_3]
[junit4:junit4] 2> 21519 T2475 C114 P57232 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty1
[junit4:junit4] 2> 21521 T2475 C114 P57232 oass.SolrIndexSearcher.<init> Opening Searcher@27427af2 main
[junit4:junit4] 2> 21521 T2475 C114 P57232 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty1/index
[junit4:junit4] 2> 21522 T2475 C114 P57232 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 21523 T2481 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@27427af2 main{StandardDirectoryReader(segments_3:3:nrt _0(5.0):C1)}
[junit4:junit4] 2> 21523 T2481 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty1/index
[junit4:junit4] 2> 21524 T2475 C114 P57232 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:51029/collection1/, StdNode: http://127.0.0.1:50008/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 21526 T2501 C113 P51029 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> ASYNC NEW_CORE C117 name=collection1 org.apache.solr.core.SolrCore@7cd8217a url=http://127.0.0.1:50008/collection1 node=127.0.0.1:50008_ C117_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:50008_, base_url=http://127.0.0.1:50008, leader=true}
[junit4:junit4] 2> 21532 T2487 C117 P50008 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 21533 T2487 C117 P50008 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty2
[junit4:junit4] 2> 21535 T2487 C117 P50008 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits:num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@788c8575 lockFactory=org.apache.lucene.store.NativeFSLockFactory@422f7845),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> 21535 T2487 C117 P50008 oasc.SolrDeletionPolicy.updateCommits newest commit = 1[segments_1]
[junit4:junit4] 2> 21536 T2487 C117 P50008 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@788c8575 lockFactory=org.apache.lucene.store.NativeFSLockFactory@422f7845),segFN=segments_1,generation=1,filenames=[segments_1]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@788c8575 lockFactory=org.apache.lucene.store.NativeFSLockFactory@422f7845),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> 21537 T2487 C117 P50008 oasc.SolrDeletionPolicy.updateCommits newest commit = 2[segments_2]
[junit4:junit4] 2> 21537 T2501 C113 P51029 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2193be98 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6cbf8763),segFN=segments_2,generation=2,filenames=[segments_2]
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@2193be98 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6cbf8763),segFN=segments_3,generation=3,filenames=[_0_Lucene41WithOrds_0.tib, _0_TestBloomFilteredLucene41Postings_0.tim, _0_Lucene41WithOrds_0.tii, _0_Pulsing41_1.tip, _0_Lucene41WithOrds_0.pos, _0_TestBloomFilteredLucene41Postings_0.tip, _0_TestBloomFilteredLucene41Postings_0.pos, _0_Pulsing41_1.tim, _0_Pulsing41_0.tim, _0_Pulsing41_0.tip, _0.nvd, _0_CheapBastard_0.dvdd, _0.si, _0_CheapBastard_0.dvdm, _0.fnm, _0_Lucene41WithOrds_0.doc, _0_TestBloomFilteredLucene41Postings_0.blm, _0.nvm, _0_Pulsing41_0.doc, _0_Pulsing41_0.pos, _0_TestBloomFilteredLucene41Postings_0.doc, _0.fdx, _0_Pulsing41_1.doc, _0_Pulsing41_1.pos, _0.fdt, segments_3]
[junit4:junit4] 2> 21538 T2487 C117 P50008 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty2
[junit4:junit4] 2> 21538 T2501 C113 P51029 oasc.SolrDeletionPolicy.updateCommits newest commit = 3[_0_Lucene41WithOrds_0.tib, _0_TestBloomFilteredLucene41Postings_0.tim, _0_Lucene41WithOrds_0.tii, _0_Pulsing41_1.tip, _0_Lucene41WithOrds_0.pos, _0_TestBloomFilteredLucene41Postings_0.tip, _0_TestBloomFilteredLucene41Postings_0.pos, _0_Pulsing41_1.tim, _0_Pulsing41_0.tim, _0_Pulsing41_0.tip, _0.nvd, _0_CheapBastard_0.dvdd, _0.si, _0_CheapBastard_0.dvdm, _0.fnm, _0_Lucene41WithOrds_0.doc, _0_TestBloomFilteredLucene41Postings_0.blm, _0.nvm, _0_Pulsing41_0.doc, _0_Pulsing41_0.pos, _0_TestBloomFilteredLucene41Postings_0.doc, _0.fdx, _0_Pulsing41_1.doc, _0_Pulsing41_1.pos, _0.fdt, segments_3]
[junit4:junit4] 2> 21538 T2487 C117 P50008 oass.SolrIndexSearcher.<init> Opening Searcher@2c467f96 main
[junit4:junit4] 2> 21539 T2501 C113 P51029 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty3
[junit4:junit4] 2> 21539 T2487 C117 P50008 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 21540 T2497 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2c467f96 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 21540 T2497 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty2/index
[junit4:junit4] 2> 21540 T2487 C117 P50008 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 8
[junit4:junit4] 2> 21541 T2501 C113 P51029 oass.SolrIndexSearcher.<init> Opening Searcher@6934e052 main
[junit4:junit4] 2> 21542 T2501 C113 P51029 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 21542 T2513 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6934e052 main{StandardDirectoryReader(segments_3:3:nrt _0(5.0):C1)}
[junit4:junit4] 2> 21543 T2513 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-1362468504124/jetty3/index
[junit4:junit4] 2> 21543 T2501 C113 P51029 /update {waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 17
[junit4:junit4] 2> 21543 T2475 C114 P57232 /update {waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 37
[junit4:junit4] 2> 21544 T2437 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 21545 T2437 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 21546 T2437 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> 21548 T2449 C116 P22379 REQ /select {q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=0
[junit4:junit4] 2> 21549 T2437 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:29817/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@e735d74
[junit4:junit4] 2> 21550 T2437 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 21551 T2522 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost/127.0.0.1:29817. Will not attempt to authenticate using SASL (access denied (javax.security.auth.AuthPermission getLoginConfiguration))
[junit4:junit4] 2> 21551 T2522 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost/127.0.0.1:29817, initiating session
[junit4:junit4] 2> 21551 T2439 oazs.NIOServerCnxnFactory.run Accepted socket connection from /140.211.11.196:45984
[junit4:junit4] 2> 21551 T2439 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /140.211.11.196:45984
[junit4:junit4] 2> 21553 T2441 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d39738244000b with negotiated timeout 10000 for client /140.211.11.196:45984
[junit4:junit4] 2> 21553 T2522 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost/127.0.0.1:29817, sessionid = 0x13d39738244000b, negotiated timeout = 10000
[junit4:junit4] 2> 21553 T2523 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e735d74 name:ZooKeeperConnection Watcher:127.0.0.1:29817/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 21553 T2437 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 21554 T2437 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 21556 T2442 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d39738244000b
[junit4:junit4] 2> 21556 T2523 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 21556 T2439 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:45984 which had sessionid 0x13d39738244000b
[junit4:junit4] 2> 21556 T2437 oaz.ZooKeeper.close Session: 0x13d39738244000b closed
[junit4:junit4] 2> 21559 T2469 C114 P57232 REQ /select {q=*:*&distrib=false&wt=javabin&version=2} hits=1 status=0 QTime=1
[junit4:junit4] 2> 21560 T2488 C117 P50008 REQ /select {q=*:*&distrib=false&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4:junit4] 2> 21565 T2489 C117 P50008 REQ /select {NOW=1362468525681&shard.url=127.0.0.1:50008/collection1/&fl=id,score&start=0&q=*:*&distrib=false&wt=javabin&isShard=true&fsv=true&version=2&rows=10} hits=0 status=0 QTime=0
[junit4:junit4] 2> 21565 T2472 C114 P57232 REQ /select {NOW=1362468525681&shard.url=127.0.0.1:57232/collection1/|127.0.0.1:51029/collection1/&fl=id,score&start=0&q=*:*&distrib=false&wt=javabin&isShard=true&fsv=true&version=2&rows=10} hits=1 status=0 QTime=0
[junit4:junit4] 2> 21568 T2472 C114 P57232 REQ /select {NOW=1362468525681&shard.url=127.0.0.1:57232/collection1/|127.0.0.1:51029/collection1/&ids=1&q=*:*&distrib=false&wt=javabin&isShard=true&version=2} status=0 QTime=0
[junit4:junit4] 2> 21569 T2502 C113 P51029 REQ /select {q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=7
[junit4:junit4] 2> 21574 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[2 (1428651796794966016)]} 0 2
[junit4:junit4] 2> 21584 T2487 C117 P50008 /update {distrib.from=http://127.0.0.1:57232/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[2 (1428651796803354624)]} 0 4
[junit4:junit4] 2> 21585 T2475 C114 P57232 /update {wt=javabin&version=2} {add=[2]} 0 8
[junit4:junit4] 2> 21588 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[3 (1428651796810694656)]} 0 1
[junit4:junit4] 2> 21591 T2490 C117 P50008 /update {wt=javabin&version=2} {add=[3 (1428651796813840384)]} 0 1
[junit4:junit4] 2> 21595 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[4 (1428651796818034688)]} 0 1
[junit4:junit4] 2> 21607 T2501 C113 P51029 /update {distrib.from=http://127.0.0.1:57232/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[4 (1428651796824326144)]} 0 2
[junit4:junit4] 2> 21608 T2527 C114 P57232 /update {distrib.from=http://127.0.0.1:50008/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[4 (1428651796824326144)]} 0 8
[junit4:junit4] 2> 21608 T2490 C117 P50008 /update {wt=javabin&version=2} {add=[4]} 0 10
[junit4:junit4] 2> 21612 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[5 (1428651796835860480)]} 0 1
[junit4:junit4] 2> 21620 T2487 C117 P50008 /update {distrib.from=http://127.0.0.1:57232/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[5 (1428651796843200512)]} 0 2
[junit4:junit4] 2> 21621 T2475 C114 P57232 /update {wt=javabin&version=2} {add=[5]} 0 6
[junit4:junit4] 2> 21625 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[6 (1428651796849491968)]} 0 1
[junit4:junit4] 2> 21629 T2490 C117 P50008 /update {wt=javabin&version=2} {add=[6 (1428651796853686272)]} 0 1
[junit4:junit4] 2> 21633 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[7 (1428651796857880576)]} 0 1
[junit4:junit4] 2> 21637 T2490 C117 P50008 /update {wt=javabin&version=2} {add=[7 (1428651796862074880)]} 0 1
[junit4:junit4] 2> 21641 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[8 (1428651796866269184)]} 0 1
[junit4:junit4] 2> 21650 T2501 C113 P51029 /update {distrib.from=http://127.0.0.1:57232/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[8 (1428651796872560640)]} 0 1
[junit4:junit4] 2> 21651 T2527 C114 P57232 /update {distrib.from=http://127.0.0.1:50008/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[8 (1428651796872560640)]} 0 5
[junit4:junit4] 2> 21651 T2490 C117 P50008 /update {wt=javabin&version=2} {add=[8]} 0 7
[junit4:junit4] 2> 21656 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[9 (1428651796880949248)]} 0 2
[junit4:junit4] 2> 21659 T2490 C117 P50008 /update {wt=javabin&version=2} {add=[9 (1428651796885143552)]} 0 1
[junit4:junit4] 2> 21663 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[10 (1428651796889337856)]} 0 1
[junit4:junit4] 2> 21671 T2501 C113 P51029 /update {distrib.from=http://127.0.0.1:57232/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10 (1428651796893532160)]} 0 1
[junit4:junit4] 2> 21672 T2475 C114 P57232 /update {wt=javabin&version=2} {add=[10 (1428651796893532160)]} 0 6
[junit4:junit4] 2> 21676 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[11 (1428651796902969344)]} 0 1
[junit4:junit4] 2> 21686 T2501 C113 P51029 /update {distrib.from=http://127.0.0.1:57232/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[11 (1428651796909260800)]} 0 1
[junit4:junit4] 2> 21687 T2527 C114 P57232 /update {distrib.from=http://127.0.0.1:50008/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[11 (1428651796909260800)]} 0 6
[junit4:junit4] 2> 21687 T2490 C117 P50008 /update {wt=javabin&version=2} {add=[11]} 0 8
[junit4:junit4] 2> 21692 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[12 (1428651796918697984)]} 0 2
[junit4:junit4] 2> 21700 T2501 C113 P51029 /update {distrib.from=http://127.0.0.1:57232/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[12 (1428651796923940864)]} 0 1
[junit4:junit4] 2> 21701 T2475 C114 P57232 /update {wt=javabin&version=2} {add=[12 (1428651796923940864)]} 0 6
[junit4:junit4] 2> 21706 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[13 (1428651796933378048)]} 0 2
[junit4:junit4] 2> 21714 T2501 C113 P51029 /update {distrib.from=http://127.0.0.1:57232/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[13 (1428651796938620928)]} 0 1
[junit4:junit4] 2> 21715 T2475 C114 P57232 /update {wt=javabin&version=2} {add=[13 (1428651796938620928)]} 0 6
[junit4:junit4] 2> 21720 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[14 (1428651796948058112)]} 0 2
[junit4:junit4] 2> 21729 T2501 C113 P51029 /update {distrib.from=http://127.0.0.1:57232/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[14 (1428651796955398144)]} 0 1
[junit4:junit4] 2> 21730 T2527 C114 P57232 /update {distrib.from=http://127.0.0.1:50008/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[14 (1428651796955398144)]} 0 5
[junit4:junit4] 2> 21730 T2490 C117 P50008 /update {wt=javabin&version=2} {add=[14]} 0 7
[junit4:junit4] 2> 21735 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[15 (1428651796963786752)]} 0 2
[junit4:junit4] 2> 21744 T2501 C113 P51029 /update {distrib.from=http://127.0.0.1:57232/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[15 (1428651796971126784)]} 0 1
[junit4:junit4] 2> 21744 T2527 C114 P57232 /update {distrib.from=http://127.0.0.1:50008/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[15 (1428651796971126784)]} 0 4
[junit4:junit4] 2> 21745 T2490 C117 P50008 /update {wt=javabin&version=2} {add=[15]} 0 7
[junit4:junit4] 2> 21750 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[16 (1428651796979515392)]} 0 2
[junit4:junit4] 2> 21759 T2501 C113 P51029 /update {distrib.from=http://127.0.0.1:57232/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[16 (1428651796986855424)]} 0 1
[junit4:junit4] 2> 21759 T2527 C114 P57232 /update {distrib.from=http://127.0.0.1:50008/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[16 (1428651796986855424)]} 0 4
[junit4:junit4] 2> 21760 T2490 C117 P50008 /update {wt=javabin&version=2} {add=[16]} 0 7
[junit4:junit4] 2> 21766 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[17 (1428651796995244032)]} 0 3
[junit4:junit4] 2> 21775 T2487 C117 P50008 /update {distrib.from=http://127.0.0.1:57232/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[17 (1428651797004681216)]} 0 3
[junit4:junit4] 2> 21776 T2475 C114 P57232 /update {wt=javabin&version=2} {add=[17]} 0 7
[junit4:junit4] 2> 21780 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[100 (1428651797012021248)]} 0 1
[junit4:junit4] 2> 21788 T2501 C113 P51029 /update {distrib.from=http://127.0.0.1:57232/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[100 (1428651797016215552)]} 0 1
[junit4:junit4] 2> 21789 T2475 C114 P57232 /update {wt=javabin&version=2} {add=[100 (1428651797016215552)]} 0 6
[junit4:junit4] 2> 21793 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[101 (1428651797025652736)]} 0 1
[junit4:junit4] 2> 21801 T2501 C113 P51029 /update {distrib.from=http://127.0.0.1:57232/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[101 (1428651797030895616)]} 0 1
[junit4:junit4] 2> 21801 T2527 C114 P57232 /update {distrib.from=http://127.0.0.1:50008/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[101 (1428651797030895616)]} 0 4
[junit4:junit4] 2> 21802 T2490 C117 P50008 /update {wt=javabin&version=2} {add=[101]} 0 7
[junit4:junit4] 2> 21806 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[102 (1428651797039284224)]} 0 1
[junit4:junit4] 2> 21814 T2501 C113 P51029 /update {distrib.from=http://127.0.0.1:57232/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[102 (1428651797044527104)]} 0 1
[junit4:junit4] 2> 21815 T2527 C114 P57232 /update {distrib.from=http://127.0.0.1:50008/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[102 (1428651797044527104)]} 0 5
[junit4:junit4] 2> 21816 T2490 C117 P50008 /update {wt=javabin&version=2} {add=[102]} 0 8
[junit4:junit4] 2> 21820 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[103 (1428651797053964288)]} 0 1
[junit4:junit4] 2> 21824 T2490 C117 P50008 /update {wt=javabin&version=2} {add=[103 (1428651797058158592)]} 0 1
[junit4:junit4] 2> 21828 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[104 (1428651797062352896)]} 0 1
[junit4:junit4] 2> 21832 T2490 C117 P50008 /update {wt=javabin&version=2} {add=[104 (1428651797066547200)]} 0 1
[junit4:junit4] 2> 21836 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[105 (1428651797070741504)]} 0 1
[junit4:junit4] 2> 21840 T2490 C117 P50008 /update {wt=javabin&version=2} {add=[105 (1428651797074935808)]} 0 1
[junit4:junit4] 2> 21844 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[106 (1428651797079130112)]} 0 1
[junit4:junit4] 2> 21851 T2487 C117 P50008 /update {distrib.from=http://127.0.0.1:57232/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[106 (1428651797086470144)]} 0 1
[junit4:junit4] 2> 21852 T2475 C114 P57232 /update {wt=javabin&version=2} {add=[106]} 0 5
[junit4:junit4] 2> 21856 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[107 (1428651797091713024)]} 0 1
[junit4:junit4] 2> 21865 T2501 C113 P51029 /update {distrib.from=http://127.0.0.1:57232/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[107 (1428651797098004480)]} 0 1
[junit4:junit4] 2> 21866 T2527 C114 P57232 /update {distrib.from=http://127.0.0.1:50008/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[107 (1428651797098004480)]} 0 5
[junit4:junit4] 2> 21866 T2490 C117 P50008 /update {wt=javabin&version=2} {add=[107]} 0 7
[junit4:junit4] 2> 21871 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[108 (1428651797106393088)]} 0 2
[junit4:junit4] 2> 21877 T2501 C113 P51029 /update {distrib.from=http://127.0.0.1:57232/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[108 (1428651797110587392)]} 0 1
[junit4:junit4] 2> 21878 T2475 C114 P57232 /update {wt=javabin&version=2} {add=[108 (1428651797110587392)]} 0 5
[junit4:junit4] 2> 21881 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[109 (1428651797117927424)]} 0 1
[junit4:junit4] 2> 21888 T2501 C113 P51029 /update {distrib.from=http://127.0.0.1:57232/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[109 (1428651797122121728)]} 0 1
[junit4:junit4] 2> 21889 T2475 C114 P57232 /update {wt=javabin&version=2} {add=[109 (1428651797122121728)]} 0 5
[junit4:junit4] 2> 21892 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[110 (1428651797129461760)]} 0 1
[junit4:junit4] 2> 21899 T2501 C113 P51029 /update {distrib.from=http://127.0.0.1:57232/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[110 (1428651797133656064)]} 0 1
[junit4:junit4] 2> 21900 T2475 C114 P57232 /update {wt=javabin&version=2} {add=[110 (1428651797133656064)]} 0 5
[junit4:junit4] 2> 21903 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[111 (1428651797140996096)]} 0 1
[junit4:junit4] 2> 21912 T2501 C113 P51029 /update {distrib.from=http://127.0.0.1:57232/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[111 (1428651797147287552)]} 0 1
[junit4:junit4] 2> 21913 T2527 C114 P57232 /update {distrib.from=http://127.0.0.1:50008/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[111 (1428651797147287552)]} 0 5
[junit4:junit4] 2> 21913 T2490 C117 P50008 /update {wt=javabin&version=2} {add=[111]} 0 7
[junit4:junit4] 2> 21917 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[112 (1428651797155676160)]} 0 1
[junit4:junit4] 2> 21921 T2490 C117 P50008 /update {wt=javabin&version=2} {add=[112 (1428651797159870464)]} 0 1
[junit4:junit4] 2> 21927 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[113 (1428651797166161920)]} 0 2
[junit4:junit4] 2> 21937 T2501 C113 P51029 /update {distrib.from=http://127.0.0.1:57232/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[113 (1428651797172453376)]} 0 1
[junit4:junit4] 2> 21938 T2527 C114 P57232 /update {distrib.from=http://127.0.0.1:50008/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[113 (1428651797172453376)]} 0 6
[junit4:junit4] 2> 21938 T2490 C117 P50008 /update {wt=javabin&version=2} {add=[113]} 0 8
[junit4:junit4] 2> 21942 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[114 (1428651797181890560)]} 0 1
[junit4:junit4] 2> 21952 T2501 C113 P51029 /update {distrib.from=http://127.0.0.1:57232/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[114 (1428651797188182016)]} 0 1
[junit4:junit4] 2> 21953 T2527 C114 P57232 /update {distrib.from=http://127.0.0.1:50008/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[114 (1428651797188182016)]} 0 6
[junit4:junit4] 2> 21953 T2490 C117 P50008 /update {wt=javabin&version=2} {add=[114]} 0 8
[junit4:junit4] 2> 21957 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[115 (1428651797197619200)]} 0 1
[junit4:junit4] 2> 21961 T2490 C117 P50008 /update {wt=javabin&version=2} {add=[115 (1428651797201813504)]} 0 1
[junit4:junit4] 2> 21965 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[116 (1428651797206007808)]} 0 1
[junit4:junit4] 2> 21971 T2487 C117 P50008 /update {distrib.from=http://127.0.0.1:57232/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[116 (1428651797212299264)]} 0 1
[junit4:junit4] 2> 21972 T2475 C114 P57232 /update {wt=javabin&version=2} {add=[116]} 0 4
[junit4:junit4] 2> 21975 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[117 (1428651797216493568)]} 0 1
[junit4:junit4] 2> 21981 T2487 C117 P50008 /update {distrib.from=http://127.0.0.1:57232/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[117 (1428651797222785024)]} 0 1
[junit4:junit4] 2> 21982 T2475 C114 P57232 /update {wt=javabin&version=2} {add=[117]} 0 4
[junit4:junit4] 2> 21985 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[118 (1428651797226979328)]} 0 1
[junit4:junit4] 2> 21992 T2501 C113 P51029 /update {distrib.from=http://127.0.0.1:57232/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[118 (1428651797231173632)]} 0 1
[junit4:junit4] 2> 21993 T2475 C114 P57232 /update {wt=javabin&version=2} {add=[118 (1428651797231173632)]} 0 5
[junit4:junit4] 2> 21996 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[119 (1428651797238513664)]} 0 1
[junit4:junit4] 2> 22000 T2490 C117 P50008 /update {wt=javabin&version=2} {add=[119 (1428651797242707968)]} 0 1
[junit4:junit4] 2> 22004 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[120 (1428651797246902272)]} 0 1
[junit4:junit4] 2> 22010 T2487 C117 P50008 /update {distrib.from=http://127.0.0.1:57232/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[120 (1428651797253193728)]} 0 1
[junit4:junit4] 2> 22011 T2475 C114 P57232 /update {wt=javabin&version=2} {add=[120]} 0 4
[junit4:junit4] 2> 22014 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[121 (1428651797257388032)]} 0 1
[junit4:junit4] 2> 22020 T2487 C117 P50008 /update {distrib.from=http://127.0.0.1:57232/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[121 (1428651797263679488)]} 0 1
[junit4:junit4] 2> 22021 T2475 C114 P57232 /update {wt=javabin&version=2} {add=[121]} 0 4
[junit4:junit4] 2> 22024 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[122 (1428651797267873792)]} 0 1
[junit4:junit4] 2> 22031 T2501 C113 P51029 /update {distrib.from=http://127.0.0.1:57232/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[122 (1428651797272068096)]} 0 1
[junit4:junit4] 2> 22032 T2475 C114 P57232 /update {wt=javabin&version=2} {add=[122 (1428651797272068096)]} 0 5
[junit4:junit4] 2> 22035 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[123 (1428651797279408128)]} 0 1
[junit4:junit4] 2> 22044 T2501 C113 P51029 /update {distrib.from=http://127.0.0.1:57232/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[123 (1428651797285699584)]} 0 1
[junit4:junit4] 2> 22045 T2527 C114 P57232 /update {distrib.from=http://127.0.0.1:50008/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[123 (1428651797285699584)]} 0 5
[junit4:junit4] 2> 22045 T2490 C117 P50008 /update {wt=javabin&version=2} {add=[123]} 0 7
[junit4:junit4] 2> 22049 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[124 (1428651797294088192)]} 0 1
[junit4:junit4] 2> 22056 T2501 C113 P51029 /update {distrib.from=http://127.0.0.1:57232/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[124 (1428651797298282496)]} 0 1
[junit4:junit4] 2> 22057 T2475 C114 P57232 /update {wt=javabin&version=2} {add=[124 (1428651797298282496)]} 0 5
[junit4:junit4] 2> 22060 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[125 (1428651797305622528)]} 0 1
[junit4:junit4] 2> 22069 T2501 C113 P51029 /update {distrib.from=http://127.0.0.1:57232/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[125 (1428651797311913984)]} 0 1
[junit4:junit4] 2> 22069 T2527 C114 P57232 /update {distrib.from=http://127.0.0.1:50008/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[125 (1428651797311913984)]} 0 4
[junit4:junit4] 2> 22070 T2490 C117 P50008 /update {wt=javabin&version=2} {add=[125]} 0 7
[junit4:junit4] 2> 22074 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[126 (1428651797320302592)]} 0 1
[junit4:junit4] 2> 22080 T2487 C117 P50008 /update {distrib.from=http://127.0.0.1:57232/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[126 (1428651797326594048)]} 0 1
[junit4:junit4] 2> 22081 T2475 C114 P57232 /update {wt=javabin&version=2} {add=[126]} 0 4
[junit4:junit4] 2> 22084 T2449 C116 P22379 /update {wt=javabin&version=2} {add=[127 (1428651797330788352)]} 0 1
[junit4:junit4] 2> 22090 T2487 C117 P50008 /update {distrib.from=http://127.0.0.1:57232/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[127 (1428651797337079808)]} 0 1
[junit4:junit4] 2> 22090 T2475 C114 P57232 /update {wt=javabin&version=2} {add=[127]} 0 3
[junit4
[...truncated too long message...]
Tests-trunk/solr/build/solr-core/test/J1/./OpenCloseCoreStressTest_/00004_core/data/index
[junit4:junit4] 2> 690297 T1584 oasc.SolrCore.close [00012_core] CLOSING SolrCore org.apache.solr.core.SolrCore@6877d5dd
[junit4:junit4] 2> 690300 T1584 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=6,autocommits=0,soft autocommits=5,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=193,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 690300 T1584 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 690300 T1584 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 690301 T1584 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 690302 T1584 C1776 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./OpenCloseCoreStressTest_/00012_core/data/index
[junit4:junit4] 2> 690302 T1584 oasc.SolrCore.closeSearcher [00012_core] Closing main searcher on request.
[junit4:junit4] 2> 690353 T1584 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./OpenCloseCoreStressTest_/00012_core/data/index
[junit4:junit4] 2> 690353 T1584 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./OpenCloseCoreStressTest_/00012_core/data/index
[junit4:junit4] 2> 690354 T1584 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./OpenCloseCoreStressTest_/00012_core/data/index
[junit4:junit4] 2> 690381 T1584 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./OpenCloseCoreStressTest_/00012_core/data
[junit4:junit4] 2> 690382 T1584 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./OpenCloseCoreStressTest_/00012_core/data
[junit4:junit4] 2> 690382 T1584 oasc.SolrCore.close [00006_core] CLOSING SolrCore org.apache.solr.core.SolrCore@758b8c68
[junit4:junit4] 2> 690384 T1584 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=6,autocommits=0,soft autocommits=5,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=182,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 690385 T1584 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 690385 T1584 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 690385 T1584 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 690386 T1584 C1777 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./OpenCloseCoreStressTest_/00006_core/data/index
[junit4:junit4] 2> 690387 T1584 oasc.SolrCore.closeSearcher [00006_core] Closing main searcher on request.
[junit4:junit4] 2> 690438 T1584 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./OpenCloseCoreStressTest_/00006_core/data/index
[junit4:junit4] 2> 690439 T1584 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./OpenCloseCoreStressTest_/00006_core/data
[junit4:junit4] 2> 690439 T1584 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./OpenCloseCoreStressTest_/00006_core/data
[junit4:junit4] 2> 690440 T1584 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./OpenCloseCoreStressTest_/00006_core/data/index
[junit4:junit4] 2> 690441 T1584 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./OpenCloseCoreStressTest_/00006_core/data/index
[junit4:junit4] 2> 690483 T1584 oasc.SolrCore.close [00008_core] CLOSING SolrCore org.apache.solr.core.SolrCore@691239b1
[junit4:junit4] 2> 690486 T1584 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=6,autocommits=0,soft autocommits=5,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=213,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 690487 T1584 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 690487 T1584 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 690487 T1584 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 690489 T1584 C1778 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./OpenCloseCoreStressTest_/00008_core/data/index
[junit4:junit4] 2> 690489 T1584 oasc.SolrCore.closeSearcher [00008_core] Closing main searcher on request.
[junit4:junit4] 2> 690490 T1584 oasc.CachingDirectoryFactory.close Releasing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./OpenCloseCoreStressTest_/00008_core/data/index
[junit4:junit4] 2> 690490 T1584 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./OpenCloseCoreStressTest_/00008_core/data/index
[junit4:junit4] 2> 690491 T1584 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./OpenCloseCoreStressTest_/00008_core/data/index
[junit4:junit4] 2> 690513 T1584 oasc.CachingDirectoryFactory.close Closing directory when closing factory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./OpenCloseCoreStressTest_/00008_core/data
[junit4:junit4] 2> 690513 T1584 oasc.CachingDirectoryFactory.closeDirectory Closing directory:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./OpenCloseCoreStressTest_/00008_core/data
[junit4:junit4] 2> 690514 T1584 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4:junit4] 2> 690933 T1584 oas.SolrTestCaseJ4.tearDown ###Ending test30SecondsOld
[junit4:junit4] 2> 690935 T1584 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> NOTE: test params are: codec=Lucene41, sim=DefaultSimilarity, locale=ar_TN, timezone=America/Argentina/Ushuaia
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Sun Microsystems Inc. 1.6.0_32 (64-bit)/cpus=16,threads=1,free=208247736,total=525664256
[junit4:junit4] 2> NOTE: All tests run in this JVM: [SpellCheckCollatorTest, TestLuceneMatchVersion, SuggesterWFSTTest, SuggesterTSTTest, TestArbitraryIndexDir, DistanceFunctionTest, TestSolrXMLSerializer, NoCacheHeaderTest, TestUtils, SimplePostToolTest, TestFiltering, TestNumberUtils, SpellCheckComponentTest, TestStressReorder, TestSolrDiscoveryProperties, SolrCmdDistributorTest, TestAnalyzedSuggestions, TestLazyCores, HardAutoCommitTest, TestIndexSearcher, TestJmxMonitoredMap, DocValuesMultiTest, ConvertedLegacyTest, OpenExchangeRatesOrgProviderTest, TestRandomFaceting, ZkNodePropsTest, TestSolr4Spatial, TestDistributedSearch, TestCollationField, NumericFieldsTest, MultiTermTest, RequestHandlersTest, BasicZkTest, StatsComponentTest, OpenCloseCoreStressTest]
[junit4:junit4] Completed on J1 in 690.96s, 6 tests, 1 failure, 2 skipped <<< FAILURES!
[...truncated 489 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:388: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:361: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:183: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:449: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1213: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:877: There were test failures: 261 suites, 1105 tests, 1 error, 1 failure, 25 ignored (6 assumptions)
Total time: 100 minutes 9 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure