You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2013/04/29 03:38:51 UTC

[JENKINS] Lucene-Solr-Tests-trunk-java7 - Build # 3940 - Failure

Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-java7/3940/

All tests passed

Build Log:
[...truncated 33618 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:378: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:317: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/extra-targets.xml:120: The following files are missing svn:eol-style (or binary svn:mime-type):
* solr/example/solr/collection1/conf/velocity/README.txt
* solr/example/solr/collection1/conf/velocity/error.vm
* solr/example/solr/collection1/conf/velocity/hit_plain.vm
* solr/example/solr/collection1/conf/velocity/mime_type_lists.vm
* solr/example/solr/collection1/conf/velocity/pagination_bottom.vm
* solr/example/solr/collection1/conf/velocity/pagination_top.vm
* solr/example/solr/collection1/conf/velocity/query_form.vm
* solr/example/solr/collection1/conf/velocity/results_list.vm

Total time: 69 minutes 15 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



Re: [JENKINS] Lucene-Solr-Tests-trunk-java7 - Build # 3943 - Still Failing

Posted by Robert Muir <rc...@gmail.com>.
I committed a fix for this.

On Mon, Apr 29, 2013 at 6:51 PM, Robert Muir <rc...@gmail.com> wrote:

> There is a constant for that purpose... It should be used here. I recently
> changed this test to use newsearcher which randomizes the sim. If it gets
> certain term freq normalizations they can result in large values
>  On Apr 29, 2013 5:03 PM, "Michael McCandless" <lu...@mikemccandless.com>
> wrote:
>
>> This failure reproduces ... it could be we need to increase the
>> allowed float difference in the compare?  TEST_SCORE_TOLERANCE_DELTA =
>> 0.001f now ... really that iota should be relative not absolute (these
>> scores a biggish: 17448.736328125 vs 17448.734375
>>
>> Mike McCandless
>>
>> http://blog.mikemccandless.com
>>
>>
>> On Mon, Apr 29, 2013 at 7:40 PM, Apache Jenkins Server
>> <je...@builds.apache.org> wrote:
>> > Build:
>> https://builds.apache.org/job/Lucene-Solr-Tests-trunk-java7/3943/
>> >
>> > 2 tests failed.
>> > REGRESSION:
>>  org.apache.lucene.queries.TestCustomScoreQuery.testCustomScoreFloat
>> >
>> > Error Message:
>> > new score for custom mul expected:<17448.736328125> but
>> was:<17448.734375>
>> >
>> > Stack Trace:
>> > java.lang.AssertionError: new score for custom mul
>> expected:<17448.736328125> but was:<17448.734375>
>> >         at
>> __randomizedtesting.SeedInfo.seed([A8CEAAB4EF38E076:B5301295BCB5C5B]:0)
>> >         at org.junit.Assert.fail(Assert.java:93)
>> >         at org.junit.Assert.failNotEquals(Assert.java:647)
>> >         at org.junit.Assert.assertEquals(Assert.java:443)
>> >         at
>> org.apache.lucene.queries.TestCustomScoreQuery.verifyResults(TestCustomScoreQuery.java:344)
>> >         at
>> org.apache.lucene.queries.TestCustomScoreQuery.doTestCustomScore(TestCustomScoreQuery.java:302)
>> >         at
>> org.apache.lucene.queries.TestCustomScoreQuery.testCustomScoreFloat(TestCustomScoreQuery.java:94)
>> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> >         at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>> >         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> >         at java.lang.reflect.Method.invoke(Method.java:601)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
>> >         at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>> >         at
>> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
>> >         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>> >         at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>> >         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
>> >         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>> >         at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> >         at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>> >         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>> >         at java.lang.Thread.run(Thread.java:722)
>> >
>> >
>> > FAILED:
>>  junit.framework.TestSuite.org.apache.lucene.queries.TestCustomScoreQuery
>> >
>> > Error Message:
>> > MockDirectoryWrapper: cannot close: there are still open files:
>> {_1_TestBloomFilteredLucene41Postings_0.pos=1,
>> _3_TestBloomFilteredLucene41Postings_0.tim=1, _2_Asserting_0.pos=1,
>> _0_TestBloomFilteredLucene41Postings_0.tim=1, _3.fdt=1,
>> _0_TestBloomFilteredLucene41Postings_0.pos=1, _1_MockRandom_0.pos=1,
>> _4.cfs=12, _1_Asserting_0.tim=1, _0_Asserting_0.doc=1,
>> _1_Asserting_0.pos=1, _8.cfs=12, _2.fdt=1,
>> _1_TestBloomFilteredLucene41Postings_0.doc=1, _2.fdx=1, _1.fdx=1,
>> _2_Asserting_0.tim=1, _1_MockRandom_0.tib=1, _1.fdt=1,
>> _0_MockRandom_0.doc=1, _3_MockRandom_0.tim=1,
>> _2_TestBloomFilteredLucene41Postings_0.pos=1, _0_MockRandom_0.pos=1,
>> _1_MockRandom_0.doc=1, _2_TestBloomFilteredLucene41Postings_0.tim=1,
>> _0_Asserting_0.tim=1, _1_TestBloomFilteredLucene41Postings_0.tim=1,
>> _1_Asserting_0.doc=1, _2_MockRandom_0.tim=1, _3_MockRandom_0.doc=1,
>> _3_TestBloomFilteredLucene41Postings_0.pos=1, _5.cfs=15,
>> _3_Asserting_0.pos=1, _2_Asserting_0.doc=1, _2_MockRandom_0.pos=1,
>> _2_TestBloomFilteredLucene41Postings_0.doc=1,
>> _3_TestBloomFilteredLucene41Postings_0.doc=1, _3.fdx=1, _6.cfs=15,
>> _3_Asserting_0.tim=1, _3_Asserting_0.doc=1,
>> _0_TestBloomFilteredLucene41Postings_0.doc=1, _0.fdx=1, _7.cfs=12,
>> _0_Asserting_0.pos=1, _0_MockRandom_0.tim=1, _2_MockRandom_0.doc=1,
>> _3_MockRandom_0.pos=1, _0.fdt=1}
>> >
>> > Stack Trace:
>> > java.lang.RuntimeException: MockDirectoryWrapper: cannot close: there
>> are still open files: {_1_TestBloomFilteredLucene41Postings_0.pos=1,
>> _3_TestBloomFilteredLucene41Postings_0.tim=1, _2_Asserting_0.pos=1,
>> _0_TestBloomFilteredLucene41Postings_0.tim=1, _3.fdt=1,
>> _0_TestBloomFilteredLucene41Postings_0.pos=1, _1_MockRandom_0.pos=1,
>> _4.cfs=12, _1_Asserting_0.tim=1, _0_Asserting_0.doc=1,
>> _1_Asserting_0.pos=1, _8.cfs=12, _2.fdt=1,
>> _1_TestBloomFilteredLucene41Postings_0.doc=1, _2.fdx=1, _1.fdx=1,
>> _2_Asserting_0.tim=1, _1_MockRandom_0.tib=1, _1.fdt=1,
>> _0_MockRandom_0.doc=1, _3_MockRandom_0.tim=1,
>> _2_TestBloomFilteredLucene41Postings_0.pos=1, _0_MockRandom_0.pos=1,
>> _1_MockRandom_0.doc=1, _2_TestBloomFilteredLucene41Postings_0.tim=1,
>> _0_Asserting_0.tim=1, _1_TestBloomFilteredLucene41Postings_0.tim=1,
>> _1_Asserting_0.doc=1, _2_MockRandom_0.tim=1, _3_MockRandom_0.doc=1,
>> _3_TestBloomFilteredLucene41Postings_0.pos=1, _5.cfs=15,
>> _3_Asserting_0.pos=1, _2_Asserting_0.doc=1, _2_MockRandom_0.pos=1,
>> _2_TestBloomFilteredLucene41Postings_0.doc=1,
>> _3_TestBloomFilteredLucene41Postings_0.doc=1, _3.fdx=1, _6.cfs=15,
>> _3_Asserting_0.tim=1, _3_Asserting_0.doc=1,
>> _0_TestBloomFilteredLucene41Postings_0.doc=1, _0.fdx=1, _7.cfs=12,
>> _0_Asserting_0.pos=1, _0_MockRandom_0.tim=1, _2_MockRandom_0.doc=1,
>> _3_MockRandom_0.pos=1, _0.fdt=1}
>> >         at __randomizedtesting.SeedInfo.seed([A8CEAAB4EF38E076]:0)
>> >         at
>> org.apache.lucene.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:621)
>> >         at
>> org.apache.lucene.queries.function.FunctionTestSetup.afterClassFunctionTestSetup(FunctionTestSetup.java:84)
>> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> >         at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>> >         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> >         at java.lang.reflect.Method.invoke(Method.java:601)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
>> >         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>> >         at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> >         at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>> >         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>> >         at java.lang.Thread.run(Thread.java:722)
>> > Caused by: java.lang.RuntimeException: unclosed IndexInput: _7.cfs
>> >         at
>> org.apache.lucene.store.MockDirectoryWrapper.addFileHandle(MockDirectoryWrapper.java:510)
>> >         at
>> org.apache.lucene.store.MockDirectoryWrapper$1.openSlice(MockDirectoryWrapper.java:929)
>> >         at
>> org.apache.lucene.store.CompoundFileDirectory.openInput(CompoundFileDirectory.java:186)
>> >         at
>> org.apache.lucene.codecs.compressing.CompressingStoredFieldsReader.<init>(CompressingStoredFieldsReader.java:98)
>> >         at
>> org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsReader(CompressingStoredFieldsFormat.java:113)
>> >         at
>> org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:147)
>> >         at
>> org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:56)
>> >         at
>> org.apache.lucene.index.StandardDirectoryReader$1.doBody(StandardDirectoryReader.java:62)
>> >         at
>> org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:668)
>> >         at
>> org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:52)
>> >         at
>> org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:66)
>> >         at
>> org.apache.lucene.queries.TestCustomScoreQuery.doTestCustomScore(TestCustomScoreQuery.java:250)
>> >         at
>> org.apache.lucene.queries.TestCustomScoreQuery.testCustomScoreFloat(TestCustomScoreQuery.java:94)
>> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> >         at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>> >         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> >         at java.lang.reflect.Method.invoke(Method.java:601)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
>> >         at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>> >         at
>> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
>> >         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>> >         at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
>> >         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>> >         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>> >         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
>> >         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
>> >         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
>> >         ... 13 more
>> >
>> >
>> >
>> >
>> > Build Log:
>> > [...truncated 7579 lines...]
>> > [junit4:junit4] Suite: org.apache.lucene.queries.TestCustomScoreQuery
>> > [junit4:junit4]   2> NOTE: reproduce with: ant test
>>  -Dtestcase=TestCustomScoreQuery -Dtests.method=testCustomScoreFloat
>> -Dtests.seed=A8CEAAB4EF38E076 -Dtests.multiplier=3 -Dtests.slow=true
>> -Dtests.locale=en_US -Dtests.timezone=America/Fortaleza
>> -Dtests.file.encoding=ISO-8859-1
>> > [junit4:junit4] FAILURE 1.05s J1 |
>> TestCustomScoreQuery.testCustomScoreFloat <<<
>> > [junit4:junit4]    > Throwable #1: java.lang.AssertionError: new score
>> for custom mul expected:<17448.736328125> but was:<17448.734375>
>> > [junit4:junit4]    >    at
>> __randomizedtesting.SeedInfo.seed([A8CEAAB4EF38E076:B5301295BCB5C5B]:0)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.queries.TestCustomScoreQuery.verifyResults(TestCustomScoreQuery.java:344)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.queries.TestCustomScoreQuery.doTestCustomScore(TestCustomScoreQuery.java:302)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.queries.TestCustomScoreQuery.testCustomScoreFloat(TestCustomScoreQuery.java:94)
>> > [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:722)
>> > [junit4:junit4]   2> NOTE: test params are: codec=Lucene42:
>> {id=PostingsFormat(name=Asserting),
>> text=PostingsFormat(name=TestBloomFilteredLucene41Postings),
>> fff=PostingsFormat(name=MockRandom),
>> iii=PostingsFormat(name=TestBloomFilteredLucene41Postings)}, docValues:{},
>> sim=RandomSimilarityProvider(queryNorm=true,coord=no): {text=DFR
>> G3(800.0)}, locale=en_US, timezone=America/Fortaleza
>> > [junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation
>> 1.7.0_17 (64-bit)/cpus=16,threads=1,free=41195792,total=122683392
>> > [junit4:junit4]   2> NOTE: All tests run in this JVM:
>> [TestFieldScoreQuery, TestBoostedQuery, BooleanFilterTest,
>> BoostingQueryTest, TestCustomScoreQuery]
>> > [junit4:junit4]   2> NOTE: reproduce with: ant test
>>  -Dtestcase=TestCustomScoreQuery -Dtests.seed=A8CEAAB4EF38E076
>> -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_US
>> -Dtests.timezone=America/Fortaleza -Dtests.file.encoding=ISO-8859-1
>> > [junit4:junit4] ERROR   0.00s J1 | TestCustomScoreQuery (suite) <<<
>> > [junit4:junit4]    > Throwable #1: java.lang.RuntimeException:
>> MockDirectoryWrapper: cannot close: there are still open files:
>> {_1_TestBloomFilteredLucene41Postings_0.pos=1,
>> _3_TestBloomFilteredLucene41Postings_0.tim=1, _2_Asserting_0.pos=1,
>> _0_TestBloomFilteredLucene41Postings_0.tim=1, _3.fdt=1,
>> _0_TestBloomFilteredLucene41Postings_0.pos=1, _1_MockRandom_0.pos=1,
>> _4.cfs=12, _1_Asserting_0.tim=1, _0_Asserting_0.doc=1,
>> _1_Asserting_0.pos=1, _8.cfs=12, _2.fdt=1,
>> _1_TestBloomFilteredLucene41Postings_0.doc=1, _2.fdx=1, _1.fdx=1,
>> _2_Asserting_0.tim=1, _1_MockRandom_0.tib=1, _1.fdt=1,
>> _0_MockRandom_0.doc=1, _3_MockRandom_0.tim=1,
>> _2_TestBloomFilteredLucene41Postings_0.pos=1, _0_MockRandom_0.pos=1,
>> _1_MockRandom_0.doc=1, _2_TestBloomFilteredLucene41Postings_0.tim=1,
>> _0_Asserting_0.tim=1, _1_TestBloomFilteredLucene41Postings_0.tim=1,
>> _1_Asserting_0.doc=1, _2_MockRandom_0.tim=1, _3_MockRandom_0.doc=1,
>> _3_TestBloomFilteredLucene41Postings_0.pos=1, _5.cfs=15,
>> _3_Asserting_0.pos=1, _2_Asserting_0.doc=1, _2_MockRandom_0.pos=1,
>> _2_TestBloomFilteredLucene41Postings_0.doc=1,
>> _3_TestBloomFilteredLucene41Postings_0.doc=1, _3.fdx=1, _6.cfs=15,
>> _3_Asserting_0.tim=1, _3_Asserting_0.doc=1,
>> _0_TestBloomFilteredLucene41Postings_0.doc=1, _0.fdx=1, _7.cfs=12,
>> _0_Asserting_0.pos=1, _0_MockRandom_0.tim=1, _2_MockRandom_0.doc=1,
>> _3_MockRandom_0.pos=1, _0.fdt=1}
>> > [junit4:junit4]    >    at
>> __randomizedtesting.SeedInfo.seed([A8CEAAB4EF38E076]:0)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:621)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.queries.function.FunctionTestSetup.afterClassFunctionTestSetup(FunctionTestSetup.java:84)
>> > [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:722)
>> > [junit4:junit4]    > Caused by: java.lang.RuntimeException: unclosed
>> IndexInput: _7.cfs
>> > [junit4:junit4]    >    at
>> org.apache.lucene.store.MockDirectoryWrapper.addFileHandle(MockDirectoryWrapper.java:510)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.store.MockDirectoryWrapper$1.openSlice(MockDirectoryWrapper.java:929)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.store.CompoundFileDirectory.openInput(CompoundFileDirectory.java:186)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.codecs.compressing.CompressingStoredFieldsReader.<init>(CompressingStoredFieldsReader.java:98)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsReader(CompressingStoredFieldsFormat.java:113)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:147)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:56)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.StandardDirectoryReader$1.doBody(StandardDirectoryReader.java:62)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:668)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:52)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:66)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.queries.TestCustomScoreQuery.doTestCustomScore(TestCustomScoreQuery.java:250)
>> > [junit4:junit4]    >    at
>> org.apache.lucene.queries.TestCustomScoreQuery.testCustomScoreFloat(TestCustomScoreQuery.java:94)
>> > [junit4:junit4]    >    ... 13 more
>> > [junit4:junit4] Completed on J1 in 3.71s, 6 tests, 1 failure, 1 error
>> <<< FAILURES!
>> >
>> > [...truncated 23 lines...]
>> > BUILD FAILED
>> >
>> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:378:
>> The following error occurred while executing this line:
>> >
>> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:358:
>> The following error occurred while executing this line:
>> >
>> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:39:
>> The following error occurred while executing this line:
>> >
>> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build.xml:548:
>> The following error occurred while executing this line:
>> >
>> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:1798:
>> The following error occurred while executing this line:
>> >
>> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/module-build.xml:61:
>> The following error occurred while executing this line:
>> >
>> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:1240:
>> The following error occurred while executing this line:
>> >
>> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:884:
>> There were test failures: 13 suites, 92 tests, 1 suite-level error, 1
>> failure
>> >
>> > Total time: 18 minutes 38 seconds
>> > Build step 'Invoke Ant' marked build as failure
>> > Archiving artifacts
>> > Recording test results
>> > Email was triggered for: Failure
>> > Sending email for trigger: Failure
>> >
>> >
>> >
>> >
>> > ---------------------------------------------------------------------
>> > To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>> > For additional commands, e-mail: dev-help@lucene.apache.org
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: dev-help@lucene.apache.org
>>
>>

Re: [JENKINS] Lucene-Solr-Tests-trunk-java7 - Build # 3943 - Still Failing

Posted by Robert Muir <rc...@gmail.com>.
There is a constant for that purpose... It should be used here. I recently
changed this test to use newsearcher which randomizes the sim. If it gets
certain term freq normalizations they can result in large values
On Apr 29, 2013 5:03 PM, "Michael McCandless" <lu...@mikemccandless.com>
wrote:

> This failure reproduces ... it could be we need to increase the
> allowed float difference in the compare?  TEST_SCORE_TOLERANCE_DELTA =
> 0.001f now ... really that iota should be relative not absolute (these
> scores a biggish: 17448.736328125 vs 17448.734375
>
> Mike McCandless
>
> http://blog.mikemccandless.com
>
>
> On Mon, Apr 29, 2013 at 7:40 PM, Apache Jenkins Server
> <je...@builds.apache.org> wrote:
> > Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-java7/3943/
> >
> > 2 tests failed.
> > REGRESSION:
>  org.apache.lucene.queries.TestCustomScoreQuery.testCustomScoreFloat
> >
> > Error Message:
> > new score for custom mul expected:<17448.736328125> but
> was:<17448.734375>
> >
> > Stack Trace:
> > java.lang.AssertionError: new score for custom mul
> expected:<17448.736328125> but was:<17448.734375>
> >         at
> __randomizedtesting.SeedInfo.seed([A8CEAAB4EF38E076:B5301295BCB5C5B]:0)
> >         at org.junit.Assert.fail(Assert.java:93)
> >         at org.junit.Assert.failNotEquals(Assert.java:647)
> >         at org.junit.Assert.assertEquals(Assert.java:443)
> >         at
> org.apache.lucene.queries.TestCustomScoreQuery.verifyResults(TestCustomScoreQuery.java:344)
> >         at
> org.apache.lucene.queries.TestCustomScoreQuery.doTestCustomScore(TestCustomScoreQuery.java:302)
> >         at
> org.apache.lucene.queries.TestCustomScoreQuery.testCustomScoreFloat(TestCustomScoreQuery.java:94)
> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> >         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >         at java.lang.reflect.Method.invoke(Method.java:601)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
> >         at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> >         at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
> >         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> >         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> >         at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
> >         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> >         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
> >         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> >         at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> >         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> >         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> >         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> >         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> >         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> >         at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> >         at java.lang.Thread.run(Thread.java:722)
> >
> >
> > FAILED:
>  junit.framework.TestSuite.org.apache.lucene.queries.TestCustomScoreQuery
> >
> > Error Message:
> > MockDirectoryWrapper: cannot close: there are still open files:
> {_1_TestBloomFilteredLucene41Postings_0.pos=1,
> _3_TestBloomFilteredLucene41Postings_0.tim=1, _2_Asserting_0.pos=1,
> _0_TestBloomFilteredLucene41Postings_0.tim=1, _3.fdt=1,
> _0_TestBloomFilteredLucene41Postings_0.pos=1, _1_MockRandom_0.pos=1,
> _4.cfs=12, _1_Asserting_0.tim=1, _0_Asserting_0.doc=1,
> _1_Asserting_0.pos=1, _8.cfs=12, _2.fdt=1,
> _1_TestBloomFilteredLucene41Postings_0.doc=1, _2.fdx=1, _1.fdx=1,
> _2_Asserting_0.tim=1, _1_MockRandom_0.tib=1, _1.fdt=1,
> _0_MockRandom_0.doc=1, _3_MockRandom_0.tim=1,
> _2_TestBloomFilteredLucene41Postings_0.pos=1, _0_MockRandom_0.pos=1,
> _1_MockRandom_0.doc=1, _2_TestBloomFilteredLucene41Postings_0.tim=1,
> _0_Asserting_0.tim=1, _1_TestBloomFilteredLucene41Postings_0.tim=1,
> _1_Asserting_0.doc=1, _2_MockRandom_0.tim=1, _3_MockRandom_0.doc=1,
> _3_TestBloomFilteredLucene41Postings_0.pos=1, _5.cfs=15,
> _3_Asserting_0.pos=1, _2_Asserting_0.doc=1, _2_MockRandom_0.pos=1,
> _2_TestBloomFilteredLucene41Postings_0.doc=1,
> _3_TestBloomFilteredLucene41Postings_0.doc=1, _3.fdx=1, _6.cfs=15,
> _3_Asserting_0.tim=1, _3_Asserting_0.doc=1,
> _0_TestBloomFilteredLucene41Postings_0.doc=1, _0.fdx=1, _7.cfs=12,
> _0_Asserting_0.pos=1, _0_MockRandom_0.tim=1, _2_MockRandom_0.doc=1,
> _3_MockRandom_0.pos=1, _0.fdt=1}
> >
> > Stack Trace:
> > java.lang.RuntimeException: MockDirectoryWrapper: cannot close: there
> are still open files: {_1_TestBloomFilteredLucene41Postings_0.pos=1,
> _3_TestBloomFilteredLucene41Postings_0.tim=1, _2_Asserting_0.pos=1,
> _0_TestBloomFilteredLucene41Postings_0.tim=1, _3.fdt=1,
> _0_TestBloomFilteredLucene41Postings_0.pos=1, _1_MockRandom_0.pos=1,
> _4.cfs=12, _1_Asserting_0.tim=1, _0_Asserting_0.doc=1,
> _1_Asserting_0.pos=1, _8.cfs=12, _2.fdt=1,
> _1_TestBloomFilteredLucene41Postings_0.doc=1, _2.fdx=1, _1.fdx=1,
> _2_Asserting_0.tim=1, _1_MockRandom_0.tib=1, _1.fdt=1,
> _0_MockRandom_0.doc=1, _3_MockRandom_0.tim=1,
> _2_TestBloomFilteredLucene41Postings_0.pos=1, _0_MockRandom_0.pos=1,
> _1_MockRandom_0.doc=1, _2_TestBloomFilteredLucene41Postings_0.tim=1,
> _0_Asserting_0.tim=1, _1_TestBloomFilteredLucene41Postings_0.tim=1,
> _1_Asserting_0.doc=1, _2_MockRandom_0.tim=1, _3_MockRandom_0.doc=1,
> _3_TestBloomFilteredLucene41Postings_0.pos=1, _5.cfs=15,
> _3_Asserting_0.pos=1, _2_Asserting_0.doc=1, _2_MockRandom_0.pos=1,
> _2_TestBloomFilteredLucene41Postings_0.doc=1,
> _3_TestBloomFilteredLucene41Postings_0.doc=1, _3.fdx=1, _6.cfs=15,
> _3_Asserting_0.tim=1, _3_Asserting_0.doc=1,
> _0_TestBloomFilteredLucene41Postings_0.doc=1, _0.fdx=1, _7.cfs=12,
> _0_Asserting_0.pos=1, _0_MockRandom_0.tim=1, _2_MockRandom_0.doc=1,
> _3_MockRandom_0.pos=1, _0.fdt=1}
> >         at __randomizedtesting.SeedInfo.seed([A8CEAAB4EF38E076]:0)
> >         at
> org.apache.lucene.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:621)
> >         at
> org.apache.lucene.queries.function.FunctionTestSetup.afterClassFunctionTestSetup(FunctionTestSetup.java:84)
> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> >         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >         at java.lang.reflect.Method.invoke(Method.java:601)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
> >         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> >         at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> >         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> >         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> >         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> >         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> >         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> >         at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> >         at java.lang.Thread.run(Thread.java:722)
> > Caused by: java.lang.RuntimeException: unclosed IndexInput: _7.cfs
> >         at
> org.apache.lucene.store.MockDirectoryWrapper.addFileHandle(MockDirectoryWrapper.java:510)
> >         at
> org.apache.lucene.store.MockDirectoryWrapper$1.openSlice(MockDirectoryWrapper.java:929)
> >         at
> org.apache.lucene.store.CompoundFileDirectory.openInput(CompoundFileDirectory.java:186)
> >         at
> org.apache.lucene.codecs.compressing.CompressingStoredFieldsReader.<init>(CompressingStoredFieldsReader.java:98)
> >         at
> org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsReader(CompressingStoredFieldsFormat.java:113)
> >         at
> org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:147)
> >         at
> org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:56)
> >         at
> org.apache.lucene.index.StandardDirectoryReader$1.doBody(StandardDirectoryReader.java:62)
> >         at
> org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:668)
> >         at
> org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:52)
> >         at
> org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:66)
> >         at
> org.apache.lucene.queries.TestCustomScoreQuery.doTestCustomScore(TestCustomScoreQuery.java:250)
> >         at
> org.apache.lucene.queries.TestCustomScoreQuery.testCustomScoreFloat(TestCustomScoreQuery.java:94)
> >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> >         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >         at java.lang.reflect.Method.invoke(Method.java:601)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
> >         at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> >         at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
> >         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> >         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> >         at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
> >         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> >         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> >         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
> >         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
> >         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
> >         ... 13 more
> >
> >
> >
> >
> > Build Log:
> > [...truncated 7579 lines...]
> > [junit4:junit4] Suite: org.apache.lucene.queries.TestCustomScoreQuery
> > [junit4:junit4]   2> NOTE: reproduce with: ant test
>  -Dtestcase=TestCustomScoreQuery -Dtests.method=testCustomScoreFloat
> -Dtests.seed=A8CEAAB4EF38E076 -Dtests.multiplier=3 -Dtests.slow=true
> -Dtests.locale=en_US -Dtests.timezone=America/Fortaleza
> -Dtests.file.encoding=ISO-8859-1
> > [junit4:junit4] FAILURE 1.05s J1 |
> TestCustomScoreQuery.testCustomScoreFloat <<<
> > [junit4:junit4]    > Throwable #1: java.lang.AssertionError: new score
> for custom mul expected:<17448.736328125> but was:<17448.734375>
> > [junit4:junit4]    >    at
> __randomizedtesting.SeedInfo.seed([A8CEAAB4EF38E076:B5301295BCB5C5B]:0)
> > [junit4:junit4]    >    at
> org.apache.lucene.queries.TestCustomScoreQuery.verifyResults(TestCustomScoreQuery.java:344)
> > [junit4:junit4]    >    at
> org.apache.lucene.queries.TestCustomScoreQuery.doTestCustomScore(TestCustomScoreQuery.java:302)
> > [junit4:junit4]    >    at
> org.apache.lucene.queries.TestCustomScoreQuery.testCustomScoreFloat(TestCustomScoreQuery.java:94)
> > [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:722)
> > [junit4:junit4]   2> NOTE: test params are: codec=Lucene42:
> {id=PostingsFormat(name=Asserting),
> text=PostingsFormat(name=TestBloomFilteredLucene41Postings),
> fff=PostingsFormat(name=MockRandom),
> iii=PostingsFormat(name=TestBloomFilteredLucene41Postings)}, docValues:{},
> sim=RandomSimilarityProvider(queryNorm=true,coord=no): {text=DFR
> G3(800.0)}, locale=en_US, timezone=America/Fortaleza
> > [junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation
> 1.7.0_17 (64-bit)/cpus=16,threads=1,free=41195792,total=122683392
> > [junit4:junit4]   2> NOTE: All tests run in this JVM:
> [TestFieldScoreQuery, TestBoostedQuery, BooleanFilterTest,
> BoostingQueryTest, TestCustomScoreQuery]
> > [junit4:junit4]   2> NOTE: reproduce with: ant test
>  -Dtestcase=TestCustomScoreQuery -Dtests.seed=A8CEAAB4EF38E076
> -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_US
> -Dtests.timezone=America/Fortaleza -Dtests.file.encoding=ISO-8859-1
> > [junit4:junit4] ERROR   0.00s J1 | TestCustomScoreQuery (suite) <<<
> > [junit4:junit4]    > Throwable #1: java.lang.RuntimeException:
> MockDirectoryWrapper: cannot close: there are still open files:
> {_1_TestBloomFilteredLucene41Postings_0.pos=1,
> _3_TestBloomFilteredLucene41Postings_0.tim=1, _2_Asserting_0.pos=1,
> _0_TestBloomFilteredLucene41Postings_0.tim=1, _3.fdt=1,
> _0_TestBloomFilteredLucene41Postings_0.pos=1, _1_MockRandom_0.pos=1,
> _4.cfs=12, _1_Asserting_0.tim=1, _0_Asserting_0.doc=1,
> _1_Asserting_0.pos=1, _8.cfs=12, _2.fdt=1,
> _1_TestBloomFilteredLucene41Postings_0.doc=1, _2.fdx=1, _1.fdx=1,
> _2_Asserting_0.tim=1, _1_MockRandom_0.tib=1, _1.fdt=1,
> _0_MockRandom_0.doc=1, _3_MockRandom_0.tim=1,
> _2_TestBloomFilteredLucene41Postings_0.pos=1, _0_MockRandom_0.pos=1,
> _1_MockRandom_0.doc=1, _2_TestBloomFilteredLucene41Postings_0.tim=1,
> _0_Asserting_0.tim=1, _1_TestBloomFilteredLucene41Postings_0.tim=1,
> _1_Asserting_0.doc=1, _2_MockRandom_0.tim=1, _3_MockRandom_0.doc=1,
> _3_TestBloomFilteredLucene41Postings_0.pos=1, _5.cfs=15,
> _3_Asserting_0.pos=1, _2_Asserting_0.doc=1, _2_MockRandom_0.pos=1,
> _2_TestBloomFilteredLucene41Postings_0.doc=1,
> _3_TestBloomFilteredLucene41Postings_0.doc=1, _3.fdx=1, _6.cfs=15,
> _3_Asserting_0.tim=1, _3_Asserting_0.doc=1,
> _0_TestBloomFilteredLucene41Postings_0.doc=1, _0.fdx=1, _7.cfs=12,
> _0_Asserting_0.pos=1, _0_MockRandom_0.tim=1, _2_MockRandom_0.doc=1,
> _3_MockRandom_0.pos=1, _0.fdt=1}
> > [junit4:junit4]    >    at
> __randomizedtesting.SeedInfo.seed([A8CEAAB4EF38E076]:0)
> > [junit4:junit4]    >    at
> org.apache.lucene.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:621)
> > [junit4:junit4]    >    at
> org.apache.lucene.queries.function.FunctionTestSetup.afterClassFunctionTestSetup(FunctionTestSetup.java:84)
> > [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:722)
> > [junit4:junit4]    > Caused by: java.lang.RuntimeException: unclosed
> IndexInput: _7.cfs
> > [junit4:junit4]    >    at
> org.apache.lucene.store.MockDirectoryWrapper.addFileHandle(MockDirectoryWrapper.java:510)
> > [junit4:junit4]    >    at
> org.apache.lucene.store.MockDirectoryWrapper$1.openSlice(MockDirectoryWrapper.java:929)
> > [junit4:junit4]    >    at
> org.apache.lucene.store.CompoundFileDirectory.openInput(CompoundFileDirectory.java:186)
> > [junit4:junit4]    >    at
> org.apache.lucene.codecs.compressing.CompressingStoredFieldsReader.<init>(CompressingStoredFieldsReader.java:98)
> > [junit4:junit4]    >    at
> org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsReader(CompressingStoredFieldsFormat.java:113)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:147)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:56)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.StandardDirectoryReader$1.doBody(StandardDirectoryReader.java:62)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:668)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:52)
> > [junit4:junit4]    >    at
> org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:66)
> > [junit4:junit4]    >    at
> org.apache.lucene.queries.TestCustomScoreQuery.doTestCustomScore(TestCustomScoreQuery.java:250)
> > [junit4:junit4]    >    at
> org.apache.lucene.queries.TestCustomScoreQuery.testCustomScoreFloat(TestCustomScoreQuery.java:94)
> > [junit4:junit4]    >    ... 13 more
> > [junit4:junit4] Completed on J1 in 3.71s, 6 tests, 1 failure, 1 error
> <<< FAILURES!
> >
> > [...truncated 23 lines...]
> > BUILD FAILED
> >
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:378:
> The following error occurred while executing this line:
> >
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:358:
> The following error occurred while executing this line:
> >
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:39:
> The following error occurred while executing this line:
> >
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build.xml:548:
> The following error occurred while executing this line:
> >
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:1798:
> The following error occurred while executing this line:
> >
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/module-build.xml:61:
> The following error occurred while executing this line:
> >
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:1240:
> The following error occurred while executing this line:
> >
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:884:
> There were test failures: 13 suites, 92 tests, 1 suite-level error, 1
> failure
> >
> > Total time: 18 minutes 38 seconds
> > Build step 'Invoke Ant' marked build as failure
> > Archiving artifacts
> > Recording test results
> > Email was triggered for: Failure
> > Sending email for trigger: Failure
> >
> >
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> > For additional commands, e-mail: dev-help@lucene.apache.org
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>
>

Re: [JENKINS] Lucene-Solr-Tests-trunk-java7 - Build # 3943 - Still Failing

Posted by Michael McCandless <lu...@mikemccandless.com>.
This failure reproduces ... it could be we need to increase the
allowed float difference in the compare?  TEST_SCORE_TOLERANCE_DELTA =
0.001f now ... really that iota should be relative not absolute (these
scores a biggish: 17448.736328125 vs 17448.734375

Mike McCandless

http://blog.mikemccandless.com


On Mon, Apr 29, 2013 at 7:40 PM, Apache Jenkins Server
<je...@builds.apache.org> wrote:
> Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-java7/3943/
>
> 2 tests failed.
> REGRESSION:  org.apache.lucene.queries.TestCustomScoreQuery.testCustomScoreFloat
>
> Error Message:
> new score for custom mul expected:<17448.736328125> but was:<17448.734375>
>
> Stack Trace:
> java.lang.AssertionError: new score for custom mul expected:<17448.736328125> but was:<17448.734375>
>         at __randomizedtesting.SeedInfo.seed([A8CEAAB4EF38E076:B5301295BCB5C5B]:0)
>         at org.junit.Assert.fail(Assert.java:93)
>         at org.junit.Assert.failNotEquals(Assert.java:647)
>         at org.junit.Assert.assertEquals(Assert.java:443)
>         at org.apache.lucene.queries.TestCustomScoreQuery.verifyResults(TestCustomScoreQuery.java:344)
>         at org.apache.lucene.queries.TestCustomScoreQuery.doTestCustomScore(TestCustomScoreQuery.java:302)
>         at org.apache.lucene.queries.TestCustomScoreQuery.testCustomScoreFloat(TestCustomScoreQuery.java:94)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:601)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
>         at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>         at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at java.lang.Thread.run(Thread.java:722)
>
>
> FAILED:  junit.framework.TestSuite.org.apache.lucene.queries.TestCustomScoreQuery
>
> Error Message:
> MockDirectoryWrapper: cannot close: there are still open files: {_1_TestBloomFilteredLucene41Postings_0.pos=1, _3_TestBloomFilteredLucene41Postings_0.tim=1, _2_Asserting_0.pos=1, _0_TestBloomFilteredLucene41Postings_0.tim=1, _3.fdt=1, _0_TestBloomFilteredLucene41Postings_0.pos=1, _1_MockRandom_0.pos=1, _4.cfs=12, _1_Asserting_0.tim=1, _0_Asserting_0.doc=1, _1_Asserting_0.pos=1, _8.cfs=12, _2.fdt=1, _1_TestBloomFilteredLucene41Postings_0.doc=1, _2.fdx=1, _1.fdx=1, _2_Asserting_0.tim=1, _1_MockRandom_0.tib=1, _1.fdt=1, _0_MockRandom_0.doc=1, _3_MockRandom_0.tim=1, _2_TestBloomFilteredLucene41Postings_0.pos=1, _0_MockRandom_0.pos=1, _1_MockRandom_0.doc=1, _2_TestBloomFilteredLucene41Postings_0.tim=1, _0_Asserting_0.tim=1, _1_TestBloomFilteredLucene41Postings_0.tim=1, _1_Asserting_0.doc=1, _2_MockRandom_0.tim=1, _3_MockRandom_0.doc=1, _3_TestBloomFilteredLucene41Postings_0.pos=1, _5.cfs=15, _3_Asserting_0.pos=1, _2_Asserting_0.doc=1, _2_MockRandom_0.pos=1, _2_TestBloomFilteredLucene41Postings_0.doc=1, _3_TestBloomFilteredLucene41Postings_0.doc=1, _3.fdx=1, _6.cfs=15, _3_Asserting_0.tim=1, _3_Asserting_0.doc=1, _0_TestBloomFilteredLucene41Postings_0.doc=1, _0.fdx=1, _7.cfs=12, _0_Asserting_0.pos=1, _0_MockRandom_0.tim=1, _2_MockRandom_0.doc=1, _3_MockRandom_0.pos=1, _0.fdt=1}
>
> Stack Trace:
> java.lang.RuntimeException: MockDirectoryWrapper: cannot close: there are still open files: {_1_TestBloomFilteredLucene41Postings_0.pos=1, _3_TestBloomFilteredLucene41Postings_0.tim=1, _2_Asserting_0.pos=1, _0_TestBloomFilteredLucene41Postings_0.tim=1, _3.fdt=1, _0_TestBloomFilteredLucene41Postings_0.pos=1, _1_MockRandom_0.pos=1, _4.cfs=12, _1_Asserting_0.tim=1, _0_Asserting_0.doc=1, _1_Asserting_0.pos=1, _8.cfs=12, _2.fdt=1, _1_TestBloomFilteredLucene41Postings_0.doc=1, _2.fdx=1, _1.fdx=1, _2_Asserting_0.tim=1, _1_MockRandom_0.tib=1, _1.fdt=1, _0_MockRandom_0.doc=1, _3_MockRandom_0.tim=1, _2_TestBloomFilteredLucene41Postings_0.pos=1, _0_MockRandom_0.pos=1, _1_MockRandom_0.doc=1, _2_TestBloomFilteredLucene41Postings_0.tim=1, _0_Asserting_0.tim=1, _1_TestBloomFilteredLucene41Postings_0.tim=1, _1_Asserting_0.doc=1, _2_MockRandom_0.tim=1, _3_MockRandom_0.doc=1, _3_TestBloomFilteredLucene41Postings_0.pos=1, _5.cfs=15, _3_Asserting_0.pos=1, _2_Asserting_0.doc=1, _2_MockRandom_0.pos=1, _2_TestBloomFilteredLucene41Postings_0.doc=1, _3_TestBloomFilteredLucene41Postings_0.doc=1, _3.fdx=1, _6.cfs=15, _3_Asserting_0.tim=1, _3_Asserting_0.doc=1, _0_TestBloomFilteredLucene41Postings_0.doc=1, _0.fdx=1, _7.cfs=12, _0_Asserting_0.pos=1, _0_MockRandom_0.tim=1, _2_MockRandom_0.doc=1, _3_MockRandom_0.pos=1, _0.fdt=1}
>         at __randomizedtesting.SeedInfo.seed([A8CEAAB4EF38E076]:0)
>         at org.apache.lucene.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:621)
>         at org.apache.lucene.queries.function.FunctionTestSetup.afterClassFunctionTestSetup(FunctionTestSetup.java:84)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:601)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at java.lang.Thread.run(Thread.java:722)
> Caused by: java.lang.RuntimeException: unclosed IndexInput: _7.cfs
>         at org.apache.lucene.store.MockDirectoryWrapper.addFileHandle(MockDirectoryWrapper.java:510)
>         at org.apache.lucene.store.MockDirectoryWrapper$1.openSlice(MockDirectoryWrapper.java:929)
>         at org.apache.lucene.store.CompoundFileDirectory.openInput(CompoundFileDirectory.java:186)
>         at org.apache.lucene.codecs.compressing.CompressingStoredFieldsReader.<init>(CompressingStoredFieldsReader.java:98)
>         at org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsReader(CompressingStoredFieldsFormat.java:113)
>         at org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:147)
>         at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:56)
>         at org.apache.lucene.index.StandardDirectoryReader$1.doBody(StandardDirectoryReader.java:62)
>         at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:668)
>         at org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:52)
>         at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:66)
>         at org.apache.lucene.queries.TestCustomScoreQuery.doTestCustomScore(TestCustomScoreQuery.java:250)
>         at org.apache.lucene.queries.TestCustomScoreQuery.testCustomScoreFloat(TestCustomScoreQuery.java:94)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:601)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
>         at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>         at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
>         at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
>         at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
>         at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
>         at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
>         ... 13 more
>
>
>
>
> Build Log:
> [...truncated 7579 lines...]
> [junit4:junit4] Suite: org.apache.lucene.queries.TestCustomScoreQuery
> [junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestCustomScoreQuery -Dtests.method=testCustomScoreFloat -Dtests.seed=A8CEAAB4EF38E076 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_US -Dtests.timezone=America/Fortaleza -Dtests.file.encoding=ISO-8859-1
> [junit4:junit4] FAILURE 1.05s J1 | TestCustomScoreQuery.testCustomScoreFloat <<<
> [junit4:junit4]    > Throwable #1: java.lang.AssertionError: new score for custom mul expected:<17448.736328125> but was:<17448.734375>
> [junit4:junit4]    >    at __randomizedtesting.SeedInfo.seed([A8CEAAB4EF38E076:B5301295BCB5C5B]:0)
> [junit4:junit4]    >    at org.apache.lucene.queries.TestCustomScoreQuery.verifyResults(TestCustomScoreQuery.java:344)
> [junit4:junit4]    >    at org.apache.lucene.queries.TestCustomScoreQuery.doTestCustomScore(TestCustomScoreQuery.java:302)
> [junit4:junit4]    >    at org.apache.lucene.queries.TestCustomScoreQuery.testCustomScoreFloat(TestCustomScoreQuery.java:94)
> [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:722)
> [junit4:junit4]   2> NOTE: test params are: codec=Lucene42: {id=PostingsFormat(name=Asserting), text=PostingsFormat(name=TestBloomFilteredLucene41Postings), fff=PostingsFormat(name=MockRandom), iii=PostingsFormat(name=TestBloomFilteredLucene41Postings)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {text=DFR G3(800.0)}, locale=en_US, timezone=America/Fortaleza
> [junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_17 (64-bit)/cpus=16,threads=1,free=41195792,total=122683392
> [junit4:junit4]   2> NOTE: All tests run in this JVM: [TestFieldScoreQuery, TestBoostedQuery, BooleanFilterTest, BoostingQueryTest, TestCustomScoreQuery]
> [junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestCustomScoreQuery -Dtests.seed=A8CEAAB4EF38E076 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_US -Dtests.timezone=America/Fortaleza -Dtests.file.encoding=ISO-8859-1
> [junit4:junit4] ERROR   0.00s J1 | TestCustomScoreQuery (suite) <<<
> [junit4:junit4]    > Throwable #1: java.lang.RuntimeException: MockDirectoryWrapper: cannot close: there are still open files: {_1_TestBloomFilteredLucene41Postings_0.pos=1, _3_TestBloomFilteredLucene41Postings_0.tim=1, _2_Asserting_0.pos=1, _0_TestBloomFilteredLucene41Postings_0.tim=1, _3.fdt=1, _0_TestBloomFilteredLucene41Postings_0.pos=1, _1_MockRandom_0.pos=1, _4.cfs=12, _1_Asserting_0.tim=1, _0_Asserting_0.doc=1, _1_Asserting_0.pos=1, _8.cfs=12, _2.fdt=1, _1_TestBloomFilteredLucene41Postings_0.doc=1, _2.fdx=1, _1.fdx=1, _2_Asserting_0.tim=1, _1_MockRandom_0.tib=1, _1.fdt=1, _0_MockRandom_0.doc=1, _3_MockRandom_0.tim=1, _2_TestBloomFilteredLucene41Postings_0.pos=1, _0_MockRandom_0.pos=1, _1_MockRandom_0.doc=1, _2_TestBloomFilteredLucene41Postings_0.tim=1, _0_Asserting_0.tim=1, _1_TestBloomFilteredLucene41Postings_0.tim=1, _1_Asserting_0.doc=1, _2_MockRandom_0.tim=1, _3_MockRandom_0.doc=1, _3_TestBloomFilteredLucene41Postings_0.pos=1, _5.cfs=15, _3_Asserting_0.pos=1, _2_Asserting_0.doc=1, _2_MockRandom_0.pos=1, _2_TestBloomFilteredLucene41Postings_0.doc=1, _3_TestBloomFilteredLucene41Postings_0.doc=1, _3.fdx=1, _6.cfs=15, _3_Asserting_0.tim=1, _3_Asserting_0.doc=1, _0_TestBloomFilteredLucene41Postings_0.doc=1, _0.fdx=1, _7.cfs=12, _0_Asserting_0.pos=1, _0_MockRandom_0.tim=1, _2_MockRandom_0.doc=1, _3_MockRandom_0.pos=1, _0.fdt=1}
> [junit4:junit4]    >    at __randomizedtesting.SeedInfo.seed([A8CEAAB4EF38E076]:0)
> [junit4:junit4]    >    at org.apache.lucene.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:621)
> [junit4:junit4]    >    at org.apache.lucene.queries.function.FunctionTestSetup.afterClassFunctionTestSetup(FunctionTestSetup.java:84)
> [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:722)
> [junit4:junit4]    > Caused by: java.lang.RuntimeException: unclosed IndexInput: _7.cfs
> [junit4:junit4]    >    at org.apache.lucene.store.MockDirectoryWrapper.addFileHandle(MockDirectoryWrapper.java:510)
> [junit4:junit4]    >    at org.apache.lucene.store.MockDirectoryWrapper$1.openSlice(MockDirectoryWrapper.java:929)
> [junit4:junit4]    >    at org.apache.lucene.store.CompoundFileDirectory.openInput(CompoundFileDirectory.java:186)
> [junit4:junit4]    >    at org.apache.lucene.codecs.compressing.CompressingStoredFieldsReader.<init>(CompressingStoredFieldsReader.java:98)
> [junit4:junit4]    >    at org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsReader(CompressingStoredFieldsFormat.java:113)
> [junit4:junit4]    >    at org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:147)
> [junit4:junit4]    >    at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:56)
> [junit4:junit4]    >    at org.apache.lucene.index.StandardDirectoryReader$1.doBody(StandardDirectoryReader.java:62)
> [junit4:junit4]    >    at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:668)
> [junit4:junit4]    >    at org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:52)
> [junit4:junit4]    >    at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:66)
> [junit4:junit4]    >    at org.apache.lucene.queries.TestCustomScoreQuery.doTestCustomScore(TestCustomScoreQuery.java:250)
> [junit4:junit4]    >    at org.apache.lucene.queries.TestCustomScoreQuery.testCustomScoreFloat(TestCustomScoreQuery.java:94)
> [junit4:junit4]    >    ... 13 more
> [junit4:junit4] Completed on J1 in 3.71s, 6 tests, 1 failure, 1 error <<< FAILURES!
>
> [...truncated 23 lines...]
> BUILD FAILED
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:378: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:358: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:39: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build.xml:548: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:1798: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/module-build.xml:61: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:1240: The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:884: There were test failures: 13 suites, 92 tests, 1 suite-level error, 1 failure
>
> Total time: 18 minutes 38 seconds
> Build step 'Invoke Ant' marked build as failure
> Archiving artifacts
> Recording test results
> Email was triggered for: Failure
> Sending email for trigger: Failure
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[JENKINS] Lucene-Solr-Tests-trunk-java7 - Build # 3943 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-java7/3943/

2 tests failed.
REGRESSION:  org.apache.lucene.queries.TestCustomScoreQuery.testCustomScoreFloat

Error Message:
new score for custom mul expected:<17448.736328125> but was:<17448.734375>

Stack Trace:
java.lang.AssertionError: new score for custom mul expected:<17448.736328125> but was:<17448.734375>
	at __randomizedtesting.SeedInfo.seed([A8CEAAB4EF38E076:B5301295BCB5C5B]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:443)
	at org.apache.lucene.queries.TestCustomScoreQuery.verifyResults(TestCustomScoreQuery.java:344)
	at org.apache.lucene.queries.TestCustomScoreQuery.doTestCustomScore(TestCustomScoreQuery.java:302)
	at org.apache.lucene.queries.TestCustomScoreQuery.testCustomScoreFloat(TestCustomScoreQuery.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)


FAILED:  junit.framework.TestSuite.org.apache.lucene.queries.TestCustomScoreQuery

Error Message:
MockDirectoryWrapper: cannot close: there are still open files: {_1_TestBloomFilteredLucene41Postings_0.pos=1, _3_TestBloomFilteredLucene41Postings_0.tim=1, _2_Asserting_0.pos=1, _0_TestBloomFilteredLucene41Postings_0.tim=1, _3.fdt=1, _0_TestBloomFilteredLucene41Postings_0.pos=1, _1_MockRandom_0.pos=1, _4.cfs=12, _1_Asserting_0.tim=1, _0_Asserting_0.doc=1, _1_Asserting_0.pos=1, _8.cfs=12, _2.fdt=1, _1_TestBloomFilteredLucene41Postings_0.doc=1, _2.fdx=1, _1.fdx=1, _2_Asserting_0.tim=1, _1_MockRandom_0.tib=1, _1.fdt=1, _0_MockRandom_0.doc=1, _3_MockRandom_0.tim=1, _2_TestBloomFilteredLucene41Postings_0.pos=1, _0_MockRandom_0.pos=1, _1_MockRandom_0.doc=1, _2_TestBloomFilteredLucene41Postings_0.tim=1, _0_Asserting_0.tim=1, _1_TestBloomFilteredLucene41Postings_0.tim=1, _1_Asserting_0.doc=1, _2_MockRandom_0.tim=1, _3_MockRandom_0.doc=1, _3_TestBloomFilteredLucene41Postings_0.pos=1, _5.cfs=15, _3_Asserting_0.pos=1, _2_Asserting_0.doc=1, _2_MockRandom_0.pos=1, _2_TestBloomFilteredLucene41Postings_0.doc=1, _3_TestBloomFilteredLucene41Postings_0.doc=1, _3.fdx=1, _6.cfs=15, _3_Asserting_0.tim=1, _3_Asserting_0.doc=1, _0_TestBloomFilteredLucene41Postings_0.doc=1, _0.fdx=1, _7.cfs=12, _0_Asserting_0.pos=1, _0_MockRandom_0.tim=1, _2_MockRandom_0.doc=1, _3_MockRandom_0.pos=1, _0.fdt=1}

Stack Trace:
java.lang.RuntimeException: MockDirectoryWrapper: cannot close: there are still open files: {_1_TestBloomFilteredLucene41Postings_0.pos=1, _3_TestBloomFilteredLucene41Postings_0.tim=1, _2_Asserting_0.pos=1, _0_TestBloomFilteredLucene41Postings_0.tim=1, _3.fdt=1, _0_TestBloomFilteredLucene41Postings_0.pos=1, _1_MockRandom_0.pos=1, _4.cfs=12, _1_Asserting_0.tim=1, _0_Asserting_0.doc=1, _1_Asserting_0.pos=1, _8.cfs=12, _2.fdt=1, _1_TestBloomFilteredLucene41Postings_0.doc=1, _2.fdx=1, _1.fdx=1, _2_Asserting_0.tim=1, _1_MockRandom_0.tib=1, _1.fdt=1, _0_MockRandom_0.doc=1, _3_MockRandom_0.tim=1, _2_TestBloomFilteredLucene41Postings_0.pos=1, _0_MockRandom_0.pos=1, _1_MockRandom_0.doc=1, _2_TestBloomFilteredLucene41Postings_0.tim=1, _0_Asserting_0.tim=1, _1_TestBloomFilteredLucene41Postings_0.tim=1, _1_Asserting_0.doc=1, _2_MockRandom_0.tim=1, _3_MockRandom_0.doc=1, _3_TestBloomFilteredLucene41Postings_0.pos=1, _5.cfs=15, _3_Asserting_0.pos=1, _2_Asserting_0.doc=1, _2_MockRandom_0.pos=1, _2_TestBloomFilteredLucene41Postings_0.doc=1, _3_TestBloomFilteredLucene41Postings_0.doc=1, _3.fdx=1, _6.cfs=15, _3_Asserting_0.tim=1, _3_Asserting_0.doc=1, _0_TestBloomFilteredLucene41Postings_0.doc=1, _0.fdx=1, _7.cfs=12, _0_Asserting_0.pos=1, _0_MockRandom_0.tim=1, _2_MockRandom_0.doc=1, _3_MockRandom_0.pos=1, _0.fdt=1}
	at __randomizedtesting.SeedInfo.seed([A8CEAAB4EF38E076]:0)
	at org.apache.lucene.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:621)
	at org.apache.lucene.queries.function.FunctionTestSetup.afterClassFunctionTestSetup(FunctionTestSetup.java:84)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)
Caused by: java.lang.RuntimeException: unclosed IndexInput: _7.cfs
	at org.apache.lucene.store.MockDirectoryWrapper.addFileHandle(MockDirectoryWrapper.java:510)
	at org.apache.lucene.store.MockDirectoryWrapper$1.openSlice(MockDirectoryWrapper.java:929)
	at org.apache.lucene.store.CompoundFileDirectory.openInput(CompoundFileDirectory.java:186)
	at org.apache.lucene.codecs.compressing.CompressingStoredFieldsReader.<init>(CompressingStoredFieldsReader.java:98)
	at org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsReader(CompressingStoredFieldsFormat.java:113)
	at org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:147)
	at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:56)
	at org.apache.lucene.index.StandardDirectoryReader$1.doBody(StandardDirectoryReader.java:62)
	at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:668)
	at org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:52)
	at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:66)
	at org.apache.lucene.queries.TestCustomScoreQuery.doTestCustomScore(TestCustomScoreQuery.java:250)
	at org.apache.lucene.queries.TestCustomScoreQuery.testCustomScoreFloat(TestCustomScoreQuery.java:94)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	... 13 more




Build Log:
[...truncated 7579 lines...]
[junit4:junit4] Suite: org.apache.lucene.queries.TestCustomScoreQuery
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestCustomScoreQuery -Dtests.method=testCustomScoreFloat -Dtests.seed=A8CEAAB4EF38E076 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_US -Dtests.timezone=America/Fortaleza -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE 1.05s J1 | TestCustomScoreQuery.testCustomScoreFloat <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: new score for custom mul expected:<17448.736328125> but was:<17448.734375>
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([A8CEAAB4EF38E076:B5301295BCB5C5B]:0)
[junit4:junit4]    > 	at org.apache.lucene.queries.TestCustomScoreQuery.verifyResults(TestCustomScoreQuery.java:344)
[junit4:junit4]    > 	at org.apache.lucene.queries.TestCustomScoreQuery.doTestCustomScore(TestCustomScoreQuery.java:302)
[junit4:junit4]    > 	at org.apache.lucene.queries.TestCustomScoreQuery.testCustomScoreFloat(TestCustomScoreQuery.java:94)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> NOTE: test params are: codec=Lucene42: {id=PostingsFormat(name=Asserting), text=PostingsFormat(name=TestBloomFilteredLucene41Postings), fff=PostingsFormat(name=MockRandom), iii=PostingsFormat(name=TestBloomFilteredLucene41Postings)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {text=DFR G3(800.0)}, locale=en_US, timezone=America/Fortaleza
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_17 (64-bit)/cpus=16,threads=1,free=41195792,total=122683392
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestFieldScoreQuery, TestBoostedQuery, BooleanFilterTest, BoostingQueryTest, TestCustomScoreQuery]
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestCustomScoreQuery -Dtests.seed=A8CEAAB4EF38E076 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_US -Dtests.timezone=America/Fortaleza -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] ERROR   0.00s J1 | TestCustomScoreQuery (suite) <<<
[junit4:junit4]    > Throwable #1: java.lang.RuntimeException: MockDirectoryWrapper: cannot close: there are still open files: {_1_TestBloomFilteredLucene41Postings_0.pos=1, _3_TestBloomFilteredLucene41Postings_0.tim=1, _2_Asserting_0.pos=1, _0_TestBloomFilteredLucene41Postings_0.tim=1, _3.fdt=1, _0_TestBloomFilteredLucene41Postings_0.pos=1, _1_MockRandom_0.pos=1, _4.cfs=12, _1_Asserting_0.tim=1, _0_Asserting_0.doc=1, _1_Asserting_0.pos=1, _8.cfs=12, _2.fdt=1, _1_TestBloomFilteredLucene41Postings_0.doc=1, _2.fdx=1, _1.fdx=1, _2_Asserting_0.tim=1, _1_MockRandom_0.tib=1, _1.fdt=1, _0_MockRandom_0.doc=1, _3_MockRandom_0.tim=1, _2_TestBloomFilteredLucene41Postings_0.pos=1, _0_MockRandom_0.pos=1, _1_MockRandom_0.doc=1, _2_TestBloomFilteredLucene41Postings_0.tim=1, _0_Asserting_0.tim=1, _1_TestBloomFilteredLucene41Postings_0.tim=1, _1_Asserting_0.doc=1, _2_MockRandom_0.tim=1, _3_MockRandom_0.doc=1, _3_TestBloomFilteredLucene41Postings_0.pos=1, _5.cfs=15, _3_Asserting_0.pos=1, _2_Asserting_0.doc=1, _2_MockRandom_0.pos=1, _2_TestBloomFilteredLucene41Postings_0.doc=1, _3_TestBloomFilteredLucene41Postings_0.doc=1, _3.fdx=1, _6.cfs=15, _3_Asserting_0.tim=1, _3_Asserting_0.doc=1, _0_TestBloomFilteredLucene41Postings_0.doc=1, _0.fdx=1, _7.cfs=12, _0_Asserting_0.pos=1, _0_MockRandom_0.tim=1, _2_MockRandom_0.doc=1, _3_MockRandom_0.pos=1, _0.fdt=1}
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([A8CEAAB4EF38E076]:0)
[junit4:junit4]    > 	at org.apache.lucene.store.MockDirectoryWrapper.close(MockDirectoryWrapper.java:621)
[junit4:junit4]    > 	at org.apache.lucene.queries.function.FunctionTestSetup.afterClassFunctionTestSetup(FunctionTestSetup.java:84)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]    > Caused by: java.lang.RuntimeException: unclosed IndexInput: _7.cfs
[junit4:junit4]    > 	at org.apache.lucene.store.MockDirectoryWrapper.addFileHandle(MockDirectoryWrapper.java:510)
[junit4:junit4]    > 	at org.apache.lucene.store.MockDirectoryWrapper$1.openSlice(MockDirectoryWrapper.java:929)
[junit4:junit4]    > 	at org.apache.lucene.store.CompoundFileDirectory.openInput(CompoundFileDirectory.java:186)
[junit4:junit4]    > 	at org.apache.lucene.codecs.compressing.CompressingStoredFieldsReader.<init>(CompressingStoredFieldsReader.java:98)
[junit4:junit4]    > 	at org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsReader(CompressingStoredFieldsFormat.java:113)
[junit4:junit4]    > 	at org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:147)
[junit4:junit4]    > 	at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:56)
[junit4:junit4]    > 	at org.apache.lucene.index.StandardDirectoryReader$1.doBody(StandardDirectoryReader.java:62)
[junit4:junit4]    > 	at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:668)
[junit4:junit4]    > 	at org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:52)
[junit4:junit4]    > 	at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:66)
[junit4:junit4]    > 	at org.apache.lucene.queries.TestCustomScoreQuery.doTestCustomScore(TestCustomScoreQuery.java:250)
[junit4:junit4]    > 	at org.apache.lucene.queries.TestCustomScoreQuery.testCustomScoreFloat(TestCustomScoreQuery.java:94)
[junit4:junit4]    > 	... 13 more
[junit4:junit4] Completed on J1 in 3.71s, 6 tests, 1 failure, 1 error <<< FAILURES!

[...truncated 23 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:378: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:358: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/build.xml:548: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:1798: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/module-build.xml:61: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:1240: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:884: There were test failures: 13 suites, 92 tests, 1 suite-level error, 1 failure

Total time: 18 minutes 38 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-Tests-trunk-java7 - Build # 3942 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-java7/3942/

1 tests failed.
REGRESSION:  org.apache.solr.cloud.SyncSliceTest.testDistribSearch

Error Message:
shard1 is not consistent.  Got 305 from http://127.0.0.1:54043/wo_/collection1lastClient and got 5 from http://127.0.0.1:54106/wo_/collection1

Stack Trace:
java.lang.AssertionError: shard1 is not consistent.  Got 305 from http://127.0.0.1:54043/wo_/collection1lastClient and got 5 from http://127.0.0.1:54106/wo_/collection1
	at __randomizedtesting.SeedInfo.seed([B8D30226B4772CCF:39358C3EC3284CF3]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:963)
	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:238)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)




Build Log:
[...truncated 9556 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:42.802; org.apache.solr.BaseDistributedSearchTestCase; Setting hostContext system property: /wo_/
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:42.809; org.apache.solr.SolrTestCaseJ4; ###Starting testDistribSearch
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:42.810; org.apache.solr.cloud.ZkTestServer; STARTING ZK TEST SERVER
[junit4:junit4]   1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:42.811; org.apache.solr.cloud.ZkTestServer$ZKServerMain; Starting server
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:42.912; org.apache.solr.cloud.ZkTestServer; start zk server on port:53869
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:42.913; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:42.916; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@41990eb1 name:ZooKeeperConnection Watcher:127.0.0.1:53869 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:42.917; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:42.917; org.apache.solr.common.cloud.SolrZkClient; makePath: /solr
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:42.945; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:42.947; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@4d17633d name:ZooKeeperConnection Watcher:127.0.0.1:53869/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:42.948; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:42.948; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:42.953; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/shards
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:42.963; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:42.965; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/shards
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:42.968; org.apache.solr.cloud.AbstractZkTestCase; put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:42.969; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:42.980; org.apache.solr.cloud.AbstractZkTestCase; put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:42.981; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/schema.xml
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.084; org.apache.solr.cloud.AbstractZkTestCase; put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.085; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.088; org.apache.solr.cloud.AbstractZkTestCase; put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.089; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/protwords.txt
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.105; org.apache.solr.cloud.AbstractZkTestCase; put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.106; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/currency.xml
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.109; org.apache.solr.cloud.AbstractZkTestCase; put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.109; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.113; org.apache.solr.cloud.AbstractZkTestCase; put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.113; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.116; org.apache.solr.cloud.AbstractZkTestCase; put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.117; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.120; org.apache.solr.cloud.AbstractZkTestCase; put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.121; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.347; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.353; org.eclipse.jetty.server.AbstractConnector; Started SocketConnector@127.0.0.1:53872
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.353; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.354; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.355; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1367254423131
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.355; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1367254423131/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.356; org.apache.solr.core.CoreContainer; New CoreContainer 279857782
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.356; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1367254423131/'
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.357; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1367254423131/'
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.476; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.477; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.477; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.478; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.478; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.479; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.480; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.480; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.481; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.481; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.498; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.499; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:53869/solr
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.499; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.500; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.503; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@5a6ac253 name:ZooKeeperConnection Watcher:127.0.0.1:53869 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.504; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.518; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.530; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.532; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@8b791c4 name:ZooKeeperConnection Watcher:127.0.0.1:53869/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.532; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.535; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.546; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/collection-queue-work
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.549; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.552; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53872_wo_
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.560; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:53872_wo_
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.563; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/election
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.580; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/leader
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.583; org.apache.solr.cloud.Overseer; Overseer (id=89604385853669379-127.0.0.1:53872_wo_-n_0000000000) starting
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.594; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue-work
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.607; org.apache.solr.cloud.OverseerCollectionProcessor; Process current queue of collection creations
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.608; org.apache.solr.common.cloud.SolrZkClient; makePath: /clusterstate.json
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.610; org.apache.solr.common.cloud.SolrZkClient; makePath: /aliases.json
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.612; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.615; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Starting to work on the main queue
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.619; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1367254423131/collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.620; org.apache.solr.cloud.ZkController; Check for collection zkNode:control_collection
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.620; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.621; org.apache.solr.cloud.ZkController; Load collection config from:/collections/control_collection
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.622; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1367254423131/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.624; org.apache.solr.core.SolrResourceLoader; Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-controljetty-1367254423131/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.625; org.apache.solr.core.SolrResourceLoader; Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-controljetty-1367254423131/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.680; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.745; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.846; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:43.852; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:44.509; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:44.521; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:44.525; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:44.538; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:44.543; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:44.548; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-29 16:53:44.549; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-29 16:53:44.549; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:44.550; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-29 16:53:44.551; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-29 16:53:44.551; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:44.551; org.apache.solr.core.SolrCore; solr.StandardDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:44.552; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-controljetty-1367254423131/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1367254422809/control/data/
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:44.552; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@54cd7581
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:44.553; org.apache.solr.core.SolrCore; solr.StandardDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:44.554; org.apache.solr.core.CachingDirectoryFactory; return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/control/data
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:44.555; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1367254422809/control/data/index/
[junit4:junit4]   1> WARN  - 2013-04-29 16:53:44.555; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1367254422809/control/data/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:44.556; org.apache.solr.core.CachingDirectoryFactory; return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/control/data/index
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:44.562; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/control/data/index,segFN=segments_1,generation=1}
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:44.563; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:44.566; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:44.566; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:44.567; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:44.567; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:44.568; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:44.568; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:44.569; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:44.569; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:44.570; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:44.581; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:44.589; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@768aab6a main
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:44.590; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:44.591; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:44.594; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@768aab6a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:44.596; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:44.597; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:45.118; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:45.119; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"control_collection",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:53872_wo_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:53872/wo_"}
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:45.119; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection control_collection with numShards 1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:45.120; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:45.134; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:45.600; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:45.600; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:53872/wo_ collection:control_collection shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:45.601; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:45.619; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:45.630; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:45.630; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:45.630; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:53872/wo_/collection1/
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:45.631; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:45.631; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:53872/wo_/collection1/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:45.631; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:53872/wo_/collection1/
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:45.632; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/leaders/shard1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:46.638; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:46.719; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:46.818; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:53872/wo_/collection1/ and leader is http://127.0.0.1:53872/wo_/collection1/
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:46.818; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53872/wo_
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:46.818; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:46.819; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:46.819; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:46.823; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:46.824; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:46.825; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:46.826; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:46.840; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:46.842; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:46.845; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1fe639da name:ZooKeeperConnection Watcher:127.0.0.1:53869/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:46.845; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:46.847; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:46.849; org.apache.solr.cloud.ChaosMonkey; monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:47.064; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:47.067; org.eclipse.jetty.server.AbstractConnector; Started SocketConnector@127.0.0.1:54005
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:47.068; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:47.068; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:47.069; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1367254426850
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:47.069; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1367254426850/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:47.070; org.apache.solr.core.CoreContainer; New CoreContainer 1911769965
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:47.071; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1367254426850/'
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:47.071; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1367254426850/'
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:47.188; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:47.189; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:47.189; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:47.190; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:47.190; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:47.191; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:47.191; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:47.192; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:47.193; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:47.193; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:47.207; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:47.208; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:53869/solr
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:47.209; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:47.210; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:47.221; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@7af2b1a1 name:ZooKeeperConnection Watcher:127.0.0.1:53869 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:47.221; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:47.236; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:47.246; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:47.248; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@56c70724 name:ZooKeeperConnection Watcher:127.0.0.1:53869/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:47.249; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:47.258; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:48.262; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54005_wo_
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:48.265; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:54005_wo_
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:48.269; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:48.269; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:48.269; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:48.269; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:48.286; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1367254426850/collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:48.287; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:48.287; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:48.288; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:48.289; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1367254426850/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:48.290; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:48.291; org.apache.solr.core.SolrResourceLoader; Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty1-1367254426850/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:48.291; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:53872_wo__collection1",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"control_collection",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:53872_wo_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:53872/wo_"}
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:48.291; org.apache.solr.core.SolrResourceLoader; Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty1-1367254426850/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:48.302; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:48.302; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:48.302; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:48.345; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:48.406; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:48.508; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:48.514; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.156; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.167; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.172; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.185; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.190; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.195; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-29 16:53:49.196; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-29 16:53:49.196; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.197; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-29 16:53:49.198; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-29 16:53:49.198; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.198; org.apache.solr.core.SolrCore; solr.StandardDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.199; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty1-1367254426850/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty1/
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.199; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@54cd7581
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.200; org.apache.solr.core.SolrCore; solr.StandardDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.201; org.apache.solr.core.CachingDirectoryFactory; return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.201; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty1/index/
[junit4:junit4]   1> WARN  - 2013-04-29 16:53:49.202; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.203; org.apache.solr.core.CachingDirectoryFactory; return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty1/index
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.208; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty1/index,segFN=segments_1,generation=1}
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.209; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.212; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.213; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.213; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.214; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.215; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.215; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.216; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.216; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.217; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.230; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.238; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@101fed39 main
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.239; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.240; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.244; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@101fed39 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.247; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.247; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.807; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.808; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:54005_wo_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:54005/wo_"}
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.808; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection collection1 with numShards 1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.809; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.814; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.814; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:49.814; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:50.250; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:50.250; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:54005/wo_ collection:collection1 shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:50.251; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:50.270; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:50.279; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:50.279; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:50.280; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:54005/wo_/collection1/
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:50.280; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:50.280; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:54005/wo_/collection1/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:50.281; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:54005/wo_/collection1/
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:50.281; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/leaders/shard1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.331; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.385; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.385; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.385; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.416; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:54005/wo_/collection1/ and leader is http://127.0.0.1:54005/wo_/collection1/
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.416; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54005/wo_
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.416; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.417; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.417; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.418; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.420; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.420; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.421; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.654; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.658; org.eclipse.jetty.server.AbstractConnector; Started SocketConnector@127.0.0.1:54015
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.659; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.660; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.660; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1367254431435
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.661; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1367254431435/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.661; org.apache.solr.core.CoreContainer; New CoreContainer 1429897126
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.662; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1367254431435/'
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.663; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1367254431435/'
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.780; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.781; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.782; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.782; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.783; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.783; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.784; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.784; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.785; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.785; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.800; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.800; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:53869/solr
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.801; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.802; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.805; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@5e505a73 name:ZooKeeperConnection Watcher:127.0.0.1:53869 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.806; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.808; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.821; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.847; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@24c40fa9 name:ZooKeeperConnection Watcher:127.0.0.1:53869/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.847; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:51.878; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:52.882; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54015_wo_
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:52.909; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:54015_wo_
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:52.910; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:52.913; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:54005_wo__collection1",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:54005_wo_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:54005/wo_"}
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:52.913; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:52.913; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:52.913; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:52.914; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:52.914; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:52.932; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1367254431435/collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:52.933; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:52.933; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:52.933; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:52.933; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:52.941; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:52.941; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:52.942; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:52.942; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:52.942; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1367254431435/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:52.944; org.apache.solr.core.SolrResourceLoader; Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty2-1367254431435/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:52.945; org.apache.solr.core.SolrResourceLoader; Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty2-1367254431435/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:52.948; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:52.996; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:53.056; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:53.158; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:53.164; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:53.793; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:53.804; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:53.809; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:53.822; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:53.827; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:53.832; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-29 16:53:53.833; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-29 16:53:53.834; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:53.834; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-29 16:53:53.835; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-29 16:53:53.835; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:53.836; org.apache.solr.core.SolrCore; solr.StandardDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:53.836; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty2-1367254431435/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty2/
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:53.837; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@54cd7581
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:53.837; org.apache.solr.core.SolrCore; solr.StandardDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:53.838; org.apache.solr.core.CachingDirectoryFactory; return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty2
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:53.839; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty2/index/
[junit4:junit4]   1> WARN  - 2013-04-29 16:53:53.840; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:53.840; org.apache.solr.core.CachingDirectoryFactory; return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty2/index
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:53.850; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty2/index,segFN=segments_1,generation=1}
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:53.850; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:53.853; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:53.854; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:53.855; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:53.856; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:53.856; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:53.857; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:53.857; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:53.858; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:53.858; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:53.871; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:53.879; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@1d7389ff main
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:53.881; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:53.881; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:53.886; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@1d7389ff main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:53.889; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:53.889; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:54.443; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:54.444; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:54015_wo_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:54015/wo_"}
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:54.444; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:54.444; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:54.449; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:54.449; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:54.449; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:54.449; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:54.892; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:54.892; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:54015/wo_ collection:collection1 shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:54.895; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:54015/wo_/collection1/ and leader is http://127.0.0.1:54005/wo_/collection1/
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:54.895; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54015/wo_
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:54.896; org.apache.solr.cloud.ZkController; Core needs to recover:collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:54.896; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:54.897; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:54.897; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:54.897; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:54.898; org.apache.solr.cloud.ZkController; publishing core=collection1 state=recovering
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:54.899; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:54.899; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:54.900; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:54.900; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:54.900; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:54.917; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 127.0.0.1:54015_wo__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.146; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.149; org.eclipse.jetty.server.AbstractConnector; Started SocketConnector@127.0.0.1:54043
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.150; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.151; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.151; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1367254434916
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.152; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1367254434916/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.152; org.apache.solr.core.CoreContainer; New CoreContainer 761851767
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.153; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1367254434916/'
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.153; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1367254434916/'
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.270; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.271; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.271; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.272; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.272; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.273; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.273; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.274; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.275; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.275; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.289; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.290; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:53869/solr
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.291; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.292; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.295; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@4b7a8df2 name:ZooKeeperConnection Watcher:127.0.0.1:53869 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.296; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.307; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.319; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.321; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@6c41854a name:ZooKeeperConnection Watcher:127.0.0.1:53869/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.321; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.332; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.964; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.965; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:54015_wo__collection1",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "state":"recovering",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:54015_wo_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:54015/wo_"}
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.980; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.981; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.981; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.981; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:55.981; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:56.335; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54043_wo_
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:56.337; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:54043_wo_
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:56.340; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:56.341; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:56.341; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:56.341; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:56.340; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:56.342; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:56.341; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:56.341; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:56.342; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:56.350; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:56.356; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1367254434916/collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:56.356; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:56.357; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:56.357; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:56.359; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1367254434916/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:56.360; org.apache.solr.core.SolrResourceLoader; Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty3-1367254434916/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:56.361; org.apache.solr.core.SolrResourceLoader; Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty3-1367254434916/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:56.413; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:56.473; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:56.574; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:56.581; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:56.920; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 127.0.0.1:54015_wo__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:56.921; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:54015_wo__collection1&state=recovering&nodeName=127.0.0.1:54015_wo_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2003 
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.237; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.249; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.253; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.267; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.272; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.277; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-29 16:53:57.278; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-29 16:53:57.279; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.279; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-29 16:53:57.280; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-29 16:53:57.281; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.281; org.apache.solr.core.SolrCore; solr.StandardDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.281; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty3-1367254434916/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty3/
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.282; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@54cd7581
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.283; org.apache.solr.core.SolrCore; solr.StandardDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.283; org.apache.solr.core.CachingDirectoryFactory; return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty3
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.284; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty3/index/
[junit4:junit4]   1> WARN  - 2013-04-29 16:53:57.285; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.286; org.apache.solr.core.CachingDirectoryFactory; return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty3/index
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.292; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty3/index,segFN=segments_1,generation=1}
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.293; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.296; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.296; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.297; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.298; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.299; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.299; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.300; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.300; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.301; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.315; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.323; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@6a3307ed main
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.324; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.325; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.330; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@6a3307ed main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.332; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.332; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.486; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.487; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:54043_wo_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:54043/wo_"}
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.487; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.487; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.492; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.492; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.492; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.492; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:57.492; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.336; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.336; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:54043/wo_ collection:collection1 shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.368; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:54043/wo_/collection1/ and leader is http://127.0.0.1:54005/wo_/collection1/
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.369; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54043/wo_
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.369; org.apache.solr.cloud.ZkController; Core needs to recover:collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.370; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.370; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.370; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.371; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.371; org.apache.solr.cloud.ZkController; publishing core=collection1 state=recovering
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.371; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.372; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.372; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.373; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.380; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.393; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 127.0.0.1:54043_wo__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.612; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.616; org.eclipse.jetty.server.AbstractConnector; Started SocketConnector@127.0.0.1:54106
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.617; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.617; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.618; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1367254438390
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.618; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1367254438390/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.619; org.apache.solr.core.CoreContainer; New CoreContainer 90993263
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.620; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1367254438390/'
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.620; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1367254438390/'
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.738; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 120000
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.739; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.740; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 15000
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.740; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.741; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.741; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.742; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.743; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.743; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.744; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.760; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.760; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:53869/solr
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.761; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.762; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.765; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@55b45dc7 name:ZooKeeperConnection Watcher:127.0.0.1:53869 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.766; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.775; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.787; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.789; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@5fec9428 name:ZooKeeperConnection Watcher:127.0.0.1:53869/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.790; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.801; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.922; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:54005/wo_/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.922; org.apache.solr.update.PeerSync; PeerSync: core=collection1 url=http://127.0.0.1:54015/wo_ START replicas=[http://127.0.0.1:54005/wo_/collection1/] nUpdates=100
[junit4:junit4]   1> WARN  - 2013-04-29 16:53:58.923; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.923; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.924; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.924; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.924; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.925; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:54005/wo_/collection1/. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.925; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.932; org.apache.solr.core.SolrCore; [collection1] webapp=/wo_ path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.938; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.943; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty1/index,segFN=segments_1,generation=1}
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.944; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.947; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty1/index,segFN=segments_1,generation=1}
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty1/index,segFN=segments_2,generation=2}
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.948; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.949; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@7f976ca7 realtime
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.950; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.950; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/wo_ path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 12
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.951; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.952; org.apache.solr.handler.SnapPuller;  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.953; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.954; org.apache.solr.core.SolrCore; [collection1] webapp=/wo_ path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1 
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.955; org.apache.solr.handler.SnapPuller; Master's generation: 2
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.955; org.apache.solr.handler.SnapPuller; Slave's generation: 1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.955; org.apache.solr.handler.SnapPuller; Starting replication process
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.959; org.apache.solr.core.SolrCore; [collection1] webapp=/wo_ path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=1 
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.960; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.961; org.apache.solr.core.CachingDirectoryFactory; return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty2/index.20130430015358960
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.962; org.apache.solr.handler.SnapPuller; Starting download to org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty2/index.20130430015358960 lockFactory=org.apache.lucene.store.NativeFSLockFactory@354bf24d fullCopy=false
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.965; org.apache.solr.core.SolrCore; [collection1] webapp=/wo_ path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.967; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.975; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.976; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.980; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty2/index,segFN=segments_1,generation=1}
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty2/index,segFN=segments_2,generation=2}
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.981; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.981; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used.
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.982; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@4be8224e main
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.983; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@4be8224e main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.984; org.apache.solr.core.CachingDirectoryFactory; looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty2/index.20130430015358960 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty2/index.20130430015358960;done=true>>]
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.984; org.apache.solr.core.CachingDirectoryFactory; Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty2/index.20130430015358960
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.985; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty2/index.20130430015358960
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.986; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.986; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.986; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.986; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:58.988; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:59.009; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:59.010; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:54043_wo__collection1",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "state":"recovering",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:54043_wo_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:54043/wo_"}
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:59.014; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:54015_wo__collection1",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:54015_wo_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:54015/wo_"}
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:59.026; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:59.026; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:59.026; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:59.026; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:59.026; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:59.026; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:59.394; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 127.0.0.1:54043_wo__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:59.394; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:54043_wo__collection1&state=recovering&nodeName=127.0.0.1:54043_wo_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001 
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:59.804; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54106_wo_
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:59.832; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:54106_wo_
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:59.834; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:59.834; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:59.835; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:59.835; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:59.835; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:59.835; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:59.835; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:59.835; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:59.836; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:59.836; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:59.837; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:59.844; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:59.854; org.apache.solr.core.CoreContainer; Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1367254438390/collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:59.854; org.apache.solr.cloud.ZkController; Check for collection zkNode:collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:59.855; org.apache.solr.cloud.ZkController; Collection zkNode exists
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:59.855; org.apache.solr.cloud.ZkController; Load collection config from:/collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:59.856; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1367254438390/collection1/'
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:59.858; org.apache.solr.core.SolrResourceLoader; Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty4-1367254438390/collection1/lib/classes/' to classloader
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:59.858; org.apache.solr.core.SolrResourceLoader; Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-jetty4-1367254438390/collection1/lib/README' to classloader
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:59.934; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-29 16:53:59.994; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:00.096; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:00.102; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:00.737; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:00.749; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:00.753; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:00.767; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:00.772; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:00.776; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-29 16:54:00.777; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-29 16:54:00.779; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:00.779; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-29 16:54:00.780; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-29 16:54:00.780; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:00.781; org.apache.solr.core.SolrCore; solr.StandardDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:00.781; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.SyncSliceTest-jetty4-1367254438390/collection1/, dataDir=./org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty4/
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:00.781; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@54cd7581
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:00.782; org.apache.solr.core.SolrCore; solr.StandardDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:00.783; org.apache.solr.core.CachingDirectoryFactory; return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty4
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:00.784; org.apache.solr.core.SolrCore; New index directory detected: old=null new=./org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty4/index/
[junit4:junit4]   1> WARN  - 2013-04-29 16:54:00.784; org.apache.solr.core.SolrCore; [collection1] Solr index directory './org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:00.785; org.apache.solr.core.CachingDirectoryFactory; return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty4/index
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:00.791; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty4/index,segFN=segments_1,generation=1}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:00.791; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:00.794; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:00.795; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:00.796; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:00.796; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:00.797; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:00.797; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:00.798; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:00.799; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:00.799; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:00.812; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:00.820; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@512bd401 main
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:00.821; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:00.822; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:00.827; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@512bd401 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:00.830; org.apache.solr.cloud.ZkController; publishing core=collection1 state=down
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:00.830; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.396; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:54005/wo_/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.396; org.apache.solr.update.PeerSync; PeerSync: core=collection1 url=http://127.0.0.1:54043/wo_ START replicas=[http://127.0.0.1:54005/wo_/collection1/] nUpdates=100
[junit4:junit4]   1> WARN  - 2013-04-29 16:54:01.397; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.397; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.397; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.397; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.398; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.398; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:54005/wo_/collection1/. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.398; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.399; org.apache.solr.core.SolrCore; [collection1] webapp=/wo_ path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.413; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.418; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty1/index,segFN=segments_2,generation=2}
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty1/index,segFN=segments_3,generation=3}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.418; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 3
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.419; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.420; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/wo_ path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.421; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.421; org.apache.solr.handler.SnapPuller;  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.424; org.apache.solr.core.SolrCore; [collection1] webapp=/wo_ path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.425; org.apache.solr.handler.SnapPuller; Master's generation: 3
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.425; org.apache.solr.handler.SnapPuller; Slave's generation: 1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.426; org.apache.solr.handler.SnapPuller; Starting replication process
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.429; org.apache.solr.core.SolrCore; [collection1] webapp=/wo_ path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=3&version=2} status=0 QTime=1 
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.429; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.431; org.apache.solr.core.CachingDirectoryFactory; return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty3/index.20130430015401430
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.432; org.apache.solr.handler.SnapPuller; Starting download to org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty3/index.20130430015401430 lockFactory=org.apache.lucene.store.NativeFSLockFactory@20b4f34b fullCopy=false
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.436; org.apache.solr.core.SolrCore; [collection1] webapp=/wo_ path=/replication params={file=segments_3&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.438; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.440; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.440; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.445; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty3/index,segFN=segments_1,generation=1}
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty3/index,segFN=segments_3,generation=3}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.446; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 3
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.446; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used.
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.447; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@495fe7f main
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.448; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@495fe7f main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.449; org.apache.solr.core.CachingDirectoryFactory; looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty3/index.20130430015401430 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty3/index.20130430015401430;done=true>>]
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.449; org.apache.solr.core.CachingDirectoryFactory; Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty3/index.20130430015401430
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.450; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty3/index.20130430015401430
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.451; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.451; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.451; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.452; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:01.453; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:02.041; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:02.042; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "shard":null,
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:54106_wo_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:54106/wo_"}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:02.043; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Collection already exists with numShards=1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:02.043; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Assigning new node to shard=shard1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:02.047; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:54043_wo__collection1",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:54043_wo_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:54043/wo_"}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:02.089; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:02.089; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:02.089; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:02.089; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:02.089; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:02.089; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:02.834; org.apache.solr.core.CoreContainer; registering core: collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:02.834; org.apache.solr.cloud.ZkController; Register replica - core:collection1 address:http://127.0.0.1:54106/wo_ collection:collection1 shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:02.839; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:54106/wo_/collection1/ and leader is http://127.0.0.1:54005/wo_/collection1/
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:02.839; org.apache.solr.cloud.ZkController; No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54106/wo_
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:02.840; org.apache.solr.cloud.ZkController; Core needs to recover:collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:02.840; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:02.840; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process.  core=collection1 recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:02.841; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:02.841; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:02.841; org.apache.solr.cloud.ZkController; publishing core=collection1 state=recovering
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:02.842; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:02.842; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:02.843; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:02.844; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:02.844; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:02.866; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:02.866; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 127.0.0.1:54106_wo__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:02.867; org.apache.solr.cloud.AbstractFullDistribZkTestBase; Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:02.868; org.apache.solr.cloud.AbstractDistribZkTestBase; Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:02.868; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:03.600; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:03.601; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:54106_wo__collection1",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "state":"recovering",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:54106_wo_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:54106/wo_"}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:03.643; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:03.643; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:03.643; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:03.643; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:03.643; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:03.643; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:03.868; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 127.0.0.1:54106_wo__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:03.868; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:54106_wo__collection1&state=recovering&nodeName=127.0.0.1:54106_wo_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1002 
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:03.870; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:04.872; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.870; org.apache.solr.cloud.RecoveryStrategy; Attempting to PeerSync from http://127.0.0.1:54005/wo_/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.870; org.apache.solr.update.PeerSync; PeerSync: core=collection1 url=http://127.0.0.1:54106/wo_ START replicas=[http://127.0.0.1:54005/wo_/collection1/] nUpdates=100
[junit4:junit4]   1> WARN  - 2013-04-29 16:54:05.871; org.apache.solr.update.PeerSync; no frame of reference to tell of we've missed updates
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.871; org.apache.solr.cloud.RecoveryStrategy; PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.871; org.apache.solr.cloud.RecoveryStrategy; Starting Replication Recovery. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.871; org.apache.solr.cloud.RecoveryStrategy; Begin buffering updates. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.872; org.apache.solr.update.UpdateLog; Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.872; org.apache.solr.cloud.RecoveryStrategy; Attempting to replicate from http://127.0.0.1:54005/wo_/collection1/. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.872; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.874; org.apache.solr.core.SolrCore; [collection1] webapp=/wo_ path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.875; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.884; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.888; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=3
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty1/index,segFN=segments_2,generation=2}
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty1/index,segFN=segments_3,generation=3}
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty1/index,segFN=segments_4,generation=4}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.889; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 4
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.890; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.890; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/wo_ path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.891; org.apache.solr.handler.ReplicationHandler; Commits will be reserved for  10000
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.891; org.apache.solr.handler.SnapPuller;  No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.894; org.apache.solr.core.SolrCore; [collection1] webapp=/wo_ path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.895; org.apache.solr.handler.SnapPuller; Master's generation: 4
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.895; org.apache.solr.handler.SnapPuller; Slave's generation: 1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.896; org.apache.solr.handler.SnapPuller; Starting replication process
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.899; org.apache.solr.core.SolrCore; [collection1] webapp=/wo_ path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=4&version=2} status=0 QTime=1 
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.900; org.apache.solr.handler.SnapPuller; Number of files in latest index in master: 1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.901; org.apache.solr.core.CachingDirectoryFactory; return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty4/index.20130430015405900
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.901; org.apache.solr.handler.SnapPuller; Starting download to org.apache.lucene.store.NIOFSDirectory@/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty4/index.20130430015405900 lockFactory=org.apache.lucene.store.NativeFSLockFactory@6fbeab97 fullCopy=false
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.905; org.apache.solr.core.SolrCore; [collection1] webapp=/wo_ path=/replication params={file=segments_4&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.907; org.apache.solr.handler.SnapPuller; Total time taken for download : 0 secs
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.916; org.apache.solr.update.DefaultSolrCoreState; Creating new IndexWriter...
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.917; org.apache.solr.update.DefaultSolrCoreState; Waiting until IndexWriter is unused... core=collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.921; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty4/index,segFN=segments_1,generation=1}
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty4/index,segFN=segments_4,generation=4}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.922; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 4
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.923; org.apache.solr.update.DefaultSolrCoreState; New IndexWriter is ready to be used.
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.924; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@3aebc608 main
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.925; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@3aebc608 main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.926; org.apache.solr.core.CachingDirectoryFactory; looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty4/index.20130430015405900 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty4/index.20130430015405900;done=true>>]
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.926; org.apache.solr.core.CachingDirectoryFactory; Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty4/index.20130430015405900
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.926; org.apache.solr.core.CachingDirectoryFactory; Removing directory before core close: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty4/index.20130430015405900
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.927; org.apache.solr.cloud.RecoveryStrategy; No replay needed. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.928; org.apache.solr.cloud.RecoveryStrategy; Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.928; org.apache.solr.cloud.ZkController; publishing core=collection1 state=active
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.928; org.apache.solr.cloud.ZkController; numShards not found on descriptor - reading it from system property
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:05.930; org.apache.solr.cloud.RecoveryStrategy; Finished recovery process. core=collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.650; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.651; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:54106_wo__collection1",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core":"collection1",
[junit4:junit4]   1>   "collection":"collection1",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:54106_wo_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:54106/wo_"}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.694; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.694; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.694; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.694; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.694; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.694; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.877; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.878; org.apache.solr.cloud.AbstractDistribZkTestBase; Recoveries finished - collection: collection1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.890; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.895; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/control/data/index,segFN=segments_1,generation=1}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.896; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.900; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/control/data/index,segFN=segments_1,generation=1}
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/control/data/index,segFN=segments_2,generation=2}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.901; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 2
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.903; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@3d0c9b67 main
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.903; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.904; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@3d0c9b67 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.905; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/wo_ path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 15
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.918; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.922; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=4
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty1/index,segFN=segments_2,generation=2}
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty1/index,segFN=segments_3,generation=3}
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty1/index,segFN=segments_4,generation=4}
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty1/index,segFN=segments_5,generation=5}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.922; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 5
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.924; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@3ebaf436 main
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.924; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.925; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@3ebaf436 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.926; org.apache.solr.update.SolrCmdDistributor; Distrib commit to:[StdNode: http://127.0.0.1:54015/wo_/collection1/, StdNode: http://127.0.0.1:54043/wo_/collection1/, StdNode: http://127.0.0.1:54106/wo_/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.941; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.941; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.941; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.955; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty2/index,segFN=segments_2,generation=2}
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty2/index,segFN=segments_3,generation=3}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.955; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty3/index,segFN=segments_3,generation=3}
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty3/index,segFN=segments_4,generation=4}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.956; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 3
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.956; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty4/index,segFN=segments_4,generation=4}
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty4/index,segFN=segments_5,generation=5}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.956; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 4
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.957; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 5
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.959; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@48074975 main
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.960; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.960; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@19158d4 main
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.960; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@69617267 main
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.961; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.960; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@48074975 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.961; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@19158d4 main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.962; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@69617267 main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.961; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.962; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/wo_ path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 21
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.962; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/wo_ path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 21
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.963; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/wo_ path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 22
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.965; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/wo_ path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 47
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.966; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.969; org.apache.solr.core.SolrCore; [collection1] webapp=/wo_ path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1 
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.971; org.apache.solr.core.SolrCore; [collection1] webapp=/wo_ path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.973; org.apache.solr.core.SolrCore; [collection1] webapp=/wo_ path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:06.975; org.apache.solr.core.SolrCore; [collection1] webapp=/wo_ path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:08.982; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/wo_ path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1433670201093652480)} 0 3
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:08.991; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/wo_ path=/update params={update.distrib=FROMLEADER&_version_=-1433670201098895360&update.from=http://127.0.0.1:54005/wo_/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1433670201098895360)} 0 2
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:08.997; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/wo_ path=/update params={update.distrib=FROMLEADER&_version_=-1433670201098895360&update.from=http://127.0.0.1:54005/wo_/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1433670201098895360)} 0 8
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:08.998; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/wo_ path=/update params={update.distrib=FROMLEADER&_version_=-1433670201098895360&update.from=http://127.0.0.1:54005/wo_/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1433670201098895360)} 0 9
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:08.999; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/wo_ path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1433670201098895360)} 0 14
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.005; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/wo_ path=/update params={wt=javabin&version=2} {add=[0 (1433670201116721152)]} 0 3
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.019; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/wo_ path=/update params={distrib.from=http://127.0.0.1:54005/wo_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1433670201125109760)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.019; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/wo_ path=/update params={distrib.from=http://127.0.0.1:54005/wo_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1433670201125109760)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.019; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/wo_ path=/update params={distrib.from=http://127.0.0.1:54005/wo_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1433670201125109760)]} 0 4
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.021; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/wo_ path=/update params={wt=javabin&version=2} {add=[0 (1433670201125109760)]} 0 12
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.024; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/wo_ path=/update params={wt=javabin&version=2} {add=[1 (1433670201138741248)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.031; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/wo_ path=/update params={distrib.from=http://127.0.0.1:54005/wo_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1433670201142935552)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.032; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/wo_ path=/update params={distrib.from=http://127.0.0.1:54005/wo_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1433670201142935552)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.032; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/wo_ path=/update params={distrib.from=http://127.0.0.1:54005/wo_/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1433670201142935552)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.034; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/wo_ path=/update params={wt=javabin&version=2} {add=[1 (1433670201142935552)]} 0 7
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.037; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/wo_ path=/update params={wt=javabin&version=2} {add=[2 (1433670201152372736)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.041; org.apache.solr.update.processor.DistributedUpdateProcessor; test.distrib.skip.servers was found and contains:[http://127.0.0.1:54015/wo_/collection1/]
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.041; org.apache.solr.update.processor.DistributedUpdateProcessor; check url:http://127.0.0.1:54015/wo_/collection1/ against:[http://127.0.0.1:54015/wo_/collection1/] result:true
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.042; org.apache.solr.update.processor.DistributedUpdateProcessor; check url:http://127.0.0.1:54043/wo_/collection1/ against:[http://127.0.0.1:54015/wo_/collection1/] result:false
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.042; org.apache.solr.update.processor.DistributedUpdateProcessor; check url:http://127.0.0.1:54106/wo_/collection1/ against:[http://127.0.0.1:54015/wo_/collection1/] result:false
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.047; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/wo_ path=/update params={distrib.from=http://127.0.0.1:54005/wo_/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:54015/wo_/collection1/&wt=javabin&version=2} {add=[2 (1433670201158664192)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.047; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/wo_ path=/update params={distrib.from=http://127.0.0.1:54005/wo_/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:54015/wo_/collection1/&wt=javabin&version=2} {add=[2 (1433670201158664192)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.048; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/wo_ path=/update params={test.distrib.skip.servers=http://127.0.0.1:54015/wo_/collection1/&wt=javabin&version=2} {add=[2 (1433670201158664192)]} 0 8
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.052; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/wo_ path=/update params={wt=javabin&version=2} {add=[3 (1433670201168101376)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.055; org.apache.solr.update.processor.DistributedUpdateProcessor; test.distrib.skip.servers was found and contains:[http://127.0.0.1:54043/wo_/collection1/, http://127.0.0.1:54015/wo_/collection1/]
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.056; org.apache.solr.update.processor.DistributedUpdateProcessor; check url:http://127.0.0.1:54015/wo_/collection1/ against:[http://127.0.0.1:54043/wo_/collection1/, http://127.0.0.1:54015/wo_/collection1/] result:true
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.056; org.apache.solr.update.processor.DistributedUpdateProcessor; check url:http://127.0.0.1:54043/wo_/collection1/ against:[http://127.0.0.1:54043/wo_/collection1/, http://127.0.0.1:54015/wo_/collection1/] result:true
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.057; org.apache.solr.update.processor.DistributedUpdateProcessor; check url:http://127.0.0.1:54106/wo_/collection1/ against:[http://127.0.0.1:54043/wo_/collection1/, http://127.0.0.1:54015/wo_/collection1/] result:false
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.061; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/wo_ path=/update params={distrib.from=http://127.0.0.1:54005/wo_/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:54015/wo_/collection1/&wt=javabin&version=2} {add=[3 (1433670201174392832)]} 0 1
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.062; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/wo_ path=/update params={test.distrib.skip.servers=http://127.0.0.1:54015/wo_/collection1/&test.distrib.skip.servers=http://127.0.0.1:54043/wo_/collection1/&wt=javabin&version=2} {add=[3 (1433670201174392832)]} 0 7
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.065; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.175; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/control/data/index,segFN=segments_2,generation=2}
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/control/data/index,segFN=segments_3,generation=3}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.176; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 3
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.184; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@671c1ae7 main
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.185; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.185; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@671c1ae7 main{StandardDirectoryReader(segments_3:3:nrt _0(5.0):C4)}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.186; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/wo_ path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 121
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.189; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.239; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=5
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty1/index,segFN=segments_2,generation=2}
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty1/index,segFN=segments_3,generation=3}
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty1/index,segFN=segments_4,generation=4}
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty1/index,segFN=segments_5,generation=5}
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty1/index,segFN=segments_6,generation=6}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.240; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 6
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.248; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@77e1a415 main
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.249; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.250; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@77e1a415 main{StandardDirectoryReader(segments_6:3:nrt _0(5.0):C4)}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.251; org.apache.solr.update.SolrCmdDistributor; Distrib commit to:[StdNode: http://127.0.0.1:54015/wo_/collection1/, StdNode: http://127.0.0.1:54043/wo_/collection1/, StdNode: http://127.0.0.1:54106/wo_/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.254; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.254; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.254; org.apache.solr.update.DirectUpdateHandler2; start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.359; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty4/index,segFN=segments_5,generation=5}
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty4/index,segFN=segments_6,generation=6}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.360; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty2/index,segFN=segments_3,generation=3}
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty2/index,segFN=segments_4,generation=4}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.360; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty3/index,segFN=segments_4,generation=4}
[junit4:junit4]   1> 	commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.SyncSliceTest-1367254422809/jetty3/index,segFN=segments_5,generation=5}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.361; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 4
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.360; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 6
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.362; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 5
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.371; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@15da92a main
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.372; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@62827c8a main
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.372; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@441ad139 main
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.373; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@15da92a main{StandardDirectoryReader(segments_6:3:nrt _0(5.0):C4)}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.374; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> WARN  - 2013-04-29 16:54:09.374; org.apache.solr.core.JmxMonitoredMap; Failed to register info bean: fieldValueCache
[junit4:junit4]   1> javax.management.InstanceAlreadyExistsException: solr/collection1:type=fieldValueCache,id=org.apache.solr.search.FastLRUCache
[junit4:junit4]   1> 	at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
[junit4:junit4]   1> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
[junit4:junit4]   1> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
[junit4:junit4]   1> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
[junit4:junit4]   1> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
[junit4:junit4]   1> 	at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:513)
[junit4:junit4]   1> 	at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:140)
[junit4:junit4]   1> 	at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:51)
[junit4:junit4]   1> 	at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:302)
[junit4:junit4]   1> 	at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:1784)
[junit4:junit4]   1> 	at org.apache.solr.core.SolrCore.access$000(SolrCore.java:131)
[junit4:junit4]   1> 	at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1661)
[junit4:junit4]   1> 	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
[junit4:junit4]   1> 	at java.util.concurrent.FutureTask.run(FutureTask.java:166)
[junit4:junit4]   1> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4:junit4]   1> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4]   1> 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.373; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.372; org.apache.solr.update.DirectUpdateHandler2; end_commit_flush
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.375; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@62827c8a main{StandardDirectoryReader(segments_5:3:nrt _0(5.0):C3)}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.374; org.apache.solr.core.SolrCore; [collection1] Registered new searcher Searcher@441ad139 main{StandardDirectoryReader(segments_4:3:nrt _0(5.0):C2)}
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.376; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/wo_ path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 122
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.377; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/wo_ path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 123
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.376; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/wo_ path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 122
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.378; org.apache.solr.update.processor.LogUpdateProcessor; [collection1] webapp=/wo_ path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 189
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.379; org.apache.solr.cloud.AbstractDistribZkTestBase; Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):230
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.380; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 16:54:09.381; org.apache.solr.cloud.AbstractDistribZkTestBase; Recoverie

[...truncated too long message...]

138301440}, {id=220, _version_=1433670649056854016}, {id=97, _version_=1433670647329849344}, {id=219, _version_=1433670649043222528}, {id=7, _version_=1433670646176415744}, {id=273, _version_=1433670649856917504}, {id=36, _version_=1433670646607380480}, {id=73, _version_=1433670647035199488}, {id=130, _version_=1433670647755571200}, {id=147, _version_=1433670647995695104}, {id=254, _version_=1433670649593724928}, {id=161, _version_=1433670648198070272}, {id=102, _version_=1433670647393812480}, {id=74, _version_=1433670647046733824}, {id=92, _version_=1433670647267983360}, {id=259, _version_=1433670649661882368}, {id=32, _version_=1433670646549708800}, {id=286, _version_=1433670650079215616}, {id=224, _version_=1433670649111379968}, {id=287, _version_=1433670650094944256}, {id=52, _version_=1433670646792978432}, {id=210, _version_=1433670648918441984}, {id=264, _version_=1433670649734234112}, {id=90, _version_=1433670647242817536}, {id=257, _version_=1433670649634619392}, {id=162, _version_=1433670648211701760}, {id=78, _version_=1433670647092871168}, {id=56, _version_=1433670646839115776}, {id=256, _version_=1433670649620987904}, {id=276, _version_=1433670649897811968}, {id=214, _version_=1433670648975065088}, {id=255, _version_=1433670649607356416}, {id=137, _version_=1433670647853088768}, {id=129, _version_=1433670647741939712}, {id=88, _version_=1433670647218700288}, {id=209, _version_=1433670648904810496}, {id=272, _version_=1433670649843286016}, {id=28, _version_=1433670646494134272}, {id=258, _version_=1433670649648250880}, {id=218, _version_=1433670649029591040}, {id=51, _version_=1433670646781444096}, {id=136, _version_=1433670647839457280}, {id=10, _version_=1433670646222553088}, {id=27, _version_=1433670646478405632}, {id=5, _version_=1433670646119792640}, {id=289, _version_=1433670650124304384}, {id=93, _version_=1433670647280566272}, {id=277, _version_=1433670649935560704}, {id=156, _version_=1433670648124669952}, {id=140, _version_=1433670647895031808}, {id=141, _version_=1433670647908663296}, {id=121, _version_=1433670647629742080}, {id=281, _version_=1433670650003718144}, {id=217, _version_=1433670649015959552}, {id=197, _version_=1433670648729698304}, {id=96, _version_=1433670647318315008}, {id=265, _version_=1433670649747865600}, {id=221, _version_=1433670649070485504}, {id=186, _version_=1433670648552488960}, {id=173, _version_=1433670648370036736}, {id=167, _version_=1433670648285102080}, {id=172, _version_=1433670648356405248}, {id=9, _version_=1433670646206824448}, {id=6, _version_=1433670646162784256}, {id=246, _version_=1433670649427001344}, {id=49, _version_=1433670646758375424}, {id=283, _version_=1433670650033078272}, {id=120, _version_=1433670647617159168}, {id=175, _version_=1433670648398348288}, {id=202, _version_=1433670648803098624}, {id=169, _version_=1433670648314462208}, {id=57, _version_=1433670646850650112}, {id=80, _version_=1433670647115939840}, {id=135, _version_=1433670647825825792}, {id=21, _version_=1433670646390325248}, {id=275, _version_=1433670649884180480}, {id=185, _version_=1433670648537808896}, {id=188, _version_=1433670648579751936}, {id=113, _version_=1433670647528030208}, {id=274, _version_=1433670649870548992}, {id=84, _version_=1433670647167320064}, {id=236, _version_=1433670649280200704}, {id=72, _version_=1433670647023665152}, {id=203, _version_=1433670648818827264}, {id=226, _version_=1433670649139691520}, {id=46, _version_=1433670646723772416}, {id=26, _version_=1433670646465822720}, {id=155, _version_=1433670648111038464}, {id=158, _version_=1433670648151932928}, {id=251, _version_=1433670649551781888}, {id=94, _version_=1433670647293149184}, {id=263, _version_=1433670649720602624}, {id=187, _version_=1433670648566120448}, {id=184, _version_=1433670648524177408}, {id=183, _version_=1433670648510545920}, {id=118, _version_=1433670647591993344}, {id=262, _version_=1433670649706971136}, {id=139, _version_=1433670647881400320}, {id=278, _version_=1433670649957580800}, {id=62, _version_=1433670646908321792}, {id=295, _version_=1433670650209239040}, {id=206, _version_=1433670648861818880}, {id=33, _version_=1433670646563340288}, {id=260, _version_=1433670649676562432}, {id=41, _version_=1433670646666100736}, {id=227, _version_=1433670649153323008}, {id=290, _version_=1433670650137935872}, {id=243, _version_=1433670649375621120}, {id=143, _version_=1433670647938023424}, {id=280, _version_=1433670649990086656}, {id=47, _version_=1433670646735306752}, {id=34, _version_=1433670646576971776}, {id=178, _version_=1433670648441339904}, {id=35, _version_=1433670646592700416}, {id=81, _version_=1433670647129571328}, {id=207, _version_=1433670648877547520}, {id=165, _version_=1433670648256790528}, {id=64, _version_=1433670646931390464}, {id=63, _version_=1433670646919856128}, {id=58, _version_=1433670646862184448}, {id=179, _version_=1433670648454971392}, {id=89, _version_=1433670647230234624}, {id=15, _version_=1433670646295953408}, {id=50, _version_=1433670646769909760}, {id=294, _version_=1433670650195607552}, {id=17, _version_=1433670646323216384}, {id=100, _version_=1433670647367598080}, {id=237, _version_=1433670649293832192}, {id=101, _version_=1433670647381229568}, {id=144, _version_=1433670647951654912}, {id=192, _version_=1433670648658395136}, {id=16, _version_=1433670646309584896}, {id=99, _version_=1433670647353966592}, {id=231, _version_=1433670649207848960}, {id=153, _version_=1433670648082726912}, {id=69, _version_=1433670646989062144}]
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SyncSliceTest -Dtests.method=testDistribSearch -Dtests.seed=B8D30226B4772CCF -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es_DO -Dtests.timezone=Asia/Irkutsk -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE  887s J1 | SyncSliceTest.testDistribSearch <<<
[junit4:junit4]    > Throwable #1: java.lang.AssertionError: shard1 is not consistent.  Got 305 from http://127.0.0.1:54043/wo_/collection1lastClient and got 5 from http://127.0.0.1:54106/wo_/collection1
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([B8D30226B4772CCF:39358C3EC3284CF3]:0)
[junit4:junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:963)
[junit4:junit4]    > 	at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:238)
[junit4:junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4]    > 	at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   1> INFO  - 2013-04-29 17:08:30.198; org.apache.solr.SolrTestCaseJ4; ###deleteCore
[junit4:junit4]   2> NOTE: test params are: codec=CheapBastard, sim=DefaultSimilarity, locale=es_DO, timezone=Asia/Irkutsk
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_17 (64-bit)/cpus=16,threads=5,free=327195656,total=523239424
[junit4:junit4]   2> NOTE: All tests run in this JVM: [BadIndexSchemaTest, TestIndexSearcher, TestPropInject, PathHierarchyTokenizerFactoryTest, DebugComponentTest, TestDynamicFieldResource, UpdateParamsTest, StandardRequestHandlerTest, CoreContainerCoreInitFailuresTest, TestUpdate, XmlUpdateRequestHandlerTest, TestPartialUpdateDeduplication, TestDefaultSimilarityFactory, TestSolrXMLSerializer, TestFastOutputStream, BasicZkTest, TestFieldTypeResource, TestMultiCoreConfBootstrap, DocumentAnalysisRequestHandlerTest, TestSchemaVersionResource, CopyFieldTest, TestFoldingMultitermQuery, TestArbitraryIndexDir, HardAutoCommitTest, TestPostingsSolrHighlighter, TestBM25SimilarityFactory, SolrTestCaseJ4Test, TestStressLucene, ZkNodePropsTest, TestHashPartitioner, TestOmitPositions, OpenExchangeRatesOrgProviderTest, SimplePostToolTest, LeaderElectionIntegrationTest, SolrPluginUtilsTest, TestFieldTypeCollectionResource, ShardSplitTest, TestManagedSchemaFieldResource, TestFieldResource, IndexReaderFactoryTest, TestLuceneMatchVersion, TestRangeQuery, TestReload, TestSolrJ, CollectionsAPIDistributedZkTest, TestCloudManagedSchema, TestCodecSupport, HighlighterTest, TestJmxMonitoredMap, TestQueryTypes, TestSystemIdResolver, SolrRequestParserTest, SignatureUpdateProcessorFactoryTest, SolrIndexConfigTest, DocValuesMultiTest, ConvertedLegacyTest, XsltUpdateRequestHandlerTest, TestMergePolicyConfig, SpellCheckCollatorTest, FileUtilsTest, IndexBasedSpellCheckerTest, CurrencyFieldXmlFileTest, FieldAnalysisRequestHandlerTest, DefaultValueUpdateProcessorTest, TestFiltering, TestLMJelinekMercerSimilarityFactory, PingRequestHandlerTest, TestIndexingPerformance, ChaosMonkeySafeLeaderTest, SyncSliceTest]
[junit4:junit4] Completed on J1 in 887.43s, 1 test, 1 failure <<< FAILURES!

[...truncated 276 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:378: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:358: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:1240: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:884: There were test failures: 293 suites, 1219 tests, 1 failure, 27 ignored (8 assumptions)

Total time: 54 minutes 38 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-Tests-trunk-java7 - Build # 3941 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-java7/3941/

3 tests failed.
REGRESSION:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 230 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 230 seconds
	at __randomizedtesting.SeedInfo.seed([7B2286C060BCB9D2:FAC408D817E3D9EE]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:173)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:131)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:126)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:511)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:145)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:722)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.CollectionsAPIDistributedZkTest:     1) Thread[id=651, name=recoveryCmdExecutor-521-thread-1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]         at java.net.PlainSocketImpl.socketConnect(Native Method)         at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)         at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)         at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)         at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:391)         at java.net.Socket.connect(Socket.java:579)         at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:127)         at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:180)         at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:294)         at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:645)         at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:480)         at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)         at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)         at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)         at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:365)         at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)         at org.apache.solr.cloud.SyncStrategy$1.run(SyncStrategy.java:298)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:722)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.CollectionsAPIDistributedZkTest: 
   1) Thread[id=651, name=recoveryCmdExecutor-521-thread-1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
        at java.net.PlainSocketImpl.socketConnect(Native Method)
        at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
        at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
        at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:391)
        at java.net.Socket.connect(Socket.java:579)
        at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:127)
        at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:180)
        at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:294)
        at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:645)
        at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:480)
        at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
        at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
        at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
        at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:365)
        at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
        at org.apache.solr.cloud.SyncStrategy$1.run(SyncStrategy.java:298)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:722)
	at __randomizedtesting.SeedInfo.seed([7B2286C060BCB9D2]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=651, name=recoveryCmdExecutor-521-thread-1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]         at java.net.PlainSocketImpl.socketConnect(Native Method)         at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)         at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)         at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)         at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:391)         at java.net.Socket.connect(Socket.java:579)         at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:127)         at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:180)         at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:294)         at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:645)         at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:480)         at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)         at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)         at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)         at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:365)         at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)         at org.apache.solr.cloud.SyncStrategy$1.run(SyncStrategy.java:298)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:722)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=651, name=recoveryCmdExecutor-521-thread-1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
        at java.net.PlainSocketImpl.socketConnect(Native Method)
        at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
        at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
        at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:391)
        at java.net.Socket.connect(Socket.java:579)
        at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:127)
        at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:180)
        at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:294)
        at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:645)
        at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:480)
        at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
        at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
        at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
        at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:365)
        at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
        at org.apache.solr.cloud.SyncStrategy$1.run(SyncStrategy.java:298)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:722)
	at __randomizedtesting.SeedInfo.seed([7B2286C060BCB9D2]:0)




Build Log:
[...truncated 9169 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:17.684; org.apache.solr.BaseDistributedSearchTestCase; Setting hostContext system property: /
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:17.694; org.apache.solr.SolrTestCaseJ4; ###Starting testDistribSearch
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:17.696; org.apache.solr.cloud.ZkTestServer; STARTING ZK TEST SERVER
[junit4:junit4]   1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:17.697; org.apache.solr.cloud.ZkTestServer$ZKServerMain; Starting server
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:17.798; org.apache.solr.cloud.ZkTestServer; start zk server on port:25829
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:17.799; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:17.803; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@6c9b4e02 name:ZooKeeperConnection Watcher:127.0.0.1:25829 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:17.803; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:17.804; org.apache.solr.common.cloud.SolrZkClient; makePath: /solr
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:17.809; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:17.817; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@33f67b05 name:ZooKeeperConnection Watcher:127.0.0.1:25829/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:17.817; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:17.818; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:17.827; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/collection1/shards
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:17.831; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:17.834; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/control_collection/shards
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:17.838; org.apache.solr.cloud.AbstractZkTestCase; put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:17.839; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:17.851; org.apache.solr.cloud.AbstractZkTestCase; put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:17.852; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/schema.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:17.957; org.apache.solr.cloud.AbstractZkTestCase; put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:17.958; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/stopwords.txt
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:17.962; org.apache.solr.cloud.AbstractZkTestCase; put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:17.962; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/protwords.txt
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:17.973; org.apache.solr.cloud.AbstractZkTestCase; put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:17.974; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/currency.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:17.978; org.apache.solr.cloud.AbstractZkTestCase; put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:17.978; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:17.982; org.apache.solr.cloud.AbstractZkTestCase; put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:17.983; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:17.987; org.apache.solr.cloud.AbstractZkTestCase; put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:17.987; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:17.991; org.apache.solr.cloud.AbstractZkTestCase; put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:17.991; org.apache.solr.common.cloud.SolrZkClient; makePath: /configs/conf1/synonyms.txt
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.153; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.157; org.eclipse.jetty.server.AbstractConnector; Started SocketConnector@127.0.0.1:25836
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.158; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.158; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.158; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1367230337996
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.159; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1367230337996/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.159; org.apache.solr.core.CoreContainer; New CoreContainer 568786783
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.160; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1367230337996/'
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.160; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1367230337996/'
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.251; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1367230337996
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.255; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1367230337996/collection1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.255; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1367230337996/collection1/conf
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.282; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1367230337996/collection1/conf/xslt
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.361; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1367230337996/collection1/lib
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.363; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1367230337996/collection1/lib/classes
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.365; org.apache.solr.core.SolrCoreDiscoverer; Discovered properties file /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1367230337996/conf/core.properties, adding to cores
[junit4:junit4]   1> SET INST DIR:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1367230337996/conf
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.371; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 0
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.371; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.371; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 0
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.372; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.372; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.372; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.373; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.373; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.373; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.374; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.386; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.386; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:25829/solr
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.387; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.387; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.390; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@6827bf56 name:ZooKeeperConnection Watcher:127.0.0.1:25829 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.391; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.393; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.402; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.405; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@79097df0 name:ZooKeeperConnection Watcher:127.0.0.1:25829/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.405; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.414; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.419; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/collection-queue-work
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.429; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.432; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:25836_
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.434; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:25836_
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.439; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/election
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.452; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer_elect/leader
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.461; org.apache.solr.cloud.Overseer; Overseer (id=89602807411572739-127.0.0.1:25836_-n_0000000000) starting
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.486; org.apache.solr.common.cloud.SolrZkClient; makePath: /overseer/queue-work
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.490; org.apache.solr.cloud.OverseerCollectionProcessor; Process current queue of collection creations
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.490; org.apache.solr.common.cloud.SolrZkClient; makePath: /clusterstate.json
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.492; org.apache.solr.common.cloud.SolrZkClient; makePath: /aliases.json
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.494; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.497; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Starting to work on the main queue
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.499; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.499; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.554; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.571; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.575; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.579; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@345d626c name:ZooKeeperConnection Watcher:127.0.0.1:25829/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.579; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.581; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.585; org.apache.solr.cloud.ChaosMonkey; monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.742; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.744; org.eclipse.jetty.server.AbstractConnector; Started SocketConnector@127.0.0.1:25845
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.745; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.745; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.745; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1367230338586
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.746; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1367230338586/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.746; org.apache.solr.core.CoreContainer; New CoreContainer 957384846
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.746; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1367230338586/'
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.747; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1367230338586/'
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.861; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1367230338586
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.866; org.apache.solr.core.SolrCoreDiscoverer; Discovered properties file /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1367230338586/conf/core.properties, adding to cores
[junit4:junit4]   1> SET INST DIR:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1367230338586/conf
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.867; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1367230338586/collection1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:18.869; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1367230338586/collection1/conf
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:19.023; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1367230338586/collection1/conf/xslt
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:19.042; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1367230338586/collection1/lib
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:19.043; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1367230338586/collection1/lib/classes
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:19.055; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 0
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:19.056; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:19.056; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 0
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:19.057; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:19.058; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:19.059; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:19.059; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:19.060; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:19.060; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:19.061; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:19.080; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:19.081; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:25829/solr
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:19.081; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:19.082; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:19.091; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@1be014ce name:ZooKeeperConnection Watcher:127.0.0.1:25829 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:19.092; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:19.106; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:19.120; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:19.123; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@5d68a5b8 name:ZooKeeperConnection Watcher:127.0.0.1:25829/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:19.123; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:19.136; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.140; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:25845_
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.143; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:25845_
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.147; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.147; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.147; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (2)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.159; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.159; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.160; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.421; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.424; org.eclipse.jetty.server.AbstractConnector; Started SocketConnector@127.0.0.1:25853
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.425; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.425; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.426; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1367230340173
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.426; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1367230340173/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.427; org.apache.solr.core.CoreContainer; New CoreContainer 2070555408
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.427; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1367230340173/'
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.428; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1367230340173/'
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.533; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1367230340173
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.539; org.apache.solr.core.SolrCoreDiscoverer; Discovered properties file /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1367230340173/conf/core.properties, adding to cores
[junit4:junit4]   1> SET INST DIR:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1367230340173/conf
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.540; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1367230340173/collection1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.541; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1367230340173/collection1/conf
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.562; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1367230340173/collection1/conf/xslt
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.751; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1367230340173/collection1/lib
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.755; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1367230340173/collection1/lib/classes
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.766; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 0
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.767; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.767; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 0
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.768; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.768; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.769; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.769; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.770; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.770; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.771; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.794; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.794; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:25829/solr
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.795; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.796; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.851; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@7ac8e54b name:ZooKeeperConnection Watcher:127.0.0.1:25829 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.852; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.855; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.870; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.911; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@2d6448ce name:ZooKeeperConnection Watcher:127.0.0.1:25829/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.911; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:20.918; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:21.923; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:25853_
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:21.953; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:25853_
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:21.958; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:21.958; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:21.958; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:21.958; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (3)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:21.974; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:21.975; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:21.976; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.247; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.251; org.eclipse.jetty.server.AbstractConnector; Started SocketConnector@127.0.0.1:25878
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.251; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.252; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.253; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1367230341993
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.253; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1367230341993/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.254; org.apache.solr.core.CoreContainer; New CoreContainer 58014754
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.254; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1367230341993/'
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.255; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1367230341993/'
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.380; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1367230341993
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.383; org.apache.solr.core.SolrCoreDiscoverer; Discovered properties file /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1367230341993/conf/core.properties, adding to cores
[junit4:junit4]   1> SET INST DIR:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1367230341993/conf
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.390; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1367230341993/collection1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.393; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1367230341993/collection1/lib
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.396; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1367230341993/collection1/lib/classes
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.398; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1367230341993/collection1/conf
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.557; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1367230341993/collection1/conf/xslt
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.586; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 0
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.587; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.588; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 0
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.588; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.589; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.589; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.590; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.591; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.592; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.594; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.636; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.638; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:25829/solr
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.639; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.863; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.866; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@2d584a4e name:ZooKeeperConnection Watcher:127.0.0.1:25829 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.867; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.886; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.900; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.903; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@21fba592 name:ZooKeeperConnection Watcher:127.0.0.1:25829/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.903; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:22.909; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:23.914; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:25878_
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:23.916; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:25878_
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:23.926; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:23.927; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:23.927; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:23.927; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:23.928; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (4)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:23.950; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:23.951; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:23.951; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.335; org.eclipse.jetty.server.Server; jetty-8.1.10.v20130312
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.353; org.eclipse.jetty.server.AbstractConnector; Started SocketConnector@127.0.0.1:25889
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.354; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init()
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.355; org.apache.solr.core.SolrResourceLoader; JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.356; org.apache.solr.core.SolrResourceLoader; using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1367230343959
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.357; org.apache.solr.core.CoreContainer$Initializer; looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1367230343959/solr.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.358; org.apache.solr.core.CoreContainer; New CoreContainer 603158386
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.359; org.apache.solr.core.CoreContainer; Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1367230343959/'
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.359; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1367230343959/'
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.510; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1367230343959
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.513; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1367230343959/collection1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.515; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1367230343959/collection1/lib
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.516; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1367230343959/collection1/lib/classes
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.520; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1367230343959/collection1/conf
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.647; org.apache.solr.core.SolrCoreDiscoverer; Looking for cores in /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1367230343959/collection1/conf/xslt
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.714; org.apache.solr.core.SolrCoreDiscoverer; Discovered properties file /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1367230343959/conf/core.properties, adding to cores
[junit4:junit4]   1> SET INST DIR:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1367230343959/conf
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.720; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting socketTimeout to: 0
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.720; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting urlScheme to: http://
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.721; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting connTimeout to: 0
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.721; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxConnectionsPerHost to: 20
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.722; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting corePoolSize to: 0
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.722; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maximumPoolSize to: 2147483647
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.723; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting maxThreadIdleTime to: 5
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.723; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting sizeOfQueue to: -1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.724; org.apache.solr.handler.component.HttpShardHandlerFactory; Setting fairnessPolicy to: false
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.724; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=0&connTimeout=0&retry=false
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.740; org.apache.solr.core.CoreContainer; Registering Log Listener
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.741; org.apache.solr.core.ZkContainer; Zookeeper client=127.0.0.1:25829/solr
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.741; org.apache.solr.cloud.ZkController; zkHost includes chroot
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.753; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.788; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@37bf78f8 name:ZooKeeperConnection Watcher:127.0.0.1:25829 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.792; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.806; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.820; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.822; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@6e125809 name:ZooKeeperConnection Watcher:127.0.0.1:25829/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.823; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:24.835; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:25.857; org.apache.solr.cloud.ZkController; Register node as live in ZooKeeper:/live_nodes/127.0.0.1:25889_
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:25.896; org.apache.solr.common.cloud.SolrZkClient; makePath: /live_nodes/127.0.0.1:25889_
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:25.930; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:25.930; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:25.930; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:25.930; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:25.930; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:25.930; org.apache.solr.common.cloud.ZkStateReader$3; Updating live nodes... (5)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:25.979; org.apache.solr.servlet.SolrDispatchFilter; user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:25.980; org.apache.solr.servlet.SolrDispatchFilter; SolrDispatchFilter.init() done
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:25.981; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:26.000; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.027; org.apache.solr.handler.admin.CollectionsHandler; Creating Collection : numShards=2&name=nodes_used_collection&replicationFactor=2&action=CREATE&wt=javabin&version=2
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.030; org.apache.solr.cloud.DistributedQueue$LatchChildWatcher; Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.033; org.apache.solr.cloud.OverseerCollectionProcessor; Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4:junit4]   1>   "operation":"createcollection",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "maxShardsPerNode":null,
[junit4:junit4]   1>   "createNodeSet":null,
[junit4:junit4]   1>   "name":"nodes_used_collection",
[junit4:junit4]   1>   "replicationFactor":"2"}
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.034; org.apache.solr.cloud.OverseerCollectionProcessor; Creating shard nodes_used_collection_shard1_replica1 as part of slice shard1 of collection nodes_used_collection on 127.0.0.1:25878_
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.046; org.apache.solr.cloud.OverseerCollectionProcessor; Creating shard nodes_used_collection_shard1_replica2 as part of slice shard1 of collection nodes_used_collection on 127.0.0.1:25836_
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.047; org.apache.solr.cloud.OverseerCollectionProcessor; Creating shard nodes_used_collection_shard2_replica1 as part of slice shard2 of collection nodes_used_collection on 127.0.0.1:25853_
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.048; org.apache.solr.cloud.OverseerCollectionProcessor; Creating shard nodes_used_collection_shard2_replica2 as part of slice shard2 of collection nodes_used_collection on 127.0.0.1:25889_
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.088; org.apache.solr.core.CoreContainer; Creating SolrCore 'nodes_used_collection_shard2_replica1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1367230340173/nodes_used_collection_shard2_replica1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.088; org.apache.solr.core.CoreContainer; Creating SolrCore 'nodes_used_collection_shard2_replica2' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1367230343959/nodes_used_collection_shard2_replica2
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.088; org.apache.solr.core.CoreContainer; Creating SolrCore 'nodes_used_collection_shard1_replica1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1367230341993/nodes_used_collection_shard1_replica1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.088; org.apache.solr.core.CoreContainer; Creating SolrCore 'nodes_used_collection_shard1_replica2' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1367230337996/nodes_used_collection_shard1_replica2
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.093; org.apache.solr.cloud.ZkController; Check for collection zkNode:nodes_used_collection
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.092; org.apache.solr.cloud.ZkController; Check for collection zkNode:nodes_used_collection
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.090; org.apache.solr.cloud.ZkController; Check for collection zkNode:nodes_used_collection
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.096; org.apache.solr.cloud.ZkController; Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.097; org.apache.solr.cloud.ZkController; Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.094; org.apache.solr.cloud.ZkController; Check for collection zkNode:nodes_used_collection
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.098; org.apache.solr.cloud.ZkController; Looking for collection configName
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.097; org.apache.solr.cloud.ZkController; Looking for collection configName
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.097; org.apache.solr.cloud.ZkController; Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.101; org.apache.solr.cloud.ZkController; Only one config set found in zk - using it:conf1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.100; org.apache.solr.cloud.ZkController; Only one config set found in zk - using it:conf1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.099; org.apache.solr.cloud.ZkController; Creating collection in ZooKeeper:nodes_used_collection
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.105; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/nodes_used_collection
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.103; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/nodes_used_collection
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.102; org.apache.solr.cloud.ZkController; Looking for collection configName
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.106; org.apache.solr.cloud.ZkController; Looking for collection configName
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.110; org.apache.solr.cloud.ZkController; Only one config set found in zk - using it:conf1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.110; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/nodes_used_collection
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.110; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/nodes_used_collection
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.110; org.apache.solr.cloud.ZkController; Load collection config from:/collections/nodes_used_collection
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.111; org.apache.solr.cloud.ZkController; Load collection config from:/collections/nodes_used_collection
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.120; org.apache.solr.cloud.ZkController; Load collection config from:/collections/nodes_used_collection
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.122; org.apache.solr.cloud.ZkController; Load collection config from:/collections/nodes_used_collection
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.123; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1367230341993/nodes_used_collection_shard1_replica1/'
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.123; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1367230343959/nodes_used_collection_shard2_replica2/'
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.123; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1367230340173/nodes_used_collection_shard2_replica1/'
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.124; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1367230337996/nodes_used_collection_shard1_replica2/'
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.204; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.204; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.212; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.218; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.282; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.285; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.295; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.318; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.384; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.387; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.390; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.392; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.398; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.403; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.420; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:27.429; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.154; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.168; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.187; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.209; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.214; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.220; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.221; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.226; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.227; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:28.229; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:28.230; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.230; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:28.232; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:28.233; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.233; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.234; org.apache.solr.core.SolrCore; [nodes_used_collection_shard1_replica1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1367230341993/nodes_used_collection_shard1_replica1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1367230341993/nodes_used_collection_shard1_replica1/data/
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.235; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4971dddf
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.236; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.237; org.apache.solr.core.CachingDirectoryFactory; return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1367230341993/nodes_used_collection_shard1_replica1/data
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.237; org.apache.solr.core.SolrCore; New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1367230341993/nodes_used_collection_shard1_replica1/data/index/
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:28.237; org.apache.solr.core.SolrCore; [nodes_used_collection_shard1_replica1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1367230341993/nodes_used_collection_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.238; org.apache.solr.core.CachingDirectoryFactory; return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1367230341993/nodes_used_collection_shard1_replica1/data/index
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.244; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@7e960d1a lockFactory=org.apache.lucene.store.NativeFSLockFactory@1b3ac255),segFN=segments_1,generation=1}
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.244; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.248; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.248; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.249; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.250; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.251; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.251; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.252; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.252; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.253; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.254; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.269; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.271; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.273; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.275; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@6fdace54 main
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.275; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.276; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1367230341993/nodes_used_collection_shard1_replica1/data/tlog
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:28.277; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.277; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:28.279; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.279; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.280; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:28.282; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:28.282; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.283; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.283; org.apache.solr.core.SolrCore; [nodes_used_collection_shard1_replica2] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1367230337996/nodes_used_collection_shard1_replica2/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1367230337996/nodes_used_collection_shard1_replica2/data/
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.284; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4971dddf
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.284; org.apache.solr.core.SolrCore; [nodes_used_collection_shard1_replica1] Registered new searcher Searcher@6fdace54 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.284; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.285; org.apache.solr.cloud.ZkController; publishing core=nodes_used_collection_shard1_replica1 state=down
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.285; org.apache.solr.core.CachingDirectoryFactory; return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1367230337996/nodes_used_collection_shard1_replica2/data
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.286; org.apache.solr.core.SolrCore; New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1367230337996/nodes_used_collection_shard1_replica2/data/index/
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:28.286; org.apache.solr.core.SolrCore; [nodes_used_collection_shard1_replica2] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1367230337996/nodes_used_collection_shard1_replica2/data/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.287; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.287; org.apache.solr.core.CachingDirectoryFactory; return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1367230337996/nodes_used_collection_shard1_replica2/data/index
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.291; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.291; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@24338643 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3216a0a),segFN=segments_1,generation=1}
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.292; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.295; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.296; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.297; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.297; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.298; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.299; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.299; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.300; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.300; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.301; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.310; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.312; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.314; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.317; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.321; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@198dda46 main
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.322; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1367230337996/nodes_used_collection_shard1_replica2/data/tlog
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.323; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.324; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.328; org.apache.solr.core.SolrCore; [nodes_used_collection_shard1_replica2] Registered new searcher Searcher@198dda46 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.329; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.331; org.apache.solr.cloud.ZkController; publishing core=nodes_used_collection_shard1_replica2 state=down
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.331; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.334; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:28.336; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.337; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:28.337; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.338; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:28.339; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:28.339; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.340; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.340; org.apache.solr.core.SolrCore; [nodes_used_collection_shard2_replica1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1367230340173/nodes_used_collection_shard2_replica1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1367230340173/nodes_used_collection_shard2_replica1/data/
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.341; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4971dddf
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.341; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.341; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.342; org.apache.solr.core.CachingDirectoryFactory; return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1367230340173/nodes_used_collection_shard2_replica1/data
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:28.342; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:28.343; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.343; org.apache.solr.core.SolrCore; New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1367230340173/nodes_used_collection_shard2_replica1/data/index/
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.343; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:28.344; org.apache.solr.core.SolrCore; [nodes_used_collection_shard2_replica1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1367230340173/nodes_used_collection_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.345; org.apache.solr.core.CachingDirectoryFactory; return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1367230340173/nodes_used_collection_shard2_replica1/data/index
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:28.345; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:28.345; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.346; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.346; org.apache.solr.core.SolrCore; [nodes_used_collection_shard2_replica2] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1367230343959/nodes_used_collection_shard2_replica2/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1367230343959/nodes_used_collection_shard2_replica2/data/
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.347; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4971dddf
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.347; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.348; org.apache.solr.core.CachingDirectoryFactory; return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1367230343959/nodes_used_collection_shard2_replica2/data
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.348; org.apache.solr.core.SolrCore; New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1367230343959/nodes_used_collection_shard2_replica2/data/index/
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:28.348; org.apache.solr.core.SolrCore; [nodes_used_collection_shard2_replica2] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1367230343959/nodes_used_collection_shard2_replica2/data/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.349; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@13f1a0e9 lockFactory=org.apache.lucene.store.NativeFSLockFactory@358ec892),segFN=segments_1,generation=1}
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.349; org.apache.solr.core.CachingDirectoryFactory; return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1367230343959/nodes_used_collection_shard2_replica2/data/index
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.349; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.352; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@64abfb1f lockFactory=org.apache.lucene.store.NativeFSLockFactory@51bb2371),segFN=segments_1,generation=1}
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.353; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.353; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.354; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.354; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.355; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.355; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.355; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.356; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.356; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.356; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.357; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.357; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.358; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.358; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.358; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.358; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.359; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.359; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.360; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.376; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.376; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.382; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@647b865 main
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.383; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1367230343959/nodes_used_collection_shard2_replica2/data/tlog
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.383; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@5acc1756 main
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.384; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1367230340173/nodes_used_collection_shard2_replica1/data/tlog
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.384; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.384; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.385; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.385; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.387; org.apache.solr.core.SolrCore; [nodes_used_collection_shard2_replica2] Registered new searcher Searcher@647b865 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.389; org.apache.solr.core.SolrCore; [nodes_used_collection_shard2_replica1] Registered new searcher Searcher@5acc1756 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.389; org.apache.solr.cloud.ZkController; publishing core=nodes_used_collection_shard2_replica2 state=down
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:28.392; org.apache.solr.cloud.ZkController; publishing core=nodes_used_collection_shard2_replica1 state=down
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.020; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.021; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core":"nodes_used_collection_shard1_replica1",
[junit4:junit4]   1>   "collection":"nodes_used_collection",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:25878_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:25878"}
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.022; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection nodes_used_collection with numShards 2
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.026; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core":"nodes_used_collection_shard1_replica2",
[junit4:junit4]   1>   "collection":"nodes_used_collection",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:25836_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:25836"}
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.037; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard":"shard2",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core":"nodes_used_collection_shard2_replica2",
[junit4:junit4]   1>   "collection":"nodes_used_collection",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:25889_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:25889"}
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.048; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard":"shard2",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core":"nodes_used_collection_shard2_replica1",
[junit4:junit4]   1>   "collection":"nodes_used_collection",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:25853_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:25853"}
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.060; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.060; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.060; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.060; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.060; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.060; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.288; org.apache.solr.core.CoreContainer; registering core: nodes_used_collection_shard1_replica1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.288; org.apache.solr.cloud.ZkController; Register replica - core:nodes_used_collection_shard1_replica1 address:http://127.0.0.1:25878 collection:nodes_used_collection shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.290; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/nodes_used_collection/leader_elect/shard1/election
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.318; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.322; org.apache.solr.cloud.ShardLeaderElectionContext; Waiting until we see more replicas up: total=2 found=1 timeoutin=179999
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.333; org.apache.solr.core.CoreContainer; registering core: nodes_used_collection_shard1_replica2
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.333; org.apache.solr.cloud.ZkController; Register replica - core:nodes_used_collection_shard1_replica2 address:http://127.0.0.1:25836 collection:nodes_used_collection shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.392; org.apache.solr.core.CoreContainer; registering core: nodes_used_collection_shard2_replica2
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.392; org.apache.solr.cloud.ZkController; Register replica - core:nodes_used_collection_shard2_replica2 address:http://127.0.0.1:25889 collection:nodes_used_collection shard:shard2
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.393; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/nodes_used_collection/leader_elect/shard2/election
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.394; org.apache.solr.core.CoreContainer; registering core: nodes_used_collection_shard2_replica1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.394; org.apache.solr.cloud.ZkController; Register replica - core:nodes_used_collection_shard2_replica1 address:http://127.0.0.1:25853 collection:nodes_used_collection shard:shard2
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.396; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/nodes_used_collection/leader_elect/shard2/election
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.403; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.407; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.408; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.408; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:25889/nodes_used_collection_shard2_replica2/
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.418; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&connTimeout=30000&socketTimeout=30000&retry=false
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.439; org.apache.solr.update.PeerSync; PeerSync: core=nodes_used_collection_shard2_replica2 url=http://127.0.0.1:25889 START replicas=[http://127.0.0.1:25853/nodes_used_collection_shard2_replica1/] nUpdates=100
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.440; org.apache.solr.update.PeerSync; PeerSync: core=nodes_used_collection_shard2_replica2 url=http://127.0.0.1:25889 DONE.  We have no versions.  sync failed.
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.441; org.apache.solr.cloud.SyncStrategy; Leader's attempt to sync with shard failed, moving to the next canidate
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.442; org.apache.solr.cloud.ShardLeaderElectionContext; We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.442; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:25889/nodes_used_collection_shard2_replica2/
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.443; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/nodes_used_collection/leaders/shard2
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.461; org.apache.solr.core.SolrCore; [nodes_used_collection_shard2_replica1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=10 
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.823; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.824; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.825; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:25878/nodes_used_collection_shard1_replica1/
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.825; org.apache.solr.update.PeerSync; PeerSync: core=nodes_used_collection_shard1_replica1 url=http://127.0.0.1:25878 START replicas=[http://127.0.0.1:25836/nodes_used_collection_shard1_replica2/] nUpdates=100
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.826; org.apache.solr.update.PeerSync; PeerSync: core=nodes_used_collection_shard1_replica1 url=http://127.0.0.1:25878 DONE.  We have no versions.  sync failed.
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.827; org.apache.solr.cloud.SyncStrategy; Leader's attempt to sync with shard failed, moving to the next canidate
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.827; org.apache.solr.cloud.ShardLeaderElectionContext; We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.828; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:25878/nodes_used_collection_shard1_replica1/
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.829; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/nodes_used_collection/leaders/shard1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:29.838; org.apache.solr.core.SolrCore; [nodes_used_collection_shard1_replica2] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=0 
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.571; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.690; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.690; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.690; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.690; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.690; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.690; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.711; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:25878/nodes_used_collection_shard1_replica1/ and leader is http://127.0.0.1:25878/nodes_used_collection_shard1_replica1/
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.711; org.apache.solr.cloud.ZkController; No LogReplay needed for core=nodes_used_collection_shard1_replica1 baseURL=http://127.0.0.1:25878
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.712; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.712; org.apache.solr.cloud.ZkController; publishing core=nodes_used_collection_shard1_replica1 state=active
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.713; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:25853/nodes_used_collection_shard2_replica1/ and leader is http://127.0.0.1:25889/nodes_used_collection_shard2_replica2/
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.713; org.apache.solr.cloud.ZkController; No LogReplay needed for core=nodes_used_collection_shard2_replica1 baseURL=http://127.0.0.1:25853
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.714; org.apache.solr.cloud.ZkController; Core needs to recover:nodes_used_collection_shard2_replica1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.714; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.721; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process.  core=nodes_used_collection_shard2_replica1 recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.722; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.723; org.apache.solr.cloud.ZkController; publishing core=nodes_used_collection_shard2_replica1 state=recovering
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.727; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:25889/nodes_used_collection_shard2_replica2/ and leader is http://127.0.0.1:25889/nodes_used_collection_shard2_replica2/
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.727; org.apache.solr.cloud.ZkController; No LogReplay needed for core=nodes_used_collection_shard2_replica2 baseURL=http://127.0.0.1:25889
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.728; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.728; org.apache.solr.cloud.ZkController; publishing core=nodes_used_collection_shard2_replica2 state=active
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.751; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.752; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.752; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.752; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.753; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard2&name=nodes_used_collection_shard2_replica1&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=3669 
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.773; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 127.0.0.1:25853__nodes_used_collection_shard2_replica1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.791; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard1&name=nodes_used_collection_shard1_replica1&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=3707 
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.791; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard2&name=nodes_used_collection_shard2_replica2&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=3707 
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.797; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:25836/nodes_used_collection_shard1_replica2/ and leader is http://127.0.0.1:25878/nodes_used_collection_shard1_replica1/
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.797; org.apache.solr.cloud.ZkController; No LogReplay needed for core=nodes_used_collection_shard1_replica2 baseURL=http://127.0.0.1:25836
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.798; org.apache.solr.cloud.ZkController; Core needs to recover:nodes_used_collection_shard1_replica2
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.798; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.799; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process.  core=nodes_used_collection_shard1_replica2 recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.799; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.799; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.800; org.apache.solr.cloud.ZkController; publishing core=nodes_used_collection_shard1_replica2 state=recovering
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.801; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={numShards=2&shard=shard1&name=nodes_used_collection_shard1_replica2&action=CREATE&collection=nodes_used_collection&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=3717 
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.802; org.apache.solr.cloud.OverseerCollectionProcessor; Finished create command on all shards for collection: nodes_used_collection
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.837; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.856; org.apache.solr.handler.admin.CoreAdminHandler; Going to wait for coreNodeName: 127.0.0.1:25836__nodes_used_collection_shard1_replica2, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.889; org.apache.solr.cloud.DistributedQueue$LatchChildWatcher; Watcher fired on path: /overseer/collection-queue-work/qnr-0000000000 state: SyncConnected type NodeDataChanged
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.891; org.apache.solr.cloud.DistributedQueue$LatchChildWatcher; Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.891; org.apache.solr.cloud.OverseerCollectionProcessor; Overseer Collection Processor: Message id:/overseer/collection-queue-work/qn-0000000000 complete, response:{success={null={responseHeader={status=0,QTime=3669},core=nodes_used_collection_shard2_replica1},null={responseHeader={status=0,QTime=3707},core=nodes_used_collection_shard1_replica1},null={responseHeader={status=0,QTime=3707},core=nodes_used_collection_shard2_replica2},null={responseHeader={status=0,QTime=3717},core=nodes_used_collection_shard1_replica2}}}
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.942; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/collections params={numShards=2&name=nodes_used_collection&replicationFactor=2&action=CREATE&wt=javabin&version=2} status=0 QTime=3919 
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.944; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.945; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.947; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@70bb0446 name:ZooKeeperConnection Watcher:127.0.0.1:25829/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.948; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.949; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.953; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.955; org.apache.solr.common.cloud.ConnectionManager; Waiting for client to connect to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.957; org.apache.solr.common.cloud.ConnectionManager; Watcher org.apache.solr.common.cloud.ConnectionManager@731ece99 name:ZooKeeperConnection Watcher:127.0.0.1:25829/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.957; org.apache.solr.common.cloud.ConnectionManager; Client is connected to ZooKeeper
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.959; org.apache.solr.common.cloud.ZkStateReader; Updating cluster state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.987; org.apache.solr.handler.admin.CollectionsHandler; Creating Collection : numShards=1&maxShardsPerNode=1&name=awholynewcollection_0&replicationFactor=4&action=CREATE&wt=javabin&version=2
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.989; org.apache.solr.cloud.DistributedQueue$LatchChildWatcher; Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.991; org.apache.solr.cloud.OverseerCollectionProcessor; Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000002 message:{
[junit4:junit4]   1>   "operation":"createcollection",
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "maxShardsPerNode":"1",
[junit4:junit4]   1>   "createNodeSet":null,
[junit4:junit4]   1>   "name":"awholynewcollection_0",
[junit4:junit4]   1>   "replicationFactor":"4"}
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.992; org.apache.solr.cloud.OverseerCollectionProcessor; Creating shard awholynewcollection_0_shard1_replica1 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:25878_
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.992; org.apache.solr.cloud.OverseerCollectionProcessor; Creating shard awholynewcollection_0_shard1_replica2 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:25845_
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.992; org.apache.solr.cloud.OverseerCollectionProcessor; Creating shard awholynewcollection_0_shard1_replica3 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:25853_
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.992; org.apache.solr.cloud.OverseerCollectionProcessor; Creating shard awholynewcollection_0_shard1_replica4 as part of slice shard1 of collection awholynewcollection_0 on 127.0.0.1:25889_
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.996; org.apache.solr.core.CoreContainer; Creating SolrCore 'awholynewcollection_0_shard1_replica2' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1367230338586/awholynewcollection_0_shard1_replica2
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.996; org.apache.solr.cloud.ZkController; Check for collection zkNode:awholynewcollection_0
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.997; org.apache.solr.core.CoreContainer; Creating SolrCore 'awholynewcollection_0_shard1_replica1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1367230341993/awholynewcollection_0_shard1_replica1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.997; org.apache.solr.core.CoreContainer; Creating SolrCore 'awholynewcollection_0_shard1_replica4' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1367230343959/awholynewcollection_0_shard1_replica4
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.998; org.apache.solr.cloud.ZkController; Check for collection zkNode:awholynewcollection_0
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.997; org.apache.solr.core.CoreContainer; Creating SolrCore 'awholynewcollection_0_shard1_replica3' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1367230340173/awholynewcollection_0_shard1_replica3
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.997; org.apache.solr.cloud.ZkController; Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.997; org.apache.solr.cloud.ZkController; Check for collection zkNode:awholynewcollection_0
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.999; org.apache.solr.cloud.ZkController; Looking for collection configName
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.999; org.apache.solr.cloud.ZkController; Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:30.998; org.apache.solr.cloud.ZkController; Check for collection zkNode:awholynewcollection_0
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.000; org.apache.solr.cloud.ZkController; Looking for collection configName
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.000; org.apache.solr.cloud.ZkController; Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.001; org.apache.solr.cloud.ZkController; Creating collection in ZooKeeper:awholynewcollection_0
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.001; org.apache.solr.cloud.ZkController; Only one config set found in zk - using it:conf1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.002; org.apache.solr.cloud.ZkController; Only one config set found in zk - using it:conf1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.002; org.apache.solr.cloud.ZkController; Looking for collection configName
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.002; org.apache.solr.cloud.ZkController; Looking for collection configName
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.003; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/awholynewcollection_0
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.003; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/awholynewcollection_0
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.005; org.apache.solr.cloud.ZkController; Only one config set found in zk - using it:conf1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.005; org.apache.solr.cloud.ZkController; Only one config set found in zk - using it:conf1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.006; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/awholynewcollection_0
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.006; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/awholynewcollection_0
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.008; org.apache.solr.cloud.ZkController; Load collection config from:/collections/awholynewcollection_0
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.009; org.apache.solr.cloud.ZkController; Load collection config from:/collections/awholynewcollection_0
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.016; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1367230338586/awholynewcollection_0_shard1_replica2/'
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.026; org.apache.solr.cloud.ZkController; Load collection config from:/collections/awholynewcollection_0
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.026; org.apache.solr.cloud.ZkController; Load collection config from:/collections/awholynewcollection_0
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.028; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1367230343959/awholynewcollection_0_shard1_replica4/'
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.028; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1367230340173/awholynewcollection_0_shard1_replica3/'
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.030; org.apache.solr.core.SolrResourceLoader; new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1367230341993/awholynewcollection_0_shard1_replica1/'
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.112; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.112; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.113; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.113; org.apache.solr.core.SolrConfig; Using Lucene MatchVersion: LUCENE_50
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.191; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.191; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.191; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.191; org.apache.solr.core.SolrConfig; Loaded SolrConfig: solrconfig.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.293; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.293; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.294; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.293; org.apache.solr.schema.IndexSchema; Reading Solr Schema from schema.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.301; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.301; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.302; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:31.302; org.apache.solr.schema.IndexSchema; Schema name=test
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.162; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.177; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.182; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.207; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.231; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.241; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:32.243; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:32.244; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.245; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:32.247; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:32.248; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.249; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.249; org.apache.solr.core.SolrCore; [awholynewcollection_0_shard1_replica3] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1367230340173/awholynewcollection_0_shard1_replica3/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1367230340173/awholynewcollection_0_shard1_replica3/data/
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.250; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4971dddf
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.251; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.253; org.apache.solr.core.CachingDirectoryFactory; return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1367230340173/awholynewcollection_0_shard1_replica3/data
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.253; org.apache.solr.core.SolrCore; New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1367230340173/awholynewcollection_0_shard1_replica3/data/index/
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:32.254; org.apache.solr.core.SolrCore; [awholynewcollection_0_shard1_replica3] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1367230340173/awholynewcollection_0_shard1_replica3/data/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.255; org.apache.solr.core.CachingDirectoryFactory; return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1367230340173/awholynewcollection_0_shard1_replica3/data/index
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.262; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5dddfb72 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7b85ea56),segFN=segments_1,generation=1}
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.263; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.268; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.269; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.271; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.272; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.273; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.273; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.274; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.274; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.275; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.275; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.281; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.290; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.292; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.294; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.294; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.295; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.295; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:25878__nodes_used_collection_shard1_replica1",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core":"nodes_used_collection_shard1_replica1",
[junit4:junit4]   1>   "collection":"nodes_used_collection",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:25878_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:25878"}
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.297; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.303; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.308; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@290c3b28 main
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.309; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1367230340173/awholynewcollection_0_shard1_replica3/data/tlog
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.310; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.310; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.311; org.apache.solr.schema.IndexSchema; default search field in schema is text
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.314; org.apache.solr.schema.IndexSchema; unique key field: id
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.314; org.apache.solr.core.SolrCore; [awholynewcollection_0_shard1_replica3] Registered new searcher Searcher@290c3b28 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.317; org.apache.solr.cloud.ZkController; publishing core=awholynewcollection_0_shard1_replica3 state=down
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.332; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:25853__nodes_used_collection_shard2_replica1",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard":"shard2",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "state":"recovering",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core":"nodes_used_collection_shard2_replica1",
[junit4:junit4]   1>   "collection":"nodes_used_collection",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:25853_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:25853"}
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.337; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:25889__nodes_used_collection_shard2_replica2",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard":"shard2",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "state":"active",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core":"nodes_used_collection_shard2_replica2",
[junit4:junit4]   1>   "collection":"nodes_used_collection",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:25889_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:25889"}
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.348; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=2 message={
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core_node_name":"127.0.0.1:25836__nodes_used_collection_shard1_replica2",
[junit4:junit4]   1>   "numShards":"2",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "state":"recovering",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core":"nodes_used_collection_shard1_replica2",
[junit4:junit4]   1>   "collection":"nodes_used_collection",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:25836_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:25836"}
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.354; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.357; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.360; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core":"awholynewcollection_0_shard1_replica3",
[junit4:junit4]   1>   "collection":"awholynewcollection_0",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:25853_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:25853"}
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.361; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Create collection awholynewcollection_0 with numShards 1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.364; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.376; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.384; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.388; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.388; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.388; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.388; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.388; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.388; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.388; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.388; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.392; org.apache.solr.schema.FileExchangeRateProvider; Reloading exchange rates from file currency.xml
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.393; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.393; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:32.399; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:32.399; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:32.399; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:32.400; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.400; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.401; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:32.403; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:32.404; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.404; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.405; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:32.405; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:32.406; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.405; org.apache.solr.core.SolrCore; [awholynewcollection_0_shard1_replica2] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1367230338586/awholynewcollection_0_shard1_replica2/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1367230338586/awholynewcollection_0_shard1_replica2/data/
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:32.407; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.406; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:32.408; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.407; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4971dddf
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.409; org.apache.solr.schema.OpenExchangeRatesOrgProvider; Reloading exchange rates from open-exchange-rates.json
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.408; org.apache.solr.core.SolrCore; [awholynewcollection_0_shard1_replica1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1367230341993/awholynewcollection_0_shard1_replica1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1367230341993/awholynewcollection_0_shard1_replica1/data/
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.409; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.410; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4971dddf
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:32.411; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Unknown key IMPORTANT NOTE
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:32.411; org.apache.solr.schema.OpenExchangeRatesOrgProvider$OpenExchangeRates; Expected key, got STRING
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.411; org.apache.solr.core.CachingDirectoryFactory; return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1367230338586/awholynewcollection_0_shard1_replica2/data
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.411; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.412; org.apache.solr.core.SolrCore; New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1367230338586/awholynewcollection_0_shard1_replica2/data/index/
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.412; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:32.413; org.apache.solr.core.SolrCore; [awholynewcollection_0_shard1_replica2] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1367230338586/awholynewcollection_0_shard1_replica2/data/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.413; org.apache.solr.core.CachingDirectoryFactory; return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1367230341993/awholynewcollection_0_shard1_replica1/data
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.414; org.apache.solr.core.CachingDirectoryFactory; return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1367230338586/awholynewcollection_0_shard1_replica2/data/index
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.413; org.apache.solr.core.SolrCore; [awholynewcollection_0_shard1_replica4] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1367230343959/awholynewcollection_0_shard1_replica4/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1367230343959/awholynewcollection_0_shard1_replica4/data/
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.414; org.apache.solr.core.SolrCore; New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1367230341993/awholynewcollection_0_shard1_replica1/data/index/
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.415; org.apache.solr.core.JmxMonitoredMap; JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4971dddf
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:32.416; org.apache.solr.core.SolrCore; [awholynewcollection_0_shard1_replica1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1367230341993/awholynewcollection_0_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.417; org.apache.solr.core.SolrCore; org.apache.solr.core.MockDirectoryFactory
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.417; org.apache.solr.core.CachingDirectoryFactory; return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1367230341993/awholynewcollection_0_shard1_replica1/data/index
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.417; org.apache.solr.core.CachingDirectoryFactory; return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1367230343959/awholynewcollection_0_shard1_replica4/data
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.418; org.apache.solr.core.SolrCore; New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1367230343959/awholynewcollection_0_shard1_replica4/data/index/
[junit4:junit4]   1> WARN  - 2013-04-29 10:12:32.419; org.apache.solr.core.SolrCore; [awholynewcollection_0_shard1_replica4] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1367230343959/awholynewcollection_0_shard1_replica4/data/index' doesn't exist. Creating new index...
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.420; org.apache.solr.core.CachingDirectoryFactory; return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1367230343959/awholynewcollection_0_shard1_replica4/data/index
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.429; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@72f2e24a lockFactory=org.apache.lucene.store.NativeFSLockFactory@79aca4ea),segFN=segments_1,generation=1}
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.429; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@277051b2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2923acfe),segFN=segments_1,generation=1}
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.429; org.apache.solr.core.SolrDeletionPolicy; SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4]   1> 	commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@55333736 lockFactory=org.apache.lucene.store.NativeFSLockFactory@197cc075),segFN=segments_1,generation=1}
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.430; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.429; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.430; org.apache.solr.core.SolrDeletionPolicy; newest commit generation = 1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.434; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.434; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.434; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.435; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.436; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.436; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.437; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.437; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.437; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.436; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.438; org.apache.solr.update.processor.UpdateRequestProcessorChain; inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.438; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.439; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.439; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.440; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.440; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.439; org.apache.solr.core.RequestHandlers; created standard: solr.StandardRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.441; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.440; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.441; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.442; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.442; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.441; org.apache.solr.core.RequestHandlers; created /get: solr.RealTimeGetHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.443; org.apache.solr.core.RequestHandlers; adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.443; org.apache.solr.core.RequestHandlers; created /replication: solr.ReplicationHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.444; org.apache.solr.core.RequestHandlers; created /update: solr.UpdateRequestHandler
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.445; org.apache.solr.core.RequestHandlers; created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.462; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.462; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.463; org.apache.solr.handler.loader.XMLLoader; xsltCacheLifetimeSeconds=60
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.475; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@e4b5ba2 main
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.476; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1367230343959/awholynewcollection_0_shard1_replica4/data/tlog
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.477; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.478; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.478; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@3a64ec49 main
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.478; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1367230338586/awholynewcollection_0_shard1_replica2/data/tlog
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.481; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.481; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.481; org.apache.solr.core.SolrCore; [awholynewcollection_0_shard1_replica4] Registered new searcher Searcher@e4b5ba2 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.482; org.apache.solr.cloud.ZkController; publishing core=awholynewcollection_0_shard1_replica4 state=down
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.482; org.apache.solr.search.SolrIndexSearcher; Opening Searcher@24b68d02 main
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.483; org.apache.solr.update.UpdateHandler; Clearing tlog files, tlogDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J1/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1367230341993/awholynewcollection_0_shard1_replica1/data/tlog
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.485; org.apache.solr.update.CommitTracker; Hard AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.485; org.apache.solr.update.CommitTracker; Soft AutoCommit: disabled
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.498; org.apache.solr.core.SolrCore; [awholynewcollection_0_shard1_replica2] Registered new searcher Searcher@3a64ec49 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.498; org.apache.solr.core.SolrCore; [awholynewcollection_0_shard1_replica1] Registered new searcher Searcher@24b68d02 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.501; org.apache.solr.cloud.ZkController; publishing core=awholynewcollection_0_shard1_replica2 state=down
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.501; org.apache.solr.cloud.ZkController; publishing core=awholynewcollection_0_shard1_replica1 state=down
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.775; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 127.0.0.1:25853__nodes_used_collection_shard2_replica1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.775; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:25853__nodes_used_collection_shard2_replica1&state=recovering&nodeName=127.0.0.1:25853_&action=PREPRECOVERY&checkLive=true&core=nodes_used_collection_shard2_replica2&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2002 
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.858; org.apache.solr.handler.admin.CoreAdminHandler; Waited coreNodeName: 127.0.0.1:25836__nodes_used_collection_shard1_replica2, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:32.858; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:25836__nodes_used_collection_shard1_replica2&state=recovering&nodeName=127.0.0.1:25836_&action=PREPRECOVERY&checkLive=true&core=nodes_used_collection_shard1_replica1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2003 
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:33.321; org.apache.solr.core.CoreContainer; registering core: awholynewcollection_0_shard1_replica3
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:33.321; org.apache.solr.cloud.ZkController; Register replica - core:awholynewcollection_0_shard1_replica3 address:http://127.0.0.1:25853 collection:awholynewcollection_0 shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:33.323; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/awholynewcollection_0/leader_elect/shard1/election
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:33.341; org.apache.solr.cloud.ShardLeaderElectionContext; Running the leader process.
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:33.353; org.apache.solr.cloud.ShardLeaderElectionContext; Enough replicas found to continue.
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:33.353; org.apache.solr.cloud.ShardLeaderElectionContext; I may be the new leader - try and sync
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:33.354; org.apache.solr.cloud.SyncStrategy; Sync replicas to http://127.0.0.1:25853/awholynewcollection_0_shard1_replica3/
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:33.354; org.apache.solr.cloud.SyncStrategy; Sync Success - now sync replicas to me
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:33.355; org.apache.solr.cloud.SyncStrategy; http://127.0.0.1:25853/awholynewcollection_0_shard1_replica3/ has no replicas
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:33.355; org.apache.solr.cloud.ShardLeaderElectionContext; I am the new leader: http://127.0.0.1:25853/awholynewcollection_0_shard1_replica3/
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:33.355; org.apache.solr.common.cloud.SolrZkClient; makePath: /collections/awholynewcollection_0/leaders/shard1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:33.913; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:33.915; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core":"awholynewcollection_0_shard1_replica4",
[junit4:junit4]   1>   "collection":"awholynewcollection_0",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:25889_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:25889"}
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:33.920; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core":"awholynewcollection_0_shard1_replica2",
[junit4:junit4]   1>   "collection":"awholynewcollection_0",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:25845_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:25845"}
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:33.932; org.apache.solr.cloud.Overseer$ClusterStateUpdater; Update state numShards=1 message={
[junit4:junit4]   1>   "operation":"state",
[junit4:junit4]   1>   "core_node_name":null,
[junit4:junit4]   1>   "numShards":"1",
[junit4:junit4]   1>   "shard":"shard1",
[junit4:junit4]   1>   "roles":null,
[junit4:junit4]   1>   "state":"down",
[junit4:junit4]   1>   "shard_state":"active",
[junit4:junit4]   1>   "core":"awholynewcollection_0_shard1_replica1",
[junit4:junit4]   1>   "collection":"awholynewcollection_0",
[junit4:junit4]   1>   "shard_range":null,
[junit4:junit4]   1>   "node_name":"127.0.0.1:25878_",
[junit4:junit4]   1>   "base_url":"http://127.0.0.1:25878"}
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:33.984; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:33.985; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:33.984; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:33.985; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:33.985; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:33.984; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:33.984; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:33.984; org.apache.solr.common.cloud.ZkStateReader$2; A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.036; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:25853/awholynewcollection_0_shard1_replica3/ and leader is http://127.0.0.1:25853/awholynewcollection_0_shard1_replica3/
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.036; org.apache.solr.cloud.ZkController; No LogReplay needed for core=awholynewcollection_0_shard1_replica3 baseURL=http://127.0.0.1:25853
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.037; org.apache.solr.cloud.ZkController; I am the leader, no recovery necessary
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.037; org.apache.solr.cloud.ZkController; publishing core=awholynewcollection_0_shard1_replica3 state=active
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.040; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.041; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={numShards=1&shard=shard1&name=awholynewcollection_0_shard1_replica3&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=3045 
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.486; org.apache.solr.core.CoreContainer; registering core: awholynewcollection_0_shard1_replica4
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.486; org.apache.solr.cloud.ZkController; Register replica - core:awholynewcollection_0_shard1_replica4 address:http://127.0.0.1:25889 collection:awholynewcollection_0 shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.491; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:25889/awholynewcollection_0_shard1_replica4/ and leader is http://127.0.0.1:25853/awholynewcollection_0_shard1_replica3/
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.492; org.apache.solr.cloud.ZkController; No LogReplay needed for core=awholynewcollection_0_shard1_replica4 baseURL=http://127.0.0.1:25889
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.492; org.apache.solr.cloud.ZkController; Core needs to recover:awholynewcollection_0_shard1_replica4
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.492; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.505; org.apache.solr.core.CoreContainer; registering core: awholynewcollection_0_shard1_replica2
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.505; org.apache.solr.core.CoreContainer; registering core: awholynewcollection_0_shard1_replica1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.505; org.apache.solr.cloud.ZkController; Register replica - core:awholynewcollection_0_shard1_replica2 address:http://127.0.0.1:25845 collection:awholynewcollection_0 shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.506; org.apache.solr.cloud.ZkController; Register replica - core:awholynewcollection_0_shard1_replica1 address:http://127.0.0.1:25878 collection:awholynewcollection_0 shard:shard1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.509; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process.  core=awholynewcollection_0_shard1_replica4 recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.510; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.510; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.510; org.apache.solr.cloud.ZkController; publishing core=awholynewcollection_0_shard1_replica4 state=recovering
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.512; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:25845/awholynewcollection_0_shard1_replica2/ and leader is http://127.0.0.1:25853/awholynewcollection_0_shard1_replica3/
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.512; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={numShards=1&shard=shard1&name=awholynewcollection_0_shard1_replica4&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=3515 
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.512; org.apache.solr.cloud.ZkController; No LogReplay needed for core=awholynewcollection_0_shard1_replica2 baseURL=http://127.0.0.1:25845
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.513; org.apache.solr.cloud.ZkController; Core needs to recover:awholynewcollection_0_shard1_replica2
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.513; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.514; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process.  core=awholynewcollection_0_shard1_replica2 recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.515; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.515; org.apache.solr.cloud.ZkController; publishing core=awholynewcollection_0_shard1_replica2 state=recovering
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.520; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.520; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.520; org.apache.solr.cloud.ZkController; We are http://127.0.0.1:25878/awholynewcollection_0_shard1_replica1/ and leader is http://127.0.0.1:25853/awholynewcollection_0_shard1_replica3/
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.521; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.521; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={numShards=1&shard=shard1&name=awholynewcollection_0_shard1_replica2&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=3525 
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.521; org.apache.solr.cloud.ZkController; No LogReplay needed for core=awholynewcollection_0_shard1_replica1 baseURL=http://127.0.0.1:25878
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.522; org.apache.solr.cloud.ZkController; Core needs to recover:awholynewcollection_0_shard1_replica1
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.523; org.apache.solr.update.DefaultSolrCoreState; Running recovery - first canceling any ongoing recovery
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.532; org.apache.solr.cloud.RecoveryStrategy; Starting recovery process.  core=awholynewcollection_0_shard1_replica1 recoveringAfterStartup=true
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.532; org.apache.solr.common.cloud.ZkStateReader; Updating cloud state from ZooKeeper... 
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.538; org.apache.solr.cloud.RecoveryStrategy; ###### startupVersions=[]
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.554; org.apache.solr.cloud.ZkController; publishing core=awholynewcollection_0_shard1_replica1 state=recovering
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.554; org.apache.solr.servlet.SolrDispatchFilter; [admin] webapp=null path=/admin/cores params={numShards=1&shard=shard1&name=awholynewcollection_0_shard1_replica1&action=CREATE&collection=awholynewcollection_0&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=3558 
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.555; org.apache.solr.cloud.OverseerCollectionProcessor; Finished create command on all shards for collection: awholynewcollection_0
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.556; org.apache.solr.client.solrj.impl.HttpClientUtil; Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.563; org.apache.solr.cloud.DistributedQueue$LatchChildWatcher; Watcher fired on path: /overseer/collection-queue-work/qnr-0000000002 state: SyncConnected type NodeDataChanged
[junit4:junit4]   1> INFO  - 2013-04-29 10:12:34.566; org.apache.solr.cloud.DistributedQueu

[...truncated too long message...]

ToAddress(AbstractPlainSocketImpl.java:200)
[junit4:junit4]   2> 	        at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
[junit4:junit4]   2> 	        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:391)
[junit4:junit4]   2> 	        at java.net.Socket.connect(Socket.java:579)
[junit4:junit4]   2> 	        at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:127)
[junit4:junit4]   2> 	        at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:180)
[junit4:junit4]   2> 	        at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:294)
[junit4:junit4]   2> 	        at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:645)
[junit4:junit4]   2> 	        at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:480)
[junit4:junit4]   2> 	        at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
[junit4:junit4]   2> 	        at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
[junit4:junit4]   2> 	        at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
[junit4:junit4]   2> 	        at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:365)
[junit4:junit4]   2> 	        at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4:junit4]   2> 	        at org.apache.solr.cloud.SyncStrategy$1.run(SyncStrategy.java:298)
[junit4:junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4:junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4]   2> 	        at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]   2> NOTE: test params are: codec=Asserting, sim=DefaultSimilarity, locale=fr_FR, timezone=Asia/Baku
[junit4:junit4]   2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_17 (64-bit)/cpus=16,threads=2,free=290779400,total=499122176
[junit4:junit4]   2> NOTE: All tests run in this JVM: [TestSerializedLuceneMatchVersion, DocumentAnalysisRequestHandlerTest, SpellCheckComponentTest, TestUtils, TestOmitPositions, DirectUpdateHandlerTest, TestQueryTypes, TestFieldCollectionResource, TestSuggestSpellingConverter, RequiredFieldsTest, SignatureUpdateProcessorFactoryTest, TestPartialUpdateDeduplication, TestRTGBase, TestSolrQueryParserResource, CoreContainerCoreInitFailuresTest, TimeZoneUtilsTest, TestRecovery, LeaderElectionIntegrationTest, SampleTest, TestPropInject, TestBM25SimilarityFactory, TestCSVLoader, URLClassifyProcessorTest, PingRequestHandlerTest, TestDefaultSimilarityFactory, CopyFieldTest, SuggesterWFSTTest, TestRangeQuery, NotRequiredUniqueKeyTest, TestWordDelimiterFilterFactory, TestHashPartitioner, TestMultiCoreConfBootstrap, RequestHandlersTest, SolrTestCaseJ4Test, TestFastOutputStream, DisMaxRequestHandlerTest, CollectionsAPIDistributedZkTest]
[junit4:junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=CollectionsAPIDistributedZkTest -Dtests.seed=7B2286C060BCB9D2 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=fr_FR -Dtests.timezone=Asia/Baku -Dtests.file.encoding=US-ASCII
[junit4:junit4] ERROR   0.00s J1 | CollectionsAPIDistributedZkTest (suite) <<<
[junit4:junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.CollectionsAPIDistributedZkTest: 
[junit4:junit4]    >    1) Thread[id=651, name=recoveryCmdExecutor-521-thread-1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4:junit4]    >         at java.net.PlainSocketImpl.socketConnect(Native Method)
[junit4:junit4]    >         at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
[junit4:junit4]    >         at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
[junit4:junit4]    >         at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
[junit4:junit4]    >         at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:391)
[junit4:junit4]    >         at java.net.Socket.connect(Socket.java:579)
[junit4:junit4]    >         at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:127)
[junit4:junit4]    >         at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:180)
[junit4:junit4]    >         at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:294)
[junit4:junit4]    >         at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:645)
[junit4:junit4]    >         at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:480)
[junit4:junit4]    >         at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
[junit4:junit4]    >         at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
[junit4:junit4]    >         at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
[junit4:junit4]    >         at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:365)
[junit4:junit4]    >         at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4:junit4]    >         at org.apache.solr.cloud.SyncStrategy$1.run(SyncStrategy.java:298)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4]    >         at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([7B2286C060BCB9D2]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4:junit4]    >    1) Thread[id=651, name=recoveryCmdExecutor-521-thread-1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4:junit4]    >         at java.net.PlainSocketImpl.socketConnect(Native Method)
[junit4:junit4]    >         at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
[junit4:junit4]    >         at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
[junit4:junit4]    >         at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
[junit4:junit4]    >         at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:391)
[junit4:junit4]    >         at java.net.Socket.connect(Socket.java:579)
[junit4:junit4]    >         at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:127)
[junit4:junit4]    >         at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:180)
[junit4:junit4]    >         at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:294)
[junit4:junit4]    >         at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:645)
[junit4:junit4]    >         at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:480)
[junit4:junit4]    >         at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
[junit4:junit4]    >         at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
[junit4:junit4]    >         at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
[junit4:junit4]    >         at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:365)
[junit4:junit4]    >         at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4:junit4]    >         at org.apache.solr.cloud.SyncStrategy$1.run(SyncStrategy.java:298)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4:junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4:junit4]    >         at java.lang.Thread.run(Thread.java:722)
[junit4:junit4]    > 	at __randomizedtesting.SeedInfo.seed([7B2286C060BCB9D2]:0)
[junit4:junit4] Completed on J1 in 386.68s, 1 test, 1 failure, 2 errors <<< FAILURES!

[...truncated 654 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:378: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:358: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:1240: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:884: There were test failures: 293 suites, 1219 tests, 2 suite-level errors, 1 failure, 673 ignored

Total time: 34 minutes 3 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure