You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2014/07/29 16:59:34 UTC

[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 2041 - Failure

Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/2041/

1 tests failed.
REGRESSION:  org.apache.lucene.analysis.icu.TestICUNormalizer2CharFilter.testRandomStrings

Error Message:
Document contains at least one immense term in field="dummy" (whose UTF8 encoding is longer than the max length 32766), all of which were skipped.  Please correct the analyzer to not produce such terms.  The prefix of the first immense term is: '[-29, -125, -110, -29, -126, -102, -29, -126, -94, -29, -126, -71, -29, -125, -120, -29, -125, -85, 49, 51, -26, -105, -91, 49, 57, -25, -126, -71, 109, 50]...', original message: bytes can be at most 32766 in length; got 51602

Stack Trace:
java.lang.IllegalArgumentException: Document contains at least one immense term in field="dummy" (whose UTF8 encoding is longer than the max length 32766), all of which were skipped.  Please correct the analyzer to not produce such terms.  The prefix of the first immense term is: '[-29, -125, -110, -29, -126, -102, -29, -126, -94, -29, -126, -71, -29, -125, -120, -29, -125, -85, 49, 51, -26, -105, -91, 49, 57, -25, -126, -71, 109, 50]...', original message: bytes can be at most 32766 in length; got 51602
	at __randomizedtesting.SeedInfo.seed([E0CC2305A3C7C11A:684523BB00C3962F]:0)
	at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:671)
	at org.apache.lucene.index.DefaultIndexingChain.processField(DefaultIndexingChain.java:342)
	at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:301)
	at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:222)
	at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:450)
	at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1507)
	at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1222)
	at org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:149)
	at org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:110)
	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:622)
	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:513)
	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:437)
	at org.apache.lucene.analysis.icu.TestICUNormalizer2CharFilter.testRandomStrings(TestICUNormalizer2CharFilter.java:202)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.lucene.util.BytesRefHash$MaxBytesLengthExceededException: bytes can be at most 32766 in length; got 51602
	at org.apache.lucene.util.BytesRefHash.add(BytesRefHash.java:284)
	at org.apache.lucene.index.TermsHashPerField.add(TermsHashPerField.java:151)
	at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:645)
	... 50 more
	Suppressed: java.lang.AssertionError: close() called in wrong state: INCREMENT
		at org.apache.lucene.analysis.MockTokenizer.close(MockTokenizer.java:262)
		at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:661)
		... 50 more




Build Log:
[...truncated 6357 lines...]
   [junit4] Suite: org.apache.lucene.analysis.icu.TestICUNormalizer2CharFilter
   [junit4]   2> TEST FAIL: useCharFilter=false text='\u332e\u33ec\u336b\u33a1\u33c7\u3328\u33a5\u3362\u33ea\u339f\u3308\u33ab\u33f4\u33c3\u33a5\u3329\u331e\u331b\u339a\u33b4\u331d\u33c2\u334f\u3342\u33a0\u3399\u330b\u3379\u33a1\u33e7\u33ab\u3375\u3309\u334e\u3343\u3326\u3341\u333d\u33b5\u333b\u3391\u334a\u338f\u33cb\u33f8\u3306\u33d9\u336c\u3325\u3355\u33b4\u33f0\u3374\u3318\u3367\u335b\u3376\u333f\u3382\u33f6\u3351\u3345\u3334\u3353\u338b\u332b\u33db\u3324\u333f\u3375\u338b\u33af\u33ec\u3350\u331d\u3309\u3362\u3370\u3306\u3329\u3395\u3327\u331d\u33db\u33e9\u33d6\u33fe\u33fc\u3337\u332b\u33fa\u3300\u339e\u335b\u33c6\u33ac\u33db\u3310\u334b\u33d7\u333f\u3319\u33f0\u3326\u33d9\u3300\u335c\u331e\u33fa\u33dd\u339b\u33d9\u335a\u3349\u3377\u330c\u33e4\u3334\u33c4\u3330\u33c7\u3307\u3389\u3345\u335d\u337b\u3364\u3382\u33ad\u3372\u33a3\u337b\u3384\u3363\u334c\u3324\u3322\u33e5\u3365\u333e\u3348\u3316\u3372\u33de\u3367\u3327\u3390\u330e\u33a4\u33bf\u33a7\u334d\u33c8\u333a\u3393\u335b\u337a\u3335\u3379\u3329\u33df\u33ba\u332d\u3356\u33e7\u336e\u3364\u3395\u3315\u33d8\u33e1\u33ef\u33a9\u33bb\u334e\u33b7\u3326\u331c\u3367\u3372\u33f7\u33e8\u33a5\u33f5\u33a6\u336e\u33c3\u336e\u337c\u3326\u337c\u330e\u33d5\u3348\u335f\u3371\u3388\u33fe\u3364\u3333\u3311\u33a5\u3305\u3343\u3371\u33a0\u33cc\u33f1\u33f4\u33e6\u3337\u33e8\u3303\u339f\u3328\u337b\u33c5\u33f9\u3324\u33a5\u3357\u3380\u3344\u336a\u3336\u33fa\u3312\u33ae\u33e0\u338d\u33ae\u337b\u338c\u33d4\u33dc\u33fa\u3386\u3311\u333b\u3343\u3333\u33d7\u33ee\u33db\u33bd\u3376\u336c\u3312\u3372\u33a5\u33d2\u339e\u33fb\u33af\u3383\u3371\u3372\u33a8\u3367\u338f\u33b3\u3328\u33ef\u33bd\u33fc\u330d\u337e\u3304\u3303\u338b\u33d6\u3369\u3365\u3345\u33a4\u3311\u337c\u33d5\u336b\u3353\u33f4\u334e\u33ba\u339c\u3321\u33ba\u33ea\u336e\u339b\u3328\u33e8\u3350\u3366\u339b\u3309\u33bb\u333b\u3397\u3388\u33ed\u3352\u3356\u33f3\u332e\u33e3\u33b7\u338c\u33d7\u332d\u33c0\u33d4\u339f\u335c\u33e3\u3303\u33cc\u33de\u33ca\u3373\u335f\u3310\u3340\u3367\u33be\u3331\u3366\u3339\u3362\u33da\u3377\u3386\u33a7\u3355\u339d\u3390\u3329\u339d\u334b\u33da\u3328\u33a7\u339c\u338d\u33c9\u3378\u3344\u3384\u333c\u3374\u335b\u335d\u337c\u3373\u3326\u3310\u3354\u33b6\u3304\u330b\u3318\u33e3\u33ab\u339d\u3346\u3301\u3360\u33cf\u33b8\u336d\u33dd\u3323\u335f\u33a4\u3390\u3337\u33a4\u3388\u3377\u33d8\u33ef\u33e5\u33a4\u3344\u3338\u337c\u33ed\u3335\u3324\u337c\u33f7\u339b\u3318\u338b\u3300\u3326\u3310\u3307\u33e2\u33d9\u33a6\u337b\u336c\u33b5\u33f1\u33d9\u33ea\u3347\u33db\u3310\u33c5\u338a\u3396\u33c4\u33a0\u33f1\u3334\u3311\u337c\u3355\u33f7\u33bf\u332c\u3397\u336d\u335b\u3308\u338c\u3382\u33f3\u33fc\u33ad\u330d\u3334\u3338\u336f\u33a2\u33a9\u3314\u3318\u33a1\u3370\u3323\u33d6\u3374\u33cf\u334c\u3342\u33ac\u3334\u3379\u33de\u3344\u3330\u3321\u3392\u33fb\u3343\u33aa\u3316\u33ad\u3354\u33e1\u3352\u33e8\u3350\u331e\u3388\u33ca\u3305\u3396\u3397\u33b7\u339a\u338d\u338f\u33e3\u33c1\u3391\u33cc\u33d5\u3346\u33b6\u3320\u335b\u330c\u3360\u331a\u331f\u3324\u33d5\u33fa\u3380\u3365\u33cb\u33f6\u33de\u3366\u33b5\u33d6\u3316\u33e2\u33a4\u33e9\u3349\u3386\u33ac\u338e\u33fb\u33e8\u3358\u3399\u33ad\u330f\u3399\u3303\u335e\u3317\u33c3\u3318\u3364\u3345\u33c6\u3358\u3377\u33ad\u3318\u3379\u33c1\u339a\u33a1\u3309\u3356\u33d9\u33b7\u33a6\u331b\u33d3\u3361\u3346\u33e2\u3300\u334f\u3396\u33cc\u3328\u3300\u33ed\u3383\u33f7\u3306\u33ff\u33cd\u333c\u3373\u337f\u3328\u332f\u3356\u33d9\u333f\u33d2\u33ab\u3365\u33c7\u335c\u33bd\u3315\u338f\u3317\u33b1\u33ec\u3345\u33c8\u33d4\u3328\u3397\u3326\u3328\u3367\u330e\u3374\u3328\u333a\u3337\u33cd\u3393\u3316\u3340\u338c\u33b6\u330e\u334b\u3300\u330d\u336e\u336d\u331c\u3345\u33f3\u33fc\u3360\u3381\u33b7\u336a\u33de\u3399\u3369\u337d\u331e\u3305\u33fb\u339a\u3313\u3313\u336c\u3348\u332e\u33bd\u339d\u3357\u33b4\u336e\u33cd\u33be\u3302\u3387\u3316\u33e5\u3301\u3348\u3347\u33e0\u336b\u33c1\u33c1\u3373\u335a\u3368\u3390\u3398\u33fe\u33a6\u33c7\u3327\u3396\u3317\u33f3\u337c\u3348\u332a\u33bd\u3336\u338c\u3390\u33b1\u33a3\u3389\u33a1\u33d7\u334b\u334e\u33f8\u33b9\u3364\u3307\u3360\u33f1\u3342\u33a9\u339a\u3301\u334f\u332a\u330a\u3348\u3369\u33dd\u33b3\u3337\u33c3\u3364\u3390\u3302\u33fe\u331c\u33bf\u3352\u33c3\u339a\u33bc\u3355\u3396\u335c\u331a\u33f5\u33b0\u332a\u33b0\u3393\u337c\u3328\u33bf\u3386\u3363\u33f7\u33f7\u33ea\u33db\u33a5\u3324\u3343\u332f\u33c6\u339e\u335b\u33ad\u33bd\u335f\u33c2\u33e1\u331a\u3350\u33ed\u3302\u3382\u3370\u3399\u339c\u3338\u3398\u33f3\u333b\u3305\u33ec\u332e\u33f9\u3370\u334f\u33be\u331d\u33aa\u3346\u3320\u3345\u33be\u3390\u3302\u3392\u33c7\u33aa\u33f1\u3329\u33ee\u33f0\u33c4\u3300\u3394\u33b1\u3325\u3333\u33fc\u332c\u33a5\u33df\u33db\u3337\u335e\u3314\u33f0\u335c\u33fb\u3312\u33ad\u3342\u3386\u3353\u33a7\u3365\u3337\u3321\u333f\u3336\u3381\u3358\u332c\u338a\u33cb\u3325\u3383\u338d\u337f\u3389\u33ce\u331f\u33d7\u3385\u3392\u33e6\u3380\u3309\u3306\u33a6\u33aa\u3344\u33d4\u3387\u3348\u3363\u335c\u332e\u3352\u33ad\u3307\u3364\u337b\u3318\u33dd\u3364\u3340\u33a0\u33aa\u333c\u3375\u3369\u336f\u3392\u3346\u33a2\u3303\u33c3\u33e3\u335f\u3334\u33b3\u3318\u330d\u33f1\u3393\u3311\u3346\u3394\u33fb\u33b2\u3384\u3311\u333f\u3372\u330f\u33cb\u3352\u3321\u33b9\u332b\u331a\u33cf\u3354\u3310\u33bf\u3344\u3346\u33d4\u3324\u333d\u33b3\u33f9\u3357\u3372\u330a\u3329\u3304\u33e9\u332c\u33b8\u33e9\u3305\u33f8\u3311\u3348\u338b\u3323\u33ec\u33ab\u3322\u33d2\u33fb\u33d7\u3367\u335a\u3312\u3304\u335c\u3382\u331f\u331a\u3361\u33fc\u33a8\u33f3\u3329\u3347\u3378\u337b\u3302\u3356\u33ab\u33c6\u3364\u33c2\u332f\u33ae\u33f7\u3379\u33ce\u3381\u3394\u3367\u3307\u33a7\u33cb\u3348\u33f1\u33c8\u3312\u3372\u3355\u3350\u338e\u33db\u339a\u3339\u3385\u33bd\u339a\u33cb\u334f\u335e\u33f6\u33da\u33cb\u3353\u333b\u3374\u3346\u33a1\u33a1\u338c\u33c8\u33a3\u33fb\u330e\u33e7\u33a1\u33e0\u33bd\u3332\u3370\u33e2\u331b\u33f8\u334d\u332c\u33eb\u33f5\u338e\u33d7\u33f1\u3360\u3390\u33f7\u3341\u3370\u3387\u33e4\u3302\u3336\u3378\u334e\u335b\u336a\u33e7\u3330\u33ac\u333a\u33fb\u3398\u3305\u3340\u33e4\u3312\u332c\u33ee\u3360\u3309\u3312\u3395\u3387\u3327\u335e\u3311\u33dc\u3373\u3373\u3368\u333a\u336b\u33a3\u335a\u3349\u331b\u3339\u3356\u33e3\u3333\u339e\u3311\u3327\u33db\u33a8\u3380\u3345\u33b9\u337b\u332d\u3351\u334f\u333d\u3373\u3369\u3345\u330d\u3371\u33d8\u331f\u3359\u332b\u3348\u335e\u3376\u3336\u3391\u3367\u3359\u3366\u33b0\u3371\u33ec\u3350\u33af\u331f\u33f5\u3317\u33b1\u331a\u33d9\u33de\u33a9\u33fc\u3331\u3305\u3372\u3311\u33e3\u3388\u335f\u339b\u3389\u3374\u336c\u33cf\u3344\u333e\u330e\u33ef\u33b6\u33ba\u336f\u3382\u337a\u333e\u332d\u33f4\u3333\u33be\u33b9\u3391\u33ac\u33b8\u33c8\u3334\u339f\u3360\u33b4\u33e6\u33df\u3350\u333a\u3358\u331a\u33f1\u338a\u338a\u33c3\u3340\u336b\u332c\u3336\u33f4\u33eb\u339a\u3315\u33dc\u33f3\u3393\u333c\u339b\u33c3\u337a\u3362\u33d1\u336c\u33cd\u334f\u33a2\u33a5\u3343\u3396\u3387\u3369\u33f9\u3397\u3357\u33d7\u33d6\u33d3\u33b5\u3339\u333e\u3389\u33f3\u33c5\u3397\u3303\u3348\u338a\u3327\u3367\u33a8\u339e\u33de\u3306\u3394\u33a4\u33bc\u3352\u3316\u3380\u335b\u337c\u33c6\u337b\u3399\u338e\u3344\u336b\u3327\u3312\u337f\u3388\u33e6\u333f\u3386\u339e\u332b\u33a2\u33a7\u3388\u333c\u335b\u3337\u33af\u3360\u3387\u3360\u33bf\u33c1\u33a7\u3395\u33e2\u3305\u3379\u3357\u337a\u338c\u3341\u3383\u33b8\u3364\u3375\u338b\u33c5\u3315\u33a6\u3393\u33ce\u33b4\u3394\u3315\u3334\u33e6\u333a\u3312\u3351\u33e3\u3330\u3353\u33ae\u33f3\u33e5\u339b\u3331\u338e\u334e\u3364\u33f1\u330c\u33e8\u3326\u3364\u331c\u3338\u33e1\u3342\u338a\u33db\u333e\u331c\u3327\u33fa\u3324\u3387\u3319\u33a6\u33aa\u33cc\u3381\u33c3\u33b8\u335d\u3394\u335b\u3398\u3347\u33e8\u3345\u33e7\u3381\u3356\u331e\u33f5\u3308\u3349\u33cf\u3398\u33fb\u3302\u339e\u3384\u33f5\u33a9\u333c\u335e\u33fd\u33b0\u3328\u33ef\u3379\u3334\u33cc\u33a9\u337a\u33b9\u3331\u33f9\u33df\u33c2\u33ac\u33dd\u3392\u33bf\u33e4\u33ba\u3356\u330f\u3331\u3337\u3307\u3378\u335e\u33cf\u33b7\u333b\u33d6\u3354\u33bf\u33a6\u3373\u3330\u338a\u33c4\u3397\u334c\u3339\u3344\u3308\u336a\u334d\u33f6\u339f\u334e\u3392\u3331\u33bc\u33ea\u3321\u33f8\u3321\u33fe\u334b\u33f3\u330a\u330b\u336f\u3314\u33c1\u33b7\u339b\u33fe\u3304\u33a1\u33f6\u337e\u335c\u3343\u3389\u33ab\u3393\u33d1\u33f5\u33e2\u33a3\u3396\u334c\u339c\u336f\u331b\u33ce\u333a\u33d6\u3395\u33d2\u336f\u3314\u33a4\u33ac\u3314\u33dc\u33f2\u335b\u33de\u3399\u33f1\u330a\u3321\u3311\u33c2\u3340\u3318\u33ad\u3383\u3308\u331d\u3385\u337c\u33d6\u33de\u33e1\u33e2\u33a5\u3379\u339c\u33aa\u3369\u334b\u333b\u330e\u33cc\u33dd\u33e5\u33d8\u33e9\u335e\u3311\u3382\u3320\u3391\u336e\u33cf\u33ba\u334f\u336e\u3330\u330e\u330d\u330e\u3389\u3392\u3392\u338c\u337b\u338d\u3385\u33d8\u33f2\u33e6\u33cf\u338c\u333f\u3353\u3306\u3384\u33d5\u33c8\u337d\u331e\u33ad\u33f6\u33cc\u339a\u3328\u336d\u33ef\u33bf\u330a\u33a5\u33e0\u3300\u3336\u33c2\u335b\u3315\u33d8\u33a7\u33a5\u33ff\u3316\u33a8\u3341\u3323\u339a\u33c9\u33f8\u33df\u3326\u336a\u33d8\u3357\u33b1\u3337\u33a0\u3307\u3354\u33f3\u337d\u33e5\u33a2\u3317\u3364\u33e2\u3356\u3334\u3311\u337b\u337f\u3351\u33d7\u33f9\u330a\u33cc\u330c\u3328\u33e3\u3392\u33e4\u333b\u33a0\u33d2\u3381\u332d\u33a7\u3396\u339b\u33fb\u335e\u330d\u33c5\u338d\u3305\u3328\u3344\u3318\u334e\u3385\u3372\u3367\u33c2\u3310\u339a\u336f\u3347\u3396\u3377\u3387\u33a1\u335c\u335f\u3327\u3379\u330e\u3392\u3334\u3320\u3320\u33cb\u3346\u33bb\u330f\u330a\u33d8\u3387\u33af\u331d\u33c4\u339b\u3371\u33b4\u3318\u33da\u33d9\u33b1\u3387\u3379\u338e\u336c\u33ea\u3377\u3384\u331f\u33bf\u33a3\u330c\u33ed\u334f\u33d2\u3328\u33ab\u33a7\u33cf\u3350\u3384\u33da\u33d2\u336f\u3300\u3300\u3319\u33c2\u338f\u336e\u334a\u3347\u336f\u338e\u330c\u33d5\u33d6\u3369\u3303\u3307\u3354\u336e\u3326\u3335\u33ae\u3336\u33e0\u335a\u33e5\u3355\u33a7\u3304\u33b3\u3324\u33a7\u33c1\u33cb\u33d5\u3393\u334a\u3338\u338a\u332b\u332e\u3300\u3311\u3325\u332d\u3303\u3380\u33a7\u3372\u3327\u33c5\u3309\u3372\u33cc\u33dc\u333e\u3379\u3346\u3345\u3357\u3310\u3305\u33bc\u33d9\u336f\u33e9\u338e\u3328\u337d\u33cd\u3395\u33c9\u331a\u332f\u33d9\u3384\u3337\u33a7\u33b8\u33d4\u3362\u33db\u33e2\u3346\u33f0\u336f\u332f\u33ab\u3336\u337b\u338d\u337f\u3353\u3345\u331f\u3307\u3369\u33f0\u33c9\u33e7\u3315\u33af\u331e\u3319\u332b\u3336\u3363\u33d3\u3364\u33e7\u3393\u334c\u33fb\u3308\u33d8\u333e\u334c\u3373\u33b5\u33c3\u33ba\u330b\u337b\u337b\u33e0\u3363\u33b6\u3382\u33b0\u33a1\u33e6\u3344\u3352\u334f\u3399\u338a\u33e2\u3309\u333b\u33d6\u331d\u33f1\u3338\u33db\u33f0\u337e\u33b3\u3340\u3385\u339c\u3388\u33b1\u334b\u3317\u33df\u33c0\u33b2\u3309\u3353\u33fb\u3310\u33ca\u3334\u33ca\u3350\u33ed\u3374\u33ae\u3343\u33a2\u33c2\u330e\u339e\u33b0\u3353\u330d\u3387\u3347\u337b\u3394\u3351\u3302\u3332\u33ee\u3399\u3353\u33f3\u33d8\u3353\u3381\u331b\u3363\u3315\u3386\u3371\u339f\u33e9\u33c9\u3353\u333d\u33ec\u33ce\u33ec\u333a\u330b\u330c\u33b8\u335a\u3329\u3346\u33d0\u3390\u3336\u3320\u33da\u33a6\u3332\u33c9\u3381\u3390\u33f7\u336e\u337e\u3380\u33ce\u3362\u331c\u334e\u33b6\u3340\u33e0\u33f3\u3387\u3300\u335f\u3349\u3332\u3333\u3343\u3348\u33f3\u3300\u3389\u3333\u330b\u3327\u335f\u332d\u3397\u33d6\u33a7\u33cf\u338c\u33d4\u33a3\u33c0\u33d2\u33e0\u3308\u3355\u33a3\u335e\u33bd\u33bd\u3323\u339f\u3387\u3332\u338b\u3382\u3375\u3310\u33cc\u33fb\u33e9\u33cf\u333f\u33ed\u33c1\u330e\u337b\u33ec\u33d5\u338b\u3342\u33f3\u33d0\u33c7\u3306\u33da\u33cb\u3303\u3391\u3360\u3311\u33cf\u33f3\u3356\u3314\u3338\u33e1\u3374\u334a\u3330\u3384\u3347\u33d8\u3338\u337b\u3321\u336e\u333a\u33a0\u3394\u336b\u3379\u3305\u3370\u3352\u3331\u33b0\u334d\u336b\u331c\u3396\u33a7\u3334\u3303\u33f1\u33e9\u3365\u330f\u3341\u3326\u33d0\u337f\u3370\u33a4\u33b1\u33fc\u331b\u3320\u33ef\u33c6\u33e3\u332e\u3392\u33d3\u336b\u3352\u3365\u3311\u3346\u33fb\u33e3\u33c7\u334d\u339e\u33f6\u3320\u33ec\u3306\u335f\u3376\u338d\u33eb\u33fc\u3335\u3315\u33c5\u3319\u3326\u33f8\u3303\u3369\u33cb\u33e2\u33fa\u33b5\u33d7\u339c\u334e\u338e\u33a4\u338b\u3374\u33ee\u3342\u33ba\u330d\u3302\u336a\u336d\u3399\u3335\u33ae\u334e\u3370\u3336\u3370\u3350\u3342\u3360\u3305\u330a\u335f\u3386\u33d5\u33ce\u33d5\u332e\u3364\u33aa\u33e8\u3303\u33c2\u3369\u3302\u33a7\u33e4\u334a\u335e\u33e2\u3319\u3310\u3325\u3397\u3363\u3338\u33f6\u332a\u33ab\u3385\u3395\u33f9\u3386\u335a\u3332\u332e\u3379\u33e3\u3347\u33a4\u3343\u33e0\u33db\u337e\u3386\u3314\u33ef\u336d\u33e2\u335f\u3357\u331e\u3324\u33bc\u3395\u33d5\u337a\u33e3\u3315\u334f\u33b6\u335a\u33d1\u3373\u338d\u33d0\u3381\u33ac\u3375\u33fd\u3344\u3388\u339f\u3385\u3361\u331b\u33b1\u33f3\u33b1\u3398\u3365\u33f4\u33c1\u33f5\u33e0\u333a\u3315\u3367\u3347\u333c\u3398\u33af\u33a6\u3368\u3363\u3386\u33d8\u3353\u332c\u339f\u33f2\u33db\u3336\u334e\u331b\u3398\u33bf\u33a9\u333f\u33ca\u337a\u337c\u335e\u33dd\u337f\u3337\u33ff\u33bd\u336c\u336c\u33ae\u3324\u33e4\u336c\u3335\u3381\u3386\u33ac\u33f5\u33bc\u336d\u335c\u335f\u3383\u33c4\u33cd\u331e\u33fa\u33a5\u3301\u33c1\u33b1\u339d\u333a\u33b0\u3311\u339c\u33bb\u3365\u33c5\u3354\u338a\u33ad\u33cb\u3371\u337d\u3328\u33f2\u33cb\u33c9\u33b2\u331d\u3389\u3319\u3360\u334a\u33de\u3347\u33ba\u3393\u33e6\u33d1\u33e2\u3341\u3363\u33d8\u3317\u338e\u33c2\u33f3\u3357\u33ee\u3353\u33c4\u33d0\u333d\u33dc\u3331\u3322\u334c\u334b\u3357\u33a6\u33e7\u333a\u3382\u335a\u3301\u3387\u33a7\u33c6\u33e9\u33fb\u336d\u33b3\u3399\u33b8\u332e\u335f\u3355\u33a9\u3318\u3383\u331c\u3399\u33be\u3309\u33a4\u33f9\u33e8\u337c\u332e\u33f6\u33ae\u3331\u3355\u333b\u3328\u3318\u33cc\u33df\u3368\u339f\u33af\u33d2\u3313\u3323\u339a\u3338\u331a\u3364\u33f8\u33f3\u337a\u335d\u3394\u3359\u33e3\u3377\u33c0\u338b\u3388\u338b\u33a1\u3381\u33c8\u3397\u33bc\u3395\u334a\u3305\u3318\u33f2\u33a4\u3310\u33c4\u337a\u3336\u333a\u33ec\u3324\u3382\u3356\u333b\u33fa\u3367\u335b\u3378\u3327\u3304\u3393\u3313\u33fb\u3336\u33e3\u3367\u3379\u3322\u3399\u3323\u3313\u3380\u3385\u3337\u33c4\u33dc\u33e4\u3329\u3319\u333f\u338a\u3348\u33b2\u33a6\u33cc\u334a\u330f\u3337\u3388\u3323\u33d9\u33e1\u3347\u3342\u33a8\u33c8\u3318\u33dc\u33f8\u331d\u3318\u33b9\u3365\u33bb\u33e3\u3324\u3321\u33de\u33a0\u3373\u33b1\u3350\u3352\u338d\u3340\u333c\u331c\u330e\u33aa\u33e6\u33ef\u33ef\u3364\u3316\u336c\u332b\u334c\u336e\u3371\u33d7\u3374\u3376\u3346\u339b\u3381\u332d\u3358\u33ec\u33aa\u3367\u33eb\u3324\u333b\u337e\u33e8\u330c\u33e8\u33dd\u337d\u3308\u330c\u33df\u335c\u33e2\u3339\u3306\u3334\u3332\u33e7\u3326\u3315\u3315\u3336\u3341\u33d7\u3371\u33a5\u3385\u33ab\u3334\u33ab\u33e6\u3315\u3386\u3390\u330c\u33d0\u33a9\u33f5\u3335\u3374\u3348\u33cf\u3354\u3300\u33b7\u33ae\u3320\u33fb\u3340\u33c9\u335f\u3335\u339c\u33ee\u33fc\u33ca\u3361\u3399\u330c\u33ed\u3371\u3328\u33f1\u3351\u3375\u33a5\u3325\u330e\u3335\u33ba\u338f\u3305\u33ff\u33ed\u33b9\u3360\u33d6\u33d8\u3321\u3301\u33f9\u331c\u3362\u33ad\u33b6\u33ed\u3329\u332a\u33d1\u3391\u331f\u33cd\u333c\u33af\u33eb\u3314\u339d\u3394\u338f\u3338\u3392\u3346\u3321\u3334\u331b\u33b0\u33dc\u3329\u33ac\u3373\u33b9\u338f\u33a5\u3391\u33f4\u339d\u33e1\u3377\u33f0\u3361\u338b\u3352\u3381\u3300\u334a\u3371\u334c\u331a\u33b0\u33fd\u33db\u33ba\u331f\u3380\u33ac\u3349\u337d\u3317\u331c\u3359\u33e8\u3347\u3321\u3301\u3351\u338f\u33b4\u3379\u334a\u33bf\u335b\u3396\u33a3\u33fd\u3314\u3347\u3391\u3313\u3325\u339c\u3311\u3331\u3395\u33d5\u33df\u331c\u33e6\u3360\u334a\u3330\u3338\u333c\u331d\u3389\u331e\u333e\u33a3\u337d\u33bc\u3319\u3350\u3300\u3391\u338f\u33c7\u330c\u3366\u3390\u330b\u33c2\u3341\u3325\u3372\u33af\u33f0\u33d4\u33f3\u33f8\u3334\u33c1\u33c1\u33dc\u333d\u33cc\u334b\u33c3\u33ee\u3315\u33e3\u3398\u33f7\u333b\u3388\u3338\u33ab\u339b\u3351\u3302\u339f\u33aa\u33a0\u330e\u3380\u3398\u33e6\u337a\u336c\u3305\u33cb\u3357\u332d\u337f\u333a\u3388\u3315\u33df\u33cc\u33bd\u33a9\u3306\u33b8\u33db\u33ba\u3301\u33c3\u3301\u3388\u330c\u33bc\u334e\u3349\u3314\u33b5\u33fe\u33d7\u33da\u33ed\u33b2\u33ff\u33dc\u33a7\u3377\u336c\u33e9\u33ac\u3356\u332c\u33b6\u3325\u33e4\u3385\u33f0\u3320\u337a\u3318\u33e8\u33a4\u3310\u333e\u33b6\u33e7\u33d9\u337c\u336a\u33e3\u33ed\u3382\u33aa\u33ef\u330e\u3332\u33d8\u33d5\u3319\u3330\u3335\u3349\u3335\u33ba\u3363\u333c\u33b3\u338e\u332d\u3312\u336a\u3373\u33b7\u332e\u33d1\u3386\u33f1\u33ae\u33cc\u33db\u33e2\u334a\u339e\u33dd\u331c\u33b2\u3398\u33c6\u33a0\u333a\u3353\u3348\u3301\u33b8\u3371\u3321\u3388\u3376\u339b\u334d\u3393\u335f\u337d\u33c7\u33e9\u33e1\u33a7\u33c9\u33af\u3359\u3300\u33fd\u336a\u3318\u331c\u3374\u3342\u333e\u3343\u334f\u33d9\u339e\u3358\u33cd\u3319\u335b\u332b\u33ef\u33eb\u3334\u33f4\u33d1\u33e2\u3347\u3390\u3339\u330e\u33d5\u3348\u3327\u3317\u3361\u33a7\u33a6\u33db\u33a4\u33d1\u33b3\u3379\u33bd\u33d3\u334a\u3331\u3338\u3
   [junit4]   2> 393\u3324\u3301\u332b\u3345\u33fa\u3368\u333d\u3362\u33b3\u3313\u3338\u3347\u335c\u33a3\u335e\u33c3\u3318\u3320\u3306\u339c\u3364\u33c6\u33bc\u3368\u33ce\u33e6\u33cd\u338d\u3338\u332a\u3309\u33aa\u33d8\u33d2\u33b1\u3346\u331c\u33bc\u3386\u3348\u337d\u331b\u3353\u33db\u33b9\u33ea\u33b5\u339c\u3313\u33c6\u333d\u33ef\u3306\u335b\u338e\u33e4\u3352\u3397\u33c3\u3343\u332e\u3317\u3373\u33df\u33b2\u33d3\u3388\u33a2\u3306\u33a5\u33e3\u33b5\u3303\u3391\u331b\u337a\u330c\u3335\u3324\u3390\u33c7\u3339\u3376\u331a\u3373\u33e4\u33be\u3387\u33e0\u33cc\u336a\u3328\u3368\u33d7\u339b\u3353\u33ad\u3369\u33fe\u3300\u33b6\u33e1\u331a\u334f\u3324\u33b9\u33d6\u33b6\u33c9\u332a\u3338\u337d\u335d\u339c\u33af\u3368\u3359\u3361\u331b\u33e9\u339a\u33ea\u33b6\u33fe\u3353\u33c6\u3309\u33aa\u332a\u33c8\u3344\u33e6\u3307\u337d\u33df\u33c9\u3380\u3382\u3330\u3388\u3352\u3384\u3379\u33dd\u334a\u33ce\u3364\u3312\u3342\u33b9\u337a\u33e0\u33b9\u339f\u33e3\u3309\u339d\u3368\u3318\u3393\u33fd\u33e9\u33b6\u335f\u33df\u3306\u3331\u3350\u3393\u33e5\u3387\u3362\u3375\u33c8\u3322\u3377\u332a\u33b4\u33cf\u3389\u337a\u33ff\u333b\u339d\u33d4\u33a0\u3398\u335d\u33b7\u334e\u339f\u33a7\u33bc\u3355\u33b8\u330d\u3379\u3310\u339f\u3380\u33c1\u332d\u3371\u33d2\u339d\u3379\u3369\u339b\u332c\u339b\u33ff\u336d\u3359\u335c\u33ed\u338f\u3350\u339b\u336f\u33fd\u335b\u33b5\u3367\u3336\u33e4\u332e\u33a4\u332b\u334d\u3393\u33ef\u3355\u33cd\u33b0\u33f7\u3336\u334a\u333f\u33bf\u3390\u338a\u3310\u3344\u33c0\u336f\u3304\u3397\u338c\u3381\u33d1\u3382\u3343\u338e\u3357\u33e2\u336f\u3344\u3308\u3355\u3305\u3315\u33a4\u33af\u33a1\u3343\u3368\u3305\u3302\u333e\u3389\u339d\u3399\u338e\u33d0\u336c\u33c0\u33ff\u33d0\u332d\u33ad\u33f3\u33d4\u335c\u3320\u339f\u33ff\u33aa\u3363\u3339\u3306\u33bd\u335c\u336f\u3307\u3322\u3380\u3344\u33f8\u338a\u3315\u33e9\u332d\u3356\u3322\u33a1\u333d\u3361\u33f5\u3366\u33e8\u33a1\u337c\u3363\u33f2\u33f0\u33a9\u33a2\u334e\u3343\u3376\u3337\u33c2\u3318\u333e\u3399\u331b\u331f\u334f\u334a\u339c\u33d9\u33a3\u3395\u3376\u3366\u3386\u33ec\u33d7\u3389\u33f3\u33d3\u330e\u3322\u33d4\u33e7\u33ca\u33f8\u337b\u33e6\u333e\u33a4\u33a6\u331d\u3382\u3332\u33cf\u33d2\u339a\u3348\u33a1\u3352\u3381\u33b0\u332a\u33cd\u333a\u33d4\u33ff\u3303\u3342\u3390\u3349\u33e5\u33fa\u33f4\u330e\u33c0\u3385\u334e\u3368\u33f0\u33db\u33fd\u3336\u33d7\u332e\u333c\u3380\u33cc\u33b5\u332d\u33bc\u33f6\u3303\u3380\u33fe\u337e\u3358\u330a\u332d\u331d\u335a\u33f3\u3323\u33a0\u3355\u337b\u33e7\u335a\u333b\u33bc\u33f9\u3367\u33b9\u3353\u3341\u33ce\u3394\u33c3\u333a\u33c7\u3310\u33d5\u330c\u33f3\u335b\u3363\u33e1\u335d\u333d\u33be\u33c9\u3359\u33c3\u33f1\u331c\u3341\u33ca\u33e2\u33a9\u33f5\u3305\u33bf\u3342\u3386\u339a\u334d\u339f\u33a3\u3378\u332e\u33f9\u33c2\u3307\u3328\u3322\u339d\u332b\u334a\u3330\u33fe\u33db\u3358\u33f1\u3392\u3390\u3345\u33c3\u3372\u33b3\u33e8\u3318\u3386\u3330\u33bc\u3388\u338c\u33da\u33d5\u33bc\u33b9\u33e4\u3358\u335a\u3349\u33de\u33c0\u33ae\u33be\u3381\u33e0\u3321\u3338\u339b\u3361\u3397\u333e\u3369\u333e\u334d\u3354\u33d8\u3355\u339c\u3337\u331d\u332f\u3331\u339f\u3308\u33f6\u33c2\u330a\u3349\u33bf\u3393\u3364\u333b\u339d\u33fa\u3364\u33b4\u33a1\u338b\u3332\u33c8\u3376\u3392\u33da\u33c2\u33a1\u33ff\u33ed\u33d2\u338f\u332d\u331e\u334e\u334c\u338b\u33b7\u3341\u3382\u33af\u33cb\u33e8\u33c9\u3368\u331f\u3382\u3343\u3367\u331c\u33b7\u33a6\u33c9\u33c2\u33f2\u333f\u33ce\u3365\u3391\u33ee\u33be\u3370\u337e\u33dc\u3386\u339f\u3313\u3396\u33e8\u33ff\u33bd\u33fd\u33c3\u335a\u33fe\u3399\u3383\u3332\u3389\u33b8\u336d\u3319\u334e\u33a5\u3328\u3378\u33ca\u33ed\u3323\u3364\u3316\u336e\u335e\u33e0\u3309\u33c2\u330a\u33f6\u3367\u33ed\u3380\u3338\u331a\u334d\u33d5\u33ff\u3340\u33fd\u33ca\u3343\u331f\u33e9\u339b\u33c7\u33ad\u33ac\u3368\u33f2\u33f8\u33bd\u3342\u33f7\u332a\u339a\u3314\u3397\u331c\u330d\u33fe\u3375\u3378\u338b\u33a9\u3393\u33dd\u33ab\u3306\u33f2\u331c\u33f1\u331d\u334b\u33f6\u33f1\u3312\u334d\u3300\u3306\u33c9\u33e2\u336c\u33fc\u334f\u337b\u3394\u335d\u33a5\u331d\u339e\u33fb\u3372\u33ec\u334c\u337c\u33e8\u338f\u33ae\u3363\u3356\u3335\u3348\u3336\u3308\u338b\u335c\u33ce\u330d\u337b\u335e\u33e0\u3335\u335e\u33a2\u3317\u3393\u3335\u33e6\u339e\u33bb\u33ed\u3388\u3311\u3376\u33b9\u331d\u330a\u3345\u334e\u33cd\u33cc\u339c\u33b4\u3310\u337c\u33e7\u33b1\u3351\u33ee\u33de\u33a9\u33a2\u331e\u33ee\u33e0\u3365\u3327\u33d4\u338d\u336e\u33ad\u33f6\u3389\u335e\u330d\u330f\u3310\u33d8\u3399\u337a\u33e8\u333c\u330e\u3358\u333d\u33f7\u33a6\u33f9\u3388\u337c\u332c\u33f4\u33f9\u33af\u33e2\u3351\u338a\u3388\u338b\u33cc\u3359\u339f\u33fc\u3326\u3372\u33b5\u3385\u3366\u33e8\u3341\u3381\u336d\u3342\u3328\u332b\u33f2\u33b6\u331e\u339f\u33e8\u33cf\u336c\u33ad\u335d\u338f\u339f\u3350\u3330\u332b\u3317\u3303\u3340\u33ab\u338e\u33af\u3338\u3379\u335f\u33a3\u33bd\u3312\u3346\u3353\u3382\u33d7\u3309\u33cd\u33cc\u332e\u33f2\u3343\u333b\u33ae\u33bf\u3322\u334e\u3336\u3353\u33fe\u3337\u3374\u3386\u33cb\u333f\u33b9\u33fb\u3383\u3356\u33f2\u33a3\u338c\u33aa\u330a\u33fc\u331b\u3336\u3305\u33f5\u3356\u33c0\u3332\u33a3\u33e5\u333f\u333d\u3399\u33ee\u3328\u33eb\u33f7\u33a0\u33df\u33f8\u3354\u3348\u33f4\u3347\u3358\u3387\u33b4\u333f\u3315\u33ee\u3309\u33e5\u33be\u3314\u3393\u3357\u33b6\u33ba\u337c\u33f4\u33e7\u33db\u33e0\u33ba\u33fa\u33b7\u337c\u33dc\u33e6\u3367\u337e\u3360\u33a7\u33ab\u33a8\u3326\u335e\u332d\u3396\u333d\u3389\u3328\u3333\u33fa\u33f9\u334e\u33ec\u3347\u3314\u3399\u3338\u33ba\u3385\u33b1\u33f1\u33c6\u3368\u33d4\u339a\u3350\u337d\u3390\u33d8\u3360\u3365\u3322\u335c\u333a\u33b3\u332e\u33fb\u3307\u3397\u33a4\u33fb\u33ad\u3325\u33ce\u3372\u3305\u33d5\u3324\u335a\u3321\u3325\u3364\u3365\u3357\u3377\u3325\u3313\u3300\u3353\u33b3\u33d0\u33e8\u3342\u330e\u3387\u338f\u330a\u33c6\u3383\u339d\u3343\u33ce\u33e4\u33ee\u335f\u33a1\u3314\u33b2\u33fc\u3340\u3370\u33a5\u33f0\u3334\u33fe\u33ae\u33a3\u33d0\u33c9\u3354\u335a\u333b\u33a0\u3311\u334b\u33ba\u3373\u33ff\u3356\u33bc\u3303\u33e5\u3330\u3334\u331d\u33e4\u3331\u3363\u3338\u33a0\u33bc\u3373\u3310\u33ff\u3373\u3392\u33e2\u3302\u330e\u3360\u33f5\u331c\u336e\u3398\u3325\u3348\u3364\u331a\u33bf\u33e0\u3388\u33ce\u334a\u3389\u33fd\u3345\u33bd\u3341\u3303\u33bc\u33b9\u3308\u33a8\u3316\u3317\u33c5\u334e\u339b\u33b1\u3335\u3389\u33ca\u33b8\u3325\u33c9\u33ad\u33c0\u3338\u3345\u330c\u337e\u333d\u334b\u33e3\u3392\u3331\u332a\u333d\u33be\u33c9\u33b3\u3351\u33c4\u33c4\u3399\u3345\u33ca\u33e3\u332a\u33ab\u337b\u3331\u3384\u33da\u33a6\u3348\u33db\u33e4\u333e\u33ec\u336f\u33a4\u3377\u3325\u3355\u339d\u332c\u339c\u3321\u33b3\u333f\u337e\u33d9\u33af\u33f9\u337f\u33cf\u3322\u335b\u3355\u337c\u3386\u3335\u335e\u334a\u3383\u33d3\u3361\u331a\u3385\u335e\u33b1\u3394\u33f3\u330a\u337f\u33ba\u33b9\u33d6\u3316\u33d8\u3346\u337e\u3304\u332e\u339f\u3365\u33e9\u33c8\u33cb\u3347\u33bb\u338b\u3397\u3315\u33b6\u3324\u3390\u33e4\u33b2\u3329\u33b9\u335c\u333a\u3303\u33e0\u3333\u33ed\u33c7\u33c5\u3342\u33ca\u3381\u33fc\u3317\u33a6\u33a4\u3381\u33cb\u3361\u3356\u33a8\u331f\u332c\u3345\u33bc\u3365\u33f5\u33c6\u3342\u339f\u3336\u33f5\u33c9\u3318\u3373\u337f\u3379\u332d\u333d\u33ef\u33b4\u3350\u336d\u33e5\u33b6\u330b\u3391\u33a2\u3308\u33bf\u33a0\u3366\u336d\u3328\u33e1\u335a\u3335\u3346\u3368\u33a0\u334b\u337c\u335b\u3334\u330b\u3340\u33a4\u331f\u3351\u3338\u33e7\u3334\u33b7\u337a\u33d3\u33c4\u3357\u33fd\u33ba\u33e7\u33fa\u330d\u33e3\u3306\u336b\u3365\u332b\u331c\u331b\u33df\u33d4\u3385\u33b6\u33b5\u33b4\u33d3\u3307\u331c\u333d\u3398\u3363\u3302\u3317\u33a6\u33f7\u33f0\u33ce\u33e0\u3309\u3333\u33ec\u339e\u3362\u33f8\u330d\u3324\u33a5\u337c\u332e\u33b3\u33f0\u3387\u3302\u3328\u332c\u335e\u330c\u33c6\u3357\u335e\u33f2\u3389\u33f6\u3328\u33c5\u335e\u33a2\u33e1\u33fd\u3313\u3325\u33df\u3388\u3313\u33af\u33c9\u334a\u3380\u3326\u33fd\u33f5\u330e\u33cc\u3356\u3364\u33f7\u3322\u33f6\u336d\u33c6\u33ae\u3387\u3384\u333e\u3308\u3366\u335a\u338f\u33cb\u337b\u33e7\u3308\u3349\u331f\u3373\u3393\u3351\u3326\u33aa\u335f\u3321\u338f\u3348\u3326\u3390\u33aa\u3350\u33ca\u336f\u33fa\u3391\u3376\u33a2\u335f\u33d1\u336c\u33bd\u33dd\u3360\u3316\u339d\u331c\u3303\u3305\u3307\u3346\u33ae\u33f9\u3349\u33c7\u3342\u3370\u3350\u3374\u33d8\u3302\u33bb\u3324\u3368\u33ee\u33c1\u3300\u3346\u3373\u33a6\u33fa\u339e\u3364\u3357\u33fb\u33c2\u3319\u336a\u332d\u3310\u3356\u33c4\u33e1\u3319\u335f\u332a\u33f3\u3340\u3370\u3320\u33fa\u3333\u330d\u334d\u3388\u338e\u330b\u3379\u33cd\u3333\u33ca\u33b3\u33d3\u339e\u3342\u332e\u338c\u3316\u332b\u3305\u3334\u3351\u33ca\u3337\u33fe\u33e9\u337a\u3316\u3351\u3381\u3301\u331a\u3342\u3304\u332b\u3342\u331e\u3301\u335d\u336e\u33ea\u3398\u3357\u3331\u3376\u3335\u3394\u332e\u3361\u3378\u337b\u33fd\u3398\u3324\u33cd\u3307\u3337\u3347\u3321\u3326\u338a\u3324\u3342\u3315\u33ef\u3326\u3323\u3322\u33f5\u3311\u33c9\u3315\u3340\u3370\u3394\u338d\u3335\u3377\u33f7\u335d\u3322\u336b\u338c\u3322\u3390\u3375\u339a\u331e\u33f9\u339b\u3378\u33d2\u333e\u339c\u3395\u33ad\u3335\u33fb\u33c3\u3324\u33a4\u33f1\u3350\u338c\u3332\u3387\u3344\u3304\u3379\u33ec\u3333\u33e3\u33b8\u3353\u33f8\u33e4\u33c9\u3391\u3304\u330f\u3391\u3309\u334a\u33c6\u33c3\u33b8\u3329\u3380\u33c7\u339a\u335f\u3365\u33f2\u3328\u3350\u3307\u33b8\u33f6\u3396\u332b\u331b\u3384\u334b\u3318\u33e0\u33ed\u33b5\u3309\u333b\u33d3\u335d\u332e\u3376\u3396\u3305\u33b1\u333f\u332f\u33b5\u33ac\u3327\u3342\u3304\u33bb\u33f5\u331f\u332b\u332c\u33fa\u3396\u3323\u33a0\u3354\u3353\u3306\u3318\u335b\u335f\u336c\u3335\u33ac\u33b0\u33f1\u33c6\u3359\u3379\u33e8\u3383\u338a\u3325\u33f1\u3314\u33d5\u339b\u330b\u3394\u3320\u3348\u33bb\u33c9\u33f0\u33d8\u3361\u337d\u33b9\u3386\u3377\u3359\u333d\u3352\u3353\u33c4\u3368\u339e\u339c\u33f6\u336c\u3322\u33d2\u33ab\u3367\u3330\u3346\u33f0\u33e3\u334f\u335e\u336f\u33c0\u3364\u3327\u3376\u337c\u338a\u33f4\u33f1\u33c9\u3312\u33f6\u33c9\u33e1\u3398\u3311\u3381\u33aa\u335b\u33fa\u33b5\u3378\u3362\u333d\u33ba\u338c\u3358\u3336\u3313\u336b\u335a\u331c\u336a\u3370\u336b\u338f\u3399\u338d\u330e\u3372\u339f\u3393\u33a7\u3316\u33f1\u33ff\u33dd\u332f\u33ad\u3331\u330c\u33ab\u3379\u3329\u334a\u33e3\u3309\u33f7\u3393\u33ff\u338a\u335c\u33c0\u33f1\u3365\u33f6\u3387\u330d\u3350\u33bd\u337b\u330c\u3325\u33e2\u3356\u3314\u339a\u335c\u33ed\u338a\u33d8\u338d\u33c1\u333a\u3301\u331d\u3330\u338b\u33d0\u331f\u3342\u33f7\u33ed\u3333\u33fc\u33cb\u3336\u3318\u33b7\u3396\u33bd\u33f5\u3329\u3399\u335a\u3380\u3382\u3340\u337a\u33a0\u33fc\u3356\u3318\u3399\u33cb\u3313\u33c9\u333b\u3365\u337c\u332e\u3366\u3325\u331d\u3301\u3312\u33ca\u3345\u3377\u33de\u3386\u3330\u3341\u338b\u332f\u3399\u33cb\u330d\u337e\u33dc\u3365\u33d2\u3383\u3328\u330c\u33a4\u337b\u3316\u339f\u33c2\u3317\u3324\u33a8\u336e\u3353\u336a\u331e\u33b5\u33b0\u336c\u3368\u33c6\u3365\u33ff\u330c\u3367\u334c\u3393\u33db\u33de\u3374\u33f7\u3384\u33e7\u3329\u3382\u3336\u33d1\u33b5\u3343\u33dc\u339b\u33dd\u3354\u33a2\u33ad\u33a8\u3355\u33d1\u33c9\u33e7\u3341\u3363\u3367\u331e\u33ae\u33a1\u33a9\u33b8\u3362\u332d\u3376\u3307\u33bd\u330e\u3301\u3335\u3375\u3331\u3323\u33e3\u3300\u33c9\u3373\u3379\u33bd\u3346\u33e2\u3338\u3311\u3351\u3329\u33fc\u3389\u336a\u330c\u33e6\u33b5\u33b4\u334d\u336a\u33ec\u33b0\u330d\u332a\u33c6\u3309\u33c6\u3311\u33be\u3333\u33ba\u33c7\u3378\u33a0\u330c\u3339\u3301\u3361\u33d0\u3334\u330a\u332b\u3373\u33cd\u3365\u3342\u33b7\u338d\u33ea\u33f6\u334f\u3346\u33c2\u33eb\u33a3\u33be\u33d9\u338e\u335b\u3356\u33fb\u3367\u33c6\u33a7\u338d\u33ba\u3355\u3394\u33fc\u33bc\u33cf\u33d8\u330f\u33be\u3385\u334e\u3336\u33af\u331a\u3346\u33ff\u3340\u33d7\u33ba\u3322\u3300\u332c\u3368\u33a9\u3316\u337e\u33eb\u3355\u339f\u33a5\u3356\u33ec\u335a\u33c4\u3367\u33ad\u3360\u33aa\u33ce\u33c3\u33f4\u335c\u339a\u3341\u3339\u3302\u3396\u3346\u33a4\u33db\u3347\u33ef\u33d7\u3349\u3327\u330c\u3344\u3344\u33ae\u334c\u33d6\u33b4\u339e\u33b7\u33a4\u336b\u3369\u334b\u3357\u3358\u3392\u33ba\u33c6\u33cc\u33d2\u33ac\u330b\u33ac\u33d2\u335c\u33e3\u33ce\u3375\u3302\u330d\u3311\u3320\u332d\u33be\u33f6\u3325\u33f5\u330e\u3355\u3383\u3341\u3336\u3355\u3345\u3303\u335e\u33f5\u334e\u33da\u3302\u339f\u3349\u332e\u336b\u3398\u33c9\u3324\u33ce\u33c6\u33ba\u3375\u330d\u336e\u3330\u332f\u3384\u3390\u33c4\u334d\u33f7\u339f\u33e1\u3371\u33e4\u339e\u33e5\u33e3\u330c\u33a0\u33b9\u336f\u33d6\u3398\u337e\u3321\u333f\u333d\u33ff\u339e\u33fd\u33ab\u33ca\u3348\u33e8\u3385\u33b7\u33d6\u334b\u335f\u333c\u3317\u33fb\u3344\u33f1\u332e\u3320\u33d0\u3369\u3362\u33ee\u3397\u3372\u3377\u33a1\u33cd\u3361\u3346\u3330\u333b\u330a\u331c\u3381\u33e0\u33cf\u33fa\u3355\u33bb\u331b\u339d\u3366\u3342\u3357\u33b9\u3312\u3329\u331d\u3372\u337d\u3300\u334b\u3321\u331c\u3333\u3353\u33ab\u3386\u33ee\u3366\u33e2\u33d5\u3378\u338e\u3346\u33e2\u33f0\u331b\u3383\u3372\u33bb\u3394\u33c8\u33a8\u330d\u33e1\u33ab\u33ef\u3326\u33bc\u336a\u33df\u332b\u332d\u3349\u33be\u3329\u3345\u33bf\u334b\u33e0\u33e6\u339c\u3385\u33af\u3350\u337f\u331a\u33c0\u33b9\u333d\u33b5\u331d\u33aa\u33f5\u33d5\u338b\u3321\u33ed\u3306\u3384\u3328\u333c\u33cc\u3355\u33dc\u3316\u3308\u33aa\u3313\u335a\u33f5\u3348\u334c\u33a6\u332c\u33ee\u33f0\u3321\u33e1\u33b9\u3376\u3331\u3392\u330f\u33f3\u33a1\u3313\u339d\u335a\u3300\u33e0\u33a5\u33ac\u33d9\u3367\u33e9\u33f6\u330d\u3329\u33c4\u33b5\u3349\u33ae\u3368\u338d\u33b3\u33c1\u338c\u33b1\u330f\u33ec\u337e\u33ce\u3354\u3356\u339b\u3390\u3324\u33e0\u3305\u33dd\u33f2\u334a\u3358\u33d8\u3370\u3385\u33da\u33c3\u3355\u33b5\u33a0\u339b\u336c\u336d\u33e6\u3373\u332c\u33ce\u3305\u33ef\u3324\u338c\u3397\u334e\u3322\u33b7\u33fa\u33e9\u33a9\u330f\u3349\u3325\u33e8\u33d5\u336a\u33aa\u33f9\u3374\u3302\u33bc\u33c3\u33fc\u330a\u3375\u33d6\u33e6\u33f6\u332c\u333a\u3388\u3352\u33a2\u33fc\u332c\u33a9\u33db\u3330\u3398\u3373\u331c\u33a1\u3347\u3337\u3383\u33be\u3330\u33df\u3318\u3355\u33e2\u3348\u333b\u3304\u33dd\u33d2\u33f5\u33ad\u333e\u335b\u33af\u3310\u3305\u332a\u338e\u338b\u3340\u33a3\u3371\u3317\u338a\u3353\u33b8\u332b\u338d\u338f\u33d5\u3324\u33cd\u335d\u3376\u338c\u3361\u3303\u33d9\u3376\u3386\u3371\u3316\u3340\u3300\u33d2\u3368\u3302\u33fe\u33b9\u337f\u3320\u3310\u337a\u33c1\u335a\u3371\u3372\u3326\u33f8\u334b\u334c\u33cb\u33c7\u3369\u334c\u333b\u33a4\u3321\u331e\u33fb\u332c\u33b5\u338e\u3352\u33d5\u33df\u335a\u33b5\u33e4\u33ac\u3345\u3333\u332f\u33eb\u33d7\u3347\u33a3\u33f2\u33c6\u335b\u3324\u3361\u330a\u3337\u3309\u33dc\u3325\u339f\u3388\u333c\u337c\u330b\u3393\u33e1\u33ca\u3368\u33b2\u33b5\u33e0\u33ab\u3334\u3338\u3346\u3351\u337f\u333f\u3350\u334a\u33f7\u3307\u338f\u333e\u338c\u33bd\u3317\u33ef\u33bf\u33c8\u336e\u3396\u3398\u3338\u3322\u33dd\u334b\u33de\u335f\u3309\u33de\u334d\u33c7\u33af\u3388\u3341\u336b\u330a\u3329\u3314\u33a1\u3347\u334b\u334c\u338c\u3351\u331e\u33f0\u3395\u33b2\u336f\u3394\u33ee\u33b1\u3340\u3320\u339e\u33c2\u339c\u337c\u3312\u3316\u331b\u336f\u33d6\u3354\u33cc\u33f4\u331a\u33d0\u33fb\u3371\u3360\u3349\u3304\u3389\u33c6\u3316\u339b\u3350\u334f\u33aa\u33a7\u3346\u338d\u334f\u3337\u33cd\u332e\u33c7\u3323\u338c\u33f3\u33cf\u3399\u33ad\u3303\u330b\u33c3\u333d\u33d0\u33ab\u33a9\u3321\u33bc\u33b2\u33e4\u33e4\u336a\u33ae\u335a\u331b\u33a3\u33e8\u33d0\u33a6\u3368\u33b4\u33d0\u33cd\u332b\u33a6\u3317\u33e9\u3375\u3382\u33e2\u3382\u33a4\u3324\u3353\u338a\u3307\u33ac\u335a\u335d\u33b1\u33ec\u33d9\u3351\u3333\u3335\u3381\u3322\u330f\u337c\u3311\u3342\u3393\u3378\u33e1\u336f\u3332\u33d9\u33c9\u33f0\u3349\u333a\u3380\u3326\u337c\u338f\u331b\u33a3\u33f9\u33fd\u3315\u33e0\u3347\u338a\u3339\u33b3\u33e9\u3362\u3332\u3375\u33e3\u3396\u33b8\u33c2\u330c\u33d9\u33cc\u337c\u3392\u3366\u33be\u33e8\u339d\u33e5\u33db\u33b2\u3328\u33f7\u33d2\u331c\u33e1\u330f\u337b\u33d9\u334e\u3358\u33e7\u3337\u3369\u33db\u333e\u3394\u338f\u332b\u33ab\u330b\u3367\u3361\u3318\u330a\u3379\u33d0\u33f9\u33e9\u3318\u337c\u33ce\u3304\u3378\u33a5\u33ec\u33d3\u332c\u335f\u3366\u334c\u3318\u33d1\u33e3\u335a\u33cd\u33cd\u33bf\u33ac\u331a\u33b8\u3367\u33c1\u339c\u3372\u332a\u33fa\u335e\u33b9\u33ee\u33af\u333a\u33a9\u337a\u33eb\u3319\u33af\u330e\u330e\u3312\u3364\u33d6\u3349\u33bd\u3387\u33bc\u3331\u3310\u333a\u333b\u3351\u332b\u3382\u3304\u339a\u3396\u332c\u3391\u339f\u3333\u33b2\u33a0\u33ea\u337c\u3361\u33ce\u3316\u332a\u33f3\u33c3\u33a2\u3329\u330b\u33c1\u3398\u3353\u33fa\u3373\u335c\u33d6\u338b\u33b9\u333e\u3344\u33eb\u33bf\u3303\u33e6\u332a\u3370\u33fd\u33d5\u33af\u335d\u337a\u33ce\u3308\u3349\u3347\u3333\u3366\u3301\u33b9\u3367\u335c\u3335\u333f\u33b7\u3357\u3340\u3330\u33bb\u33da\u334d\u33a0\u3397\u3353\u3398\u339f\u3331\u33a8\u337d\u333e\u333a\u33b7\u33b4\u3328\u33de\u3388\u3375\u334e\u33f7\u3326\u33f3\u33a8\u3314\u33ba\u3356\u3372\u3343\u33a8\u33c9\
   [junit4]   2> u339a\u33b4\u337c\u33a2\u3362\u33f3\u3308\u336a\u3315\u33c7\u3377\u331e\u33bb\u33e5\u3334\u3303\u3351\u33b4\u33e9\u339b\u3347\u33aa\u33e3\u338f\u335a\u332a\u3335\u33b5\u3366\u331d\u33ed\u3336\u3335\u3306\u3348\u33f8\u33f8\u3366\u33bb\u3318\u33bb\u33f1\u335f\u3318\u333a\u3317\u3376\u333d\u3304\u331f\u33e6\u3331\u339e\u330b\u3309\u3370\u33d4\u33ac\u338c\u337d\u338c\u336e\u33a7\u33ba\u3310\u3347\u3318\u3323\u333d\u33ea\u330c\u333f\u3391\u336c\u334f\u335d\u33c2\u3344\u33df\u334d\u3319\u336f\u33ff\u3380\u3358\u33d8\u3347\u3380\u3349\u336d\u333b\u33fe\u33ac\u332f\u334a\u33fc\u33b1\u33f2\u3308\u33f6\u33c7\u33c4\u339e\u33ef\u330c\u3398\u33f1\u3371\u33a2\u3348\u3345\u33ab\u33b7\u3305\u3383\u3301\u331d\u3327\u33d1\u33e5\u3345\u33bf\u332e\u330e\u3366\u33ea\u3323\u33ee\u33cb\u3312\u33f7\u33b6\u334e\u33fc\u3337\u33f0\u3344\u33d6\u331f\u33e8\u3310\u33db\u33f5\u3391\u33da\u3331\u3321\u33fa\u338e\u3326\u3300\u33ba\u336c\u33a2\u3390\u33c2\u33a1\u3301\u3324\u338c\u3321\u3377\u33bc\u33f9\u3388\u3375\u336e\u330e\u33e9\u3396\u33a7\u337b\u33f9\u33ca\u33ed\u3362\u333d\u33e1\u3370\u33c8\u335d\u33ac\u33b2\u330e\u3353\u33d6\u3339\u3302\u334f\u33f6\u3322\u3302\u332a\u33fd\u33a1\u3387\u331d\u332d\u336b\u33ee\u3394\u339a\u3300\u333b\u336a\u336b\u33b9\u33b6\u334d\u33a4\u33ef\u3371\u33a6\u333f\u33fc\u33b4\u33e8\u3369\u3333\u3376\u3327\u3332\u33ff\u33bd\u33e4\u3367\u3396\u33b0\u330f\u3313\u3329\u33ef\u33ea\u33e6\u3347\u3357\u332a\u33da\u338b\u338d\u337f\u337b\u330e\u33e1\u3314\u33ea\u33ae\u3350\u33ee\u332c\u33e0\u334c\u33b3\u33cf\u333e\u33e6\u3358\u3349\u339d\u339a\u332e\u330d\u33d1\u3391\u331b\u33e5\u332c\u33ff\u33f0\u3370\u33ef\u332e\u33a8\u33f9\u33a9\u3368\u3343\u337e\u3317\u3335\u3316\u33a5\u3340\u3353\u3354\u33e3\u3389\u33c2\u335c\u3384\u3301\u330c\u3317\u338d\u3399\u33e5\u3329\u3338\u332b\u33df\u33c3\u33ff\u33be\u332e\u33c1\u333c\u3385\u33f2\u33f3\u33b0\u33a7\u338e\u3326\u33e1\u33cd\u33f7\u339d\u33c8\u339e\u337f\u3304\u33cf\u33ba\u332e\u332b\u3358\u33b7\u3386\u3391\u33be\u33b2\u33b3\u33fa\u334d\u33ab\u331f\u33a7\u332d\u334c\u3370\u3370\u339a\u33ce\u3348\u33b7\u33cc\u337b\u338d\u339b\u33ec\u3330\u33e9\u3347\u33da\u3395\u33c3\u3317\u33e4\u33da\u339e\u33c4\u334a\u3396\u3375\u3369\u334f\u330e\u336b\u334b\u3399\u3382\u3304\u33cc\u331b\u33b3\u3349\u3308\u3367\u334e\u3381\u3381\u339c\u332f\u3386\u3360\u3377\u339d\u3361\u3357\u33d6\u33b5\u3370\u33ef\u3387\u336f\u339e\u332a\u33ac\u3353\u33d5\u33d9\u3397\u33f6\u335d\u335b\u3397\u3330\u3374\u3366\u337c\u3312\u33d4\u3334\u3352\u33fe\u339d\u3359\u335c\u333a\u3316\u334a\u332a\u3316\u33ed\u33a5\u3391\u3349\u330d\u3392\u33f5\u3397\u3324\u3354\u33bf\u3337\u33d3\u33ee\u339e\u33a6\u33ef\u33a9\u333b\u33b2\u3379\u3343\u3308\u331c\u33a8\u3359\u33f3\u3392\u3316\u333c\u3374\u3309\u33d4\u33cf\u33c0\u333d\u33f6\u33c7\u332a\u33f2\u3375\u3329\u33b2\u337d\u33b9\u3359\u33f0\u330f\u3336\u3349\u334b\u33a3\u330c\u33c0\u3300\u33b0\u33a8\u3318\u33bb\u33a0\u33d3\u3303\u33c2\u3389\u33d4\u3380\u331c\u3358\u337a\u337c\u33f8\u33f0\u33bc\u3330\u3377\u3395\u3365\u33c1\u335b\u33eb\u3379\u3381\u33d1\u33f6\u335b\u337f\u339f\u338a\u33ea\u3315\u33bb\u3395\u3318\u3399\u33a6\u333d\u3340\u3311\u330b\u336f\u334e\u3353\u333b\u33b7\u33e9\u33ad\u3323\u334b\u337a\u3323\u330a\u3372\u33ba\u330b\u33db\u3381\u334e\u3336\u33b9\u330f\u33b0\u33f9\u3383\u33e5\u339a\u333c\u33da\u33c2\u33c8\u331a\u33af\u3340\u33fd\u3361\u3340\u3357\u3332\u33b8\u3357\u33cb\u33df\u33ad\u33a5\u3393\u3342\u33f6\u33ca\u33a6\u33a8\u330c\u33e5\u338f\u3344\u33af\u3344\u33a2\u337e\u3394\u3306\u3305\u33b6\u33bd\u336c\u3381\u3344\u335f\u334d\u33c7\u3313\u33ac\u330a\u3383\u33f7\u3355\u33df\u3346\u33d0\u3307\u3328\u3339\u331e\u3302\u3351\u338d\u33f6\u33b8\u3373\u3386\u3362\u3362\u332d\u3325\u333e\u33c9\u332c\u333b\u330a\u33f3\u33de\u3316\u3369\u33f7\u3329\u3304\u3394\u3334\u33d9\u33a3\u331f\u3338\u3367\u3302\u3349\u33c9\u339c\u336d\u3383\u332d\u337e\u3341\u3351\u3328\u3331\u3364\u3350\u332b\u33ca\u3310\u336b\u33a9\u3333\u333f\u333f\u33f0\u3386\u3358\u3319\u332c\u33f0\u334d\u3328\u33c2\u3321\u3359\u33ee\u3376\u3325\u3319\u335d\u33f8\u3318\u3388\u333e\u3368\u3301\u33aa\u3372\u333c\u3334\u33d6\u335e\u330e\u3391\u3332\u33be\u3316\u3396\u3361\u3360\u3350\u3365\u33a8\u33b7\u334b\u3338\u3364\u3326\u33a1\u3365\u3309\u336b\u33c1\u338b\u3354\u336e\u33d3\u33e4\u330a\u332a\u335f\u33b6\u3311\u3377\u336d\u33ca\u3383\u33cd\u334b\u3383\u33a9\u33d1\u338a\u336d\u3355\u33c6\u3399\u3374\u3372\u33d6\u3368\u33cb\u333e\u33a4\u3318\u33a8\u33eb\u335f\u3314\u3363\u33e0\u336c\u3377\u3306\u33c8\u3341\u33b4\u338b\u334f\u33d3\u3383\u330f\u333a\u3337\u3316\u331a\u3388\u331d\u3364\u330f\u33e9\u3306\u33d3\u338f\u33a7\u3318\u3342\u33bc\u3322\u33ab\u3388\u335a\u33f4\u338e\u33b1\u336a\u333f\u33ac\u33ff\u33de\u33c4\u3327\u3365\u33c4\u33e6\u33cd\u3330\u33ab\u33a1\u33bf\u33b9\u33a7\u3361\u3391\u3321\u330f\u3376\u33e6\u3353\u331d\u3355\u335a\u338f\u33a6\u332e\u334d\u331f\u33a5\u3303\u331b\u3343\u337b\u33dd\u33a6\u3363\u33f9\u339a\u33fe\u3395\u33b9\u3395\u33a4\u3374\u3334\u334f\u33a8\u3379\u332e\u33e0\u3398\u33e7\u33c7\u33a7\u333b\u33d9\u33f0\u3353\u3355\u33b0\u3308\u33da\u3388\u33a3\u3351\u33c9\u33f1\u33c8\u332a\u3324\u336b\u333f\u33ca\u33a3\u332f\u334e\u3361\u33d2\u33b9\u337f\u3327\u33c8\u3361\u331c\u338b\u33fa\u33aa\u3335\u3323\u3354\u33d4\u33f6\u3339\u330e\u333d\u33ea\u33d1\u337f\u33db\u3339\u3318\u33fa\u339b\u33f1\u33bf\u33da\u33fc\u33ff\u33d9\u331f\u3321\u334f\u3374\u33de\u33d3\u3341\u3349\u3321\u3354\u336d\u33fb\u33a6\u3396\u3343\u3325\u3395\u33ae\u33a3\u3380\u33fc\u3375\u332a\u3344\u3380\u33ef\u33fa\u33aa\u33e6\u336f\u33f9\u3306\u3305\u3345\u335e\u3326\u33a0\u336f\u33b3\u33c1\u33d4\u3377\u33a2\u3336\u332b\u3328\u33a0\u33b0\u3396\u33e9\u3362\u3343\u33b4\u334f\u33d0\u3336\u3343\u334a\u33c9\u337a\u33af\u3389\u3331\u33c4\u3313\u3379\u33bc\u3347\u33d5\u33a7\u3379\u3377\u33dc\u3313\u33ac\u33eb\u3323\u3389\u330f\u3383\u33cd\u3317\u33a5\u33ed\u33ad\u3357\u33f8\u3314\u33bc\u33f4\u33c0\u3316\u3343\u3391\u3383\u3381\u33d5\u3345\u3340\u33b8\u33e7\u33c8\u3308\u331d\u3304\u339a\u3304\u337c\u33ab\u33dd\u33ab\u33a1\u3347\u33a6\u33e6\u3394\u33c4\u33ea\u3369\u330f\u3306\u3334\u33cf\u334f\u338c\u33f9\u332b\u334d\u33b7\u3384\u3316\u3315\u33b9\u3348\u33ca\u331d\u333f\u339c\u33ad\u33aa\u3350\u33b2\u3318\u3318\u3300\u337a\u3346\u3320\u33a3\u3385\u3323\u331b\u3319\u3325\u3350\u3334\u3353\u3316\u33cf\u335d\u33fb\u33da\u3332\u3313\u335d\u3305\u33d0\u33a9\u338b\u33df\u33a8\u3350\u3325\u3343\u33cb\u3372\u33de\u33c6\u3369\u339e\u33e4\u33ab\u3326\u337c\u33fc\u3341\u33ac\u334d\u3315\u331e\u339f\u3384\u3353\u3303\u332b\u33ea\u333e\u33e3\u333d\u33dc\u331a\u3383\u3367\u3336\u33ec\u334b\u33a5\u334d\u3383\u33f7\u33ed\u33d2\u33dd\u3365\u3327\u33a4\u3378\u332c\u3345\u3331\u331c\u33e9\u330e\u3312\u3396\u3379\u33f7\u3331\u3334\u335e\u33e5\u3375\u332d\u338c\u33cb\u338d\u33ca\u33e5\u3363\u33b1\u3381\u3337\u330d\u3391\u33a1\u33fb\u33b5\u33dd\u33c5\u332c\u3320\u33fc\u3370\u3306\u339c\u33af\u330e\u33fb\u330c\u33c9\u3309\u337c\u33a2\u339a\u3335\u3370\u3320\u3385\u330a\u33e9\u3364\u3384\u3370\u330b\u33e4\u3350\u33a3\u3347\u335d\u334d\u33b5\u33e9\u33d9\u3330\u3308\u3391\u3333\u339c\u33ed\u3361\u336b\u3343\u33e5\u33ab\u33dc\u3332\u33a6\u3321\u33a7\u338a\u336a\u335b\u3344\u33c1\u3353\u338b\u33db\u3380\u338e\u333d\u333a\u33c1\u33e0\u33d8\u335c\u3368\u33d5\u3355\u33a3\u33f2\u3352\u3356\u330c\u3342\u332f\u330d\u33cc\u3348\u3319\u3301\u331c\u339d\u3377\u3363\u33cc\u33d6\u33e7\u33b2\u33b2\u3322\u33c9\u3315\u3381\u33d3\u3345\u33e9\u33df\u337b\u3310\u33b2\u33a4\u3347\u3377\u335d\u332e\u336b\u334f\u33a4\u33e8\u330b\u3313\u3362\u33c5\u3356\u3376\u334a\u33b5\u33b5\u3349\u3346\u33bb\u3323\u3325\u33a0\u337c\u33d5\u33ee\u33e5\u33a6\u3372\u335e\u33d9\u33fc\u3349\u3373\u33bd\u330f\u3346\u33ec\u33ec\u3310\u33d3\u3321\u33ef\u338b\u33f8\u3358\u3301\u33c2\u3318\u3379\u33da\u33ae\u33f3\u333b\u3344\u337e\u331a\u3311\u3313\u3306\u33ec\u3334\u33be\u3330\u33c9\u331f\u33bb\u3388\u33ae\u330a\u335f\u33ec\u33c0\u339f\u3397\u338b\u333a\u3340\u33b2\u33b0\u3375\u333d\u336b\u33aa\u33e1\u33f6\u3329\u334d\u3308\u332b\u3383\u3336\u335a\u3319\u3366\u334a\u33b6\u3394\u33b3\u330d\u333c\u339e\u3363\u33fb\u3363\u33c7\u3371\u33bc\u331e\u330d\u33db\u3379\u331e\u33e1\u3310\u33d7\u33b6\u33c8\u3303\u337c\u337b\u3398\u33a3\u335a\u33a0\u3326\u33f0\u333f\u338d\u33c9\u338b\u3392\u332f\u3307\u3317\u33dd\u33ff\u3375\u3313\u330a\u3377\u337c\u3372\u336c\u331f\u334b\u3349\u3330\u3311\u330f\u330c\u333c\u33fb\u332e\u3386\u3359\u3395\u335b\u33ee\u335b\u33b4\u33cc\u33f5\u33da\u335e\u33fc\u3397\u3350\u33d5\u332e\u33e6\u3387\u3385\u3350\u338b\u339b\u333b\u33fb\u3365\u33ee\u330a\u3327\u33aa\u3326\u3348\u3349\u335d\u33fb\u33e4\u3340\u3385\u334b\u334a\u3319\u331b\u339f\u33a2\u3362\u3322\u335c\u3302\u33e5\u33f5\u3310\u3340\u3306\u3314\u331c\u33ac\u335c\u3383\u331b\u3387\u33a5\u3334\u3377\u33a9\u33e4\u33bb\u33c8\u33d3\u334e\u33d7\u333b\u33e9\u338c\u3312\u332f\u3348\u3390\u33a7\u3342\u3372\u33f4\u33b0\u3303\u33b1\u339b\u330e\u33a4\u3304\u33f8\u33a4\u33ca\u33e4\u3344\u336d\u333d\u339c\u3320\u33fd\u3328\u3361\u33b1\u3334\u338b\u33d4\u3375\u33b4\u33df\u3300\u3380\u333d\u338f\u3362\u33db\u332e\u3375\u33fe\u33dc\u33d3\u33f1\u33ce\u3304\u3361\u3373\u3352\u33fd\u331a\u3300\u334e\u33d1\u337d\u3352\u3352\u33c5\u3395\u338d\u331b\u3342\u334a\u33ee\u33d1\u3371\u3308\u33f1\u33ef\u333a\u3361\u336d\u338d\u33c3\u33ec\u338d\u3352\u33d1\u33b4\u33f2\u3375\u33c9\u334d\u335b\u3363\u3385\u33f1\u3375\u338d\u33f2\u33e3\u33ed\u332e\u334d\u3394\u3348\u3386\u336a\u3301\u333c\u333a\u3384\u33c8\u33a9\u33cb\u3364\u33e3\u3363\u3316\u3391\u335a\u33b2\u33cb\u3395\u33d1\u330f\u3397\u3387\u3389\u33b1\u336b\u3349\u3382\u3318\u335f\u3342\u33a9\u33ae\u3324\u333c\u332a\u3324\u33a1\u33f6\u331a\u335e\u3310\u33e0\u33a8\u33ac\u3386\u33ff\u334f\u3373\u334d\u33e2\u3344\u3304\u33a5\u3366\u3347\u334c\u3358\u3376\u33a6\u3348\u33da\u33a2\u332d\u33c1\u33df\u3360\u33ab\u332a\u337c\u3341\u3366\u3388\u332f\u33ed\u33fb\u33af\u3354\u3363\u33e2\u333d\u33d4\u338f\u3356\u33c5\u330a\u336a\u330f\u33b1\u3361\u3373\u33f5\u339c\u338b\u33e7\u3364\u337b\u3310\u334d\u3357\u3345\u33fb\u337d\u3330\u3338\u3316\u3366\u3360\u33d6\u3308\u3370\u33e5\u33f6\u33c2\u3350\u33b8\u33ee\u330f\u3399\u33ea\u33b1\u331b\u339a\u33ef\u33cb\u3371\u33c4\u339e\u3383\u33a6\u33b6\u331b\u33b5\u338a\u33d0\u3308\u3366\u3322\u336d\u331c\u339b\u333c\u3383\u3372\u3319\u3364\u3357\u3326\u3311\u33ad\u33a9\u330c\u338c\u336e\u3372\u339d\u33e7\u33eb\u33fc\u3376\u33e7\u33a4\u3337\u33d3\u3399\u3348\u3353\u3312\u33d3\u3381\u3390\u33b9\u33c5\u330e\u33bb\u33cc\u3318\u339b\u33a7\u332b\u338f\u33bd\u3377\u330c\u333c\u33c4\u33d8\u330e\u33b7\u336f\u335f\u3372\u33c4\u3315\u33ee\u330f\u33ad\u3314\u33bb\u3313\u335e\u3347\u3387\u3398\u337d\u3342\u3374\u33d9\u33e1\u3348\u3390\u3304\u33e2\u33f7\u337b\u33d9\u3388\u3311\u33e6\u3317\u3327\u3333\u335e\u3379\u3347\u3304\u3381\u333a\u33c3\u33a4\u3335\u336c\u3370\u3396\u33f8\u3307\u33b9\u3397\u3396\u33b0\u3305\u33f1\u33e1\u332d\u33e5\u3347\u33b6\u33e2\u3359\u3347\u3337\u33e2\u334b\u3349\u33bd\u339c\u339e\u33fb\u3311\u33ab\u3371\u3332\u3307\u3395\u33e0\u336d\u33c9\u335f\u3379\u33c6\u334b\u33c6\u3304\u332e\u333b\u3316\u338a\u33f2\u33a0\u3302\u33d8\u339f\u33ea\u33c5\u337c\u33ac\u33e4\u33c5\u3343\u337c\u339b\u3324\u3375\u3338\u336a\u338c\u33e6\u339a\u337f\u33b3\u335d\u33b7\u338b\u3336\u3347\u3355\u3320\u3387\u3386\u3308\u338d\u3396\u33cb\u334d\u33fd\u33d9\u3300\u33be\u334a\u33b1\u3336\u33f9\u3345\u3333\u3349\u33bc\u331f\u33c4\u3387\u334a\u332d\u3380\u3308\u336c\u3306\u3396\u3333\u33e6\u3320\u3329\u3371\u33ad\u331b\u335a\u33bd\u330e\u336b\u33ea\u33cf\u33b0\u3382\u33ce\u3397\u33da\u3319\u3303\u3373\u33b1\u334b\u3304\u3312\u33b6\u336b\u33e8\u33e7\u3310\u33ed\u33f2\u33e7\u333a\u33be\u33b2\u33e4\u33ac\u330c\u3378\u3367\u331d\u33a1\u3322\u33f1\u3369\u335d\u3368\u3323\u33f1\u33aa\u3310\u3303\u33e4\u3301\u33c8\u331e\u337c\u33dd\u33f8\u33ba\u33c6\u331b\u335c\u3320\u33f0\u3379\u3349\u33fc\u33e1\u3330\u3350\u33e1\u3304\u33b6\u3301\u33e1\u3352\u33b2\u33bb\u331d\u3302\u332c\u3346\u33cc\u33fd\u3317\u3392\u3387\u330e\u33c8\u3376\u3381\u339a\u3310\u338e\u33bd\u339b\u338e\u3382\u33e1\u33f4\u33ba\u3379\u3315\u33d0\u33f9\u3326\u3399\u3395\u3339\u3352\u3314\u33be\u3372\u330c\u33cd\u3312\u33ad\u33bd\u33f9\u33c6\u3331\u33b7\u3338\u3331\u3355\u3332\u3370\u3339\u33da\u3390\u33b8\u33de\u33a1\u337f\u33f9\u3327\u3347\u3353\u33a1\u3356\u3312\u3347\u3314\u33c6\u335e\u33b3\u3355\u3347\u33fb\u3342\u337a\u3322\u330b\u33ff\u33e7\u33a1\u33b8\u3337\u330a\u33dd\u336e\u3318\u3392\u33c7\u3373\u33d7\u330f\u33bd\u33af\u3344\u33c0\u334e\u3355\u33d9\u33b9\u332e\u333a\u33d4\u3352\u3300\u33d1\u33f8\u337d\u3390\u33f3\u33e9\u338a\u33fd\u33e3\u33c4\u33f6\u3328\u3358\u3334\u33c8\u33b3\u332d\u3389\u33a5\u33ab\u33e1\u33d0\u33bd\u3364\u3352\u33db\u33a8\u33fc\u3385\u330f\u3362\u332c\u3361\u33d0\u33f5\u336e\u33f4\u335a\u334c\u330e\u33d5\u3348\u334f\u33f8\u330a\u3314\u3351\u337a\u3388\u3318\u3360\u3326\u33f0\u33c7\u33b1\u33b1\u33e0\u337c\u33ec\u3333\u33a4\u33bb\u3310\u3310\u33b7\u3388\u33f4\u33a0\u33df\u337c\u3398\u33c8\u33b1\u331a\u3326\u33e1\u33fa\u33d8\u338d\u339b\u334b\u3324\u338c\u331c\u33da\u332a\u3377\u3376\u3353\u33ea\u33b8\u33d2\u3304\u33f9\u33c7\u3339\u337d\u3352\u3346\u3348\u33aa\u3340\u337e\u33e1\u3374\u333a\u3364\u33df\u33e8\u3302\u3303\u3358\u3316\u333d\u33a6\u3329\u3360\u331d\u33aa\u3382\u3388\u334a\u3312\u335d\u332d\u33b5\u33fb\u33e8\u3371\u33ff\u339a\u3320\u3363\u33ed\u33ef\u3326\u33fd\u33a6\u33d3\u33cf\u3357\u331e\u3395\u33a6\u3328\u3376\u33bf\u3373\u33ad\u332c\u33b9\u338d\u3390\u338e\u33dd\u3366\u333d\u330b\u330c\u33a5\u331b\u3317\u33aa\u33fa\u3324\u3332\u3349\u33f8\u33f8\u33cd\u33d0\u3324\u33af\u330c\u33a7\u336e\u33a8\u3332\u330d\u33ea\u3346\u3351\u3394\u33fe\u337b\u33a0\u33ca\u3390\u334d\u339b\u3353\u334e\u3347\u3374\u33eb\u33d7\u33a2\u334b\u33c1\u3381\u3328\u3393\u331e\u3363\u338a\u3375\u33c2\u33a1\u33e5\u33a2\u3355\u335f\u33cc\u334e\u3367\u33a5\u33be\u3366\u33b2\u339d\u334e\u333d\u33ef\u334a\u33ad\u33ce\u3342\u3326\u33c2\u33a2\u3318\u3312\u3389\u3376\u335f\u33dc\u33b5\u33eb\u3320\u3397\u3315\u3387\u338e\u3307\u3303\u33c2\u33f2\u33e9\u33b3\u3324\u33cf\u33f7\u33c9\u33aa\u33c0\u333e\u3366\u33c7\u3338\u33a7\u33b7\u3385\u332d\u333b\u33d2\u3349\u33b3\u3323\u3354\u332c\u33b9\u3344\u3314\u33a1\u334d\u33d6\u33b2\u3393\u33f0\u33e3\u33b9\u33af\u335c\u3339\u330d\u3383\u331b\u33e0\u3394\u33ea\u333e\u3361\u3337\u335a\u33dd\u330e\u33d1\u3309\u33fb\u33cd\u33c1\u3316\u333e\u33c1\u3399\u3362\u3375\u3341\u33c1\u331c\u3316\u33e7\u3375\u3302\u3320\u333d\u3351\u3345\u33af\u334b\u33cb\u3326\u336d\u334e\u3332\u33eb\u33be\u3313\u3329\u3345\u3340\u33ea\u3388\u33be\u338b\u339b\u3372\u3354\u33ac\u33e1\u3332\u33a1\u3326\u3308\u33a3\u33a2\u3350\u332c\u333a\u33ac\u3325\u3377\u33b3\u3343\u334e\u3312\u33a1\u3326\u332e\u3370\u33ea\u33a8\u33c1\u33ca\u331d\u3333\u330e\u337f\u3335\u33b5\u3317\u336f\u3361\u3392\u3396\u3306\u3318\u3366\u3369\u3305\u3356\u33f2\u33ec\u3332\u336f\u33cf\u3329\u3364\u33db\u33fd\u3332\u33c1\u3384\u3319\u3328\u3371\u33b5\u3367\u33a2\u33ae\u33ec\u33d8\u33da\u33ad\u330b\u3313\u334e\u3329\u334c\u330e\u335a\u3333\u33fe\u3384\u33c5\u3332\u3337\u3301\u3353\u338f\u33f4\u33ba\u33af\u3320\u3399\u33ef\u335b\u3361\u33d6\u33c7\u3360\u33cb\u334c\u33b0\u33da\u33a7\u33b2\u3352\u33fb\u3398\u330f\u333c\u33a9\u339a\u3327\u339b\u337b\u33b9\u33b8\u3319\u3309\u3396\u33b4\u336f\u3379\u33e0\u3332\u33c3'
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestICUNormalizer2CharFilter -Dtests.method=testRandomStrings -Dtests.seed=E0CC2305A3C7C11A -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es_GT -Dtests.timezone=Asia/Amman -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   12.6s J0 | TestICUNormalizer2CharFilter.testRandomStrings <<<
   [junit4]    > Throwable #1: java.lang.IllegalArgumentException: Document contains at least one immense term in field="dummy" (whose UTF8 encoding is longer than the max length 32766), all of which were skipped.  Please correct the analyzer to not produce such terms.  The prefix of the first immense term is: '[-29, -125, -110, -29, -126, -102, -29, -126, -94, -29, -126, -71, -29, -125, -120, -29, -125, -85, 49, 51, -26, -105, -91, 49, 57, -25, -126, -71, 109, 50]...', original message: bytes can be at most 32766 in length; got 51602
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([E0CC2305A3C7C11A:684523BB00C3962F]:0)
   [junit4]    > 	at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:671)
   [junit4]    > 	at org.apache.lucene.index.DefaultIndexingChain.processField(DefaultIndexingChain.java:342)
   [junit4]    > 	at org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:301)
   [junit4]    > 	at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:222)
   [junit4]    > 	at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:450)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1507)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1222)
   [junit4]    > 	at org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:149)
   [junit4]    > 	at org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:110)
   [junit4]    > 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:622)
   [junit4]    > 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:513)
   [junit4]    > 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:437)
   [junit4]    > 	at org.apache.lucene.analysis.icu.TestICUNormalizer2CharFilter.testRandomStrings(TestICUNormalizer2CharFilter.java:202)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]    > Caused by: org.apache.lucene.util.BytesRefHash$MaxBytesLengthExceededException: bytes can be at most 32766 in length; got 51602
   [junit4]    > 	at org.apache.lucene.util.BytesRefHash.add(BytesRefHash.java:284)
   [junit4]    > 	at org.apache.lucene.index.TermsHashPerField.add(TermsHashPerField.java:151)
   [junit4]    > 	at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:645)
   [junit4]    > 	... 50 more
   [junit4]    > 	Suppressed: java.lang.AssertionError: close() called in wrong state: INCREMENT
   [junit4]    > 		at org.apache.lucene.analysis.MockTokenizer.close(MockTokenizer.java:262)
   [junit4]    > 		at org.apache.lucene.index.DefaultIndexingChain$PerField.invert(DefaultIndexingChain.java:661)
   [junit4]    > 		... 50 more
   [junit4]   2> NOTE: leaving temporary files on disk at: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/build/analysis/icu/test/J0/./lucene.analysis.icu.TestICUNormalizer2CharFilter-E0CC2305A3C7C11A-001
   [junit4]   2> NOTE: test params are: codec=Lucene42, sim=DefaultSimilarity, locale=es_GT, timezone=Asia/Amman
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_60 (64-bit)/cpus=16,threads=1,free=132423856,total=163577856
   [junit4]   2> NOTE: All tests run in this JVM: [TestICUFoldingFilter, TestICUTransformFilter, TestICUNormalizer2CharFilter]
   [junit4] Completed on J0 in 22.34s, 17 tests, 1 error <<< FAILURES!

[...truncated 13 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:467: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:447: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:45: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/build.xml:544: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:2028: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/analysis/build.xml:106: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/analysis/build.xml:38: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/module-build.xml:60: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1299: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:923: There were test failures: 17 suites, 126 tests, 1 error

Total time: 30 minutes 43 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-Tests-4.x-Java7 #2040
Archived 3 artifacts
Archive block size is 32768
Received 0 blocks and 230528 bytes
Compression is 0.0%
Took 89 ms
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



Re: [JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 2049 - Still Failing

Posted by "david.w.smiley@gmail.com" <da...@gmail.com>.
Thanks… I added such a test earlier actually (same commit as changing the
default separator to comma) so it’s in there now.

~ David Smiley
Freelance Apache Lucene/Solr Search Consultant/Developer
http://www.linkedin.com/in/davidwsmiley


On Thu, Aug 7, 2014 at 5:32 PM, Chris Hostetter <ho...@fucit.org>
wrote:

>
> Smiley,
>
> QueryEqualityTest has a sanity check built into it to ensure no one adds a
> new built-in QParser w/o writting some query equality tests for it ... it
> seems to have caught you....
>
>
> : Date: Thu, 7 Aug 2014 20:23:23 +0000 (UTC)
> : From: Apache Jenkins Server <je...@builds.apache.org>
> : Reply-To: dev@lucene.apache.org
> : To: dev@lucene.apache.org
> : Subject: [JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 2049 - Still
> Failing
> :
> : Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/2049/
> :
> : 2 tests failed.
> : FAILED:
>  junit.framework.TestSuite.org.apache.solr.search.QueryEqualityTest
> :
> : Error Message:
> : testParserCoverage was run w/o any other method explicitly testing
> qparser: terms
> :
> : Stack Trace:
> : java.lang.AssertionError: testParserCoverage was run w/o any other
> method explicitly testing qparser: terms
> :       at __randomizedtesting.SeedInfo.seed([894023E3DFD774C6]:0)
> :       at org.junit.Assert.fail(Assert.java:93)
> :       at org.junit.Assert.assertTrue(Assert.java:43)
> :       at
> org.apache.solr.search.QueryEqualityTest.afterClassParserCoverageTest(QueryEqualityTest.java:62)
> :       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> :       at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> :       at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> :       at java.lang.reflect.Method.invoke(Method.java:606)
> :       at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
> :       at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:790)
> :       at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> :       at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> :       at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> :       at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> :       at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> :       at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> :       at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> :       at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> :       at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> :       at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> :       at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> :       at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> :       at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
> :       at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> :       at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> :       at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
> :       at java.lang.Thread.run(Thread.java:745)
> :
> :
> : FAILED:  org.apache.solr.cloud.MultiThreadedOCPTest.testDistribSearch
> :
> : Error Message:
> : We have a failed SPLITSHARD task
> :
> : Stack Trace:
> : java.lang.AssertionError: We have a failed SPLITSHARD task
> :       at
> __randomizedtesting.SeedInfo.seed([894023E3DFD774C6:8A6ADFBA88814FA]:0)
> :       at org.junit.Assert.fail(Assert.java:93)
> :       at org.junit.Assert.assertTrue(Assert.java:43)
> :       at
> org.apache.solr.cloud.MultiThreadedOCPTest.testTaskExclusivity(MultiThreadedOCPTest.java:125)
> :       at
> org.apache.solr.cloud.MultiThreadedOCPTest.doTest(MultiThreadedOCPTest.java:71)
> :       at
> org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
> :       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> :       at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> :       at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> :       at java.lang.reflect.Method.invoke(Method.java:606)
> :       at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
> :       at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
> :       at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
> :       at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
> :       at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> :       at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> :       at
> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
> :       at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> :       at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> :       at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
> :       at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
> :       at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> :       at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> :       at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
> :       at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
> :       at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
> :       at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
> :       at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
> :       at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
> :       at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
> :       at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> :       at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> :       at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> :       at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> :       at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> :       at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> :       at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> :       at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> :       at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> :       at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> :       at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> :       at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> :       at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
> :       at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> :       at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> :       at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
> :       at java.lang.Thread.run(Thread.java:745)
> :
> :
> :
> :
> : Build Log:
> : [...truncated 13182 lines...]
> :    [junit4] Suite: org.apache.solr.search.QueryEqualityTest
> :    [junit4]   2> Creating dataDir:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.search.QueryEqualityTest-894023E3DFD774C6-001/init-core-data-001
> :    [junit4]   2> 1065206 T2891 oas.SolrTestCaseJ4.buildSSLConfig
> Randomized ssl (true) and clientAuth (true)
> :    [junit4]   2> 1065208 T2891 oas.SolrTestCaseJ4.initCore ####initCore
> :    [junit4]   2> 1065208 T2891 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/'
> :    [junit4]   2> 1065209 T2891
> oasc.SolrResourceLoader.replaceClassLoader Adding
> 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/.svn/'
> to classloader
> :    [junit4]   2> 1065210 T2891
> oasc.SolrResourceLoader.replaceClassLoader Adding
> 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/README'
> to classloader
> :    [junit4]   2> 1065210 T2891
> oasc.SolrResourceLoader.replaceClassLoader Adding
> 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/classes/'
> to classloader
> :    [junit4]   2> 1065344 T2891 oasc.SolrConfig.<init> Using Lucene
> MatchVersion: LUCENE_4_10
> :    [junit4]   2> 1065414 T2891 oasc.SolrConfig.<init> Loaded SolrConfig:
> solrconfig.xml
> :    [junit4]   2> 1065415 T2891 oass.IndexSchema.readSchema Reading Solr
> Schema from schema15.xml
> :    [junit4]   2> 1065425 T2891 oass.IndexSchema.readSchema [null] Schema
> name=test
> :    [junit4]   2> 1065818 T2891 oass.IndexSchema.readSchema default
> search field in schema is text
> :    [junit4]   2> 1065820 T2891 oass.IndexSchema.readSchema unique key
> field: id
> :    [junit4]   2> 1065822 T2891 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
> :    [junit4]   2> 1065825 T2891 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
> :    [junit4]   2> 1065836 T2891 oasc.SolrResourceLoader.locateSolrHome
> JNDI not configured for solr (NoInitialContextEx)
> :    [junit4]   2> 1065837 T2891 oasc.SolrResourceLoader.locateSolrHome
> using system property solr.solr.home:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr
> :    [junit4]   2> 1065837 T2891 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/'
> :    [junit4]   2> 1065878 T2891 oasc.CoreContainer.<init> New
> CoreContainer 830398897
> :    [junit4]   2> 1065878 T2891 oasc.CoreContainer.load Loading cores
> into CoreContainer
> [instanceDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/]
> :    [junit4]   2> 1065879 T2891
> oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
> :    [junit4]   2> 1065879 T2891
> oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
> :    [junit4]   2> 1065879 T2891
> oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
> :    [junit4]   2> 1065879 T2891
> oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost
> to: 20
> :    [junit4]   2> 1065880 T2891
> oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> :    [junit4]   2> 1065880 T2891
> oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to:
> 2147483647
> :    [junit4]   2> 1065880 T2891
> oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> :    [junit4]   2> 1065880 T2891
> oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> :    [junit4]   2> 1065880 T2891
> oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> :    [junit4]   2> 1065883 T2891 oasu.UpdateShardHandler.<init> Creating
> UpdateShardHandler HTTP client with params:
> socketTimeout=30000&connTimeout=30000&retry=false
> :    [junit4]   2> 1065884 T2891 oasl.LogWatcher.createWatcher SLF4J impl
> is org.slf4j.impl.Log4jLoggerFactory
> :    [junit4]   2> 1065884 T2891 oasl.LogWatcher.newRegisteredLogWatcher
> Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
> :    [junit4]   2> 1065884 T2891 oasc.CoreContainer.load Host Name:
> :    [junit4]   2> 1065888 T2892 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/'
> :    [junit4]   2> 1065890 T2892
> oasc.SolrResourceLoader.replaceClassLoader Adding
> 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/.svn/'
> to classloader
> :    [junit4]   2> 1065890 T2892
> oasc.SolrResourceLoader.replaceClassLoader Adding
> 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/README'
> to classloader
> :    [junit4]   2> 1065890 T2892
> oasc.SolrResourceLoader.replaceClassLoader Adding
> 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/classes/'
> to classloader
> :    [junit4]   2> 1065950 T2892 oasc.SolrConfig.<init> Using Lucene
> MatchVersion: LUCENE_4_10
> :    [junit4]   2> 1066019 T2892 oasc.SolrConfig.<init> Loaded SolrConfig:
> solrconfig.xml
> :    [junit4]   2> 1066020 T2892 oass.IndexSchema.readSchema Reading Solr
> Schema from schema15.xml
> :    [junit4]   2> 1066031 T2892 oass.IndexSchema.readSchema [collection1]
> Schema name=test
> :    [junit4]   2> 1066425 T2892 oass.IndexSchema.readSchema default
> search field in schema is text
> :    [junit4]   2> 1066428 T2892 oass.IndexSchema.readSchema unique key
> field: id
> :    [junit4]   2> 1066430 T2892 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
> :    [junit4]   2> 1066435 T2892 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
> :    [junit4]   2> 1066450 T2892 oasc.CoreContainer.create Creating
> SolrCore 'collection1' using configuration from instancedir
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/
> :    [junit4]   2> 1066450 T2892 oasc.SolrCore.initDirectoryFactory
> org.apache.solr.core.MockDirectoryFactory
> :    [junit4]   2> 1066451 T2892 oasc.SolrCore.<init> [collection1]
> Opening new SolrCore at
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/,
> dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.search.QueryEqualityTest-894023E3DFD774C6-001/init-core-data-001/
> :    [junit4]   2> 1066451 T2892 oasc.JmxMonitoredMap.<init> JMX
> monitoring is enabled. Adding Solr mbeans to JMX Server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@7bde656e
> :    [junit4]   2> 1066452 T2892 oasc.CachingDirectoryFactory.get return
> new directory for
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.search.QueryEqualityTest-894023E3DFD774C6-001/init-core-data-001
> :    [junit4]   2> 1066452 T2892 oasc.SolrCore.getNewIndexDir New index
> directory detected: old=null
> new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.search.QueryEqualityTest-894023E3DFD774C6-001/init-core-data-001/index/
> :    [junit4]   2> 1066452 T2892 oasc.SolrCore.initIndex WARN
> [collection1] Solr index directory
> '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.search.QueryEqualityTest-894023E3DFD774C6-001/init-core-data-001/index'
> doesn't exist. Creating new index...
> :    [junit4]   2> 1066453 T2892 oasc.CachingDirectoryFactory.get return
> new directory for
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.search.QueryEqualityTest-894023E3DFD774C6-001/init-core-data-001/index
> :    [junit4]   2> 1066454 T2892 oasu.RandomMergePolicy.<init>
> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy:
> [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=24,
> maxMergedSegmentMB=12.4951171875, floorSegmentMB=2.103515625,
> forceMergeDeletesPctAllowed=8.686604790539262, segmentsPerTier=14.0,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.17091186665069513
> :    [junit4]   2> 1066455 T2892 oasc.SolrDeletionPolicy.onCommit
> SolrDeletionPolicy.onCommit: commits: num=1
> :    [junit4]   2>
>  commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@35a71706
> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1beedab1
> )),segFN=segments_1,generation=1}
> :    [junit4]   2> 1066455 T2892 oasc.SolrDeletionPolicy.updateCommits
> newest commit generation = 1
> :    [junit4]   2> 1066455 T2892 oasc.SolrCore.initWriters created xml:
> solr.XMLResponseWriter
> :    [junit4]   2> 1066459 T2892 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "dedupe"
> :    [junit4]   2> 1066460 T2892 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "dedupe"
> :    [junit4]   2> 1066460 T2892 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "dedupe-allfields"
> :    [junit4]   2> 1066460 T2892 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "dedupe-allfields"
> :    [junit4]   2> 1066461 T2892 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "stored_sig"
> :    [junit4]   2> 1066461 T2892 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "stored_sig"
> :    [junit4]   2> 1066461 T2892 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "uniq-fields"
> :    [junit4]   2> 1066461 T2892
> oasup.UniqFieldsUpdateProcessorFactory.init WARN Use of the 'fields' init
> param in UniqFieldsUpdateProcessorFactory is deprecated, please use
> 'fieldName' (or another FieldMutatingUpdateProcessorFactory selector
> option) instead
> :    [junit4]   2> 1066462 T2892
> oasup.UniqFieldsUpdateProcessorFactory.init Replacing 'fields' init param
> with (individual) 'fieldName' params
> :    [junit4]   2> 1066462 T2892 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "uniq-fields"
> :    [junit4]   2> 1066462 T2892 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
> :    [junit4]   2> 1066463 T2892 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> :    [junit4]   2> 1066463 T2892 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> :    [junit4]   2> 1066463 T2892 oasc.SolrCore.loadUpdateProcessorChains
> no updateRequestProcessorChain defined as default, creating implicit default
> :    [junit4]   2> 1066464 T2892
> oasc.RequestHandlers.initHandlersFromConfig created /update:
> org.apache.solr.handler.UpdateRequestHandler
> :    [junit4]   2> 1066464 T2892
> oasc.RequestHandlers.initHandlersFromConfig created /update/json:
> org.apache.solr.handler.UpdateRequestHandler
> :    [junit4]   2> 1066465 T2892
> oasc.RequestHandlers.initHandlersFromConfig created /update/csv:
> org.apache.solr.handler.UpdateRequestHandler
> :    [junit4]   2> 1066465 T2892
> oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs:
> org.apache.solr.handler.UpdateRequestHandler
> :    [junit4]   2> 1066465 T2892
> oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler:
> solr.ReplicationHandler
> :    [junit4]   2> 1066466 T2892
> oasc.RequestHandlers.initHandlersFromConfig created /replication:
> solr.ReplicationHandler
> :    [junit4]   2> 1066466 T2892
> oasc.RequestHandlers.initHandlersFromConfig created standard:
> solr.StandardRequestHandler
> :    [junit4]   2> 1066467 T2892
> oasc.RequestHandlers.initHandlersFromConfig created /get:
> solr.RealTimeGetHandler
> :    [junit4]   2> 1066467 T2892
> oasc.RequestHandlers.initHandlersFromConfig created dismax:
> solr.SearchHandler
> :    [junit4]   2> 1066468 T2892
> oasc.RequestHandlers.initHandlersFromConfig created mock:
> org.apache.solr.core.MockQuerySenderListenerReqHandler
> :    [junit4]   2> 1066468 T2892
> oasc.RequestHandlers.initHandlersFromConfig created /admin/:
> org.apache.solr.handler.admin.AdminHandlers
> :    [junit4]   2> 1066469 T2892
> oasc.RequestHandlers.initHandlersFromConfig created /admin/file:
> solr.admin.ShowFileRequestHandler
> :    [junit4]   2> 1066469 T2892
> oasc.RequestHandlers.initHandlersFromConfig created defaults:
> solr.StandardRequestHandler
> :    [junit4]   2> 1066469 T2892
> oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler:
> solr.StandardRequestHandler
> :    [junit4]   2> 1066470 T2892
> oasc.RequestHandlers.initHandlersFromConfig created lazy:
> solr.StandardRequestHandler
> :    [junit4]   2> 1066470 T2892
> oasc.RequestHandlers.initHandlersFromConfig WARN Multiple requestHandler
> registered to the same name: /update ignoring:
> org.apache.solr.handler.UpdateRequestHandler
> :    [junit4]   2> 1066470 T2892
> oasc.RequestHandlers.initHandlersFromConfig created /update:
> solr.UpdateRequestHandler
> :    [junit4]   2> 1066471 T2892
> oasc.RequestHandlers.initHandlersFromConfig created /terms:
> org.apache.solr.handler.component.SearchHandler
> :    [junit4]   2> 1066471 T2892
> oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH:
> org.apache.solr.handler.component.SearchHandler
> :    [junit4]   2> 1066472 T2892
> oasc.RequestHandlers.initHandlersFromConfig created
> spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
> :    [junit4]   2> 1066472 T2892
> oasc.RequestHandlers.initHandlersFromConfig created
> spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
> :    [junit4]   2> 1066473 T2892
> oasc.RequestHandlers.initHandlersFromConfig created
> spellCheckWithWordbreak_Direct:
> org.apache.solr.handler.component.SearchHandler
> :    [junit4]   2> 1066473 T2892
> oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1:
> org.apache.solr.handler.component.SearchHandler
> :    [junit4]   2> 1066474 T2892
> oasc.RequestHandlers.initHandlersFromConfig created mltrh:
> org.apache.solr.handler.component.SearchHandler
> :    [junit4]   2> 1066474 T2892
> oasc.RequestHandlers.initHandlersFromConfig created tvrh:
> org.apache.solr.handler.component.SearchHandler
> :    [junit4]   2> 1066475 T2892
> oasc.RequestHandlers.initHandlersFromConfig created /mlt:
> solr.MoreLikeThisHandler
> :    [junit4]   2> 1066475 T2892
> oasc.RequestHandlers.initHandlersFromConfig created /debug/dump:
> solr.DumpRequestHandler
> :    [junit4]   2> 1066494 T2892 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
> :    [junit4]   2> 1066496 T2892 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
> :    [junit4]   2> 1066498 T2892 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
> :    [junit4]   2> 1066500 T2892 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
> :    [junit4]   2> 1066502 T2892 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
> :    [junit4]   2> 1066504 T2892 oasc.SolrCore.initDeprecatedSupport WARN
> solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your
> config to use the ShowFileRequestHandler.
> :    [junit4]   2> 1066506 T2892 oasu.CommitTracker.<init> Hard
> AutoCommit: disabled
> :    [junit4]   2> 1066507 T2892 oasu.CommitTracker.<init> Soft
> AutoCommit: disabled
> :    [junit4]   2> 1066507 T2892 oasu.RandomMergePolicy.<init>
> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy:
> [TieredMergePolicy: maxMergeAtOnce=49, maxMergeAtOnceExplicit=36,
> maxMergedSegmentMB=38.9736328125, floorSegmentMB=1.5791015625,
> forceMergeDeletesPctAllowed=25.466902262123792, segmentsPerTier=35.0,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
> :    [junit4]   2> 1066508 T2892 oasc.SolrDeletionPolicy.onInit
> SolrDeletionPolicy.onInit: commits: num=1
> :    [junit4]   2>
>  commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@35a71706
> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1beedab1
> )),segFN=segments_1,generation=1}
> :    [junit4]   2> 1066508 T2892 oasc.SolrDeletionPolicy.updateCommits
> newest commit generation = 1
> :    [junit4]   2> 1066509 T2892 oass.SolrIndexSearcher.<init> Opening
> Searcher@32ea2a58[collection1] main
> :    [junit4]   2> 1066509 T2892 oasr.RestManager.init Initializing
> RestManager with initArgs:
> {storageIO=org.apache.solr.rest.ManagedResourceStorage$InMemoryStorageIO}
> :    [junit4]   2> 1066509 T2892 oasr.ManagedResourceStorage.load Reading
> _rest_managed.json using InMemoryStorage
> :    [junit4]   2> 1066510 T2892 oasr.ManagedResource.reloadFromStorage
> WARN No stored data found for /rest/managed
> :    [junit4]   2> 1066510 T2892
> oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path
> _rest_managed.json using InMemoryStorage
> :    [junit4]   2> 1066510 T2892 oasr.RestManager.init Initializing 0
> registered ManagedResources
> :    [junit4]   2> 1066510 T2892 oashc.SpellCheckComponent.inform
> Initializing spell checkers
> :    [junit4]   2> 1066531 T2892 oass.DirectSolrSpellChecker.init init:
> {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
> :    [junit4]   2> 1066579 T2893 oasc.SolrCore.registerSearcher
> [collection1] Registered new searcher Searcher@32ea2a58[collection1]
> main{StandardDirectoryReader(segments_1:1:nrt)}
> :    [junit4]   2> 1066582 T2892 oasc.CoreContainer.registerCore
> registering core: collection1
> :    [junit4]   2> 1066585 T2891 oas.SolrTestCaseJ4.initCore ####initCore
> end
> :    [junit4]   2> 1066589 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncGeodist
> :    [junit4]   2> 1066626 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncGeodist
> :    [junit4]   2> 1066632 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testQueryLucene
> :    [junit4]   2> 1066635 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testQueryLucene
> :    [junit4]   2> 1066640 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncOrd
> :    [junit4]   2> 1066640 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncOrd
> :    [junit4]   2> 1066645 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncMod
> :    [junit4]   2> 1066646 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncMod
> :    [junit4]   2> 1066651 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncCscore
> :    [junit4]   2> 1066658 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncCscore
> :    [junit4]   2> 1066663 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncDist
> :    [junit4]   2> 1066664 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncDist
> :    [junit4]   2> 1066668 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncExists
> :    [junit4]   2> 1066679 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncExists
> :    [junit4]   2> 1066684 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncMap
> :    [junit4]   2> 1066693 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncMap
> :    [junit4]   2> 1066698 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncRord
> :    [junit4]   2> 1066699 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncRord
> :    [junit4]   2> 1066704 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testField
> :    [junit4]   2> 1066704 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testField
> :    [junit4]   2> 1066709 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testQueryComplexPhrase
> :    [junit4]   2> 1066860 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testQueryComplexPhrase
> :    [junit4]   2> 1066865 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testQuerySimple
> :    [junit4]   2> 1066887 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testQuerySimple
> :    [junit4]   2> 1066892 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncGeohash
> :    [junit4]   2> 1066893 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncGeohash
> :    [junit4]   2> 1066898 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testQueryDismax
> :    [junit4]   2> 1066906 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testQueryDismax
> :    [junit4]   2> 1066911 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testQueryGeofilt
> :    [junit4]   2> 1066915 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testQueryGeofilt
> :    [junit4]   2> 1066921 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testQueryPrefix
> :    [junit4]   2> 1066921 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testQueryPrefix
> :    [junit4]   2> 1066936 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testTestFuncs
> :    [junit4]   2> 1066941 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testTestFuncs
> :    [junit4]   2> 1066946 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncSqedist
> :    [junit4]   2> 1066947 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncSqedist
> :    [junit4]   2> 1066952 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncSum
> :    [junit4]   2> 1066954 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncSum
> :    [junit4]   2> 1066959 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncIf
> :    [junit4]   2> 1066966 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncIf
> :    [junit4]   2> 1066971 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testQueryBoost
> :    [junit4]   2> 1066980 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testQueryBoost
> :    [junit4]   2> 1066985 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncDef
> :    [junit4]   2> 1067003 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncDef
> :    [junit4]   2> 1067008 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncNumdocs
> :    [junit4]   2> 1067017 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncNumdocs
> :    [junit4]   2> 1067022 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testDateMathParsingEquality
> :    [junit4]   2> 1067025 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testDateMathParsingEquality
> :    [junit4]   2> 1067029 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncMin
> :    [junit4]   2> 1067031 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncMin
> :    [junit4]   2> 1067036 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testQueryTerm
> :    [junit4]   2> 1067036 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testQueryTerm
> :    [junit4]   2> 1067041 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncDiv
> :    [junit4]   2> 1067042 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncDiv
> :    [junit4]   2> 1067047 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncBoost
> :    [junit4]   2> 1067048 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncBoost
> :    [junit4]   2> 1067053 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncMs
> :    [junit4]   2> 1067070 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncMs
> :    [junit4]   2> 1067075 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncNorm
> :    [junit4]   2> 1067097 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncNorm
> :    [junit4]   2> 1067103 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncLiteral
> :    [junit4]   2> 1067103 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncLiteral
> :    [junit4]   2> 1067108 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncLinear
> :    [junit4]   2> 1067117 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncLinear
> :    [junit4]   2> 1067122 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncTestfunc
> :    [junit4]   2> 1067123 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncTestfunc
> :    [junit4]   2> 1067128 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testQueryNested
> :    [junit4]   2> 1067129 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testQueryNested
> :    [junit4]   2> 1067135 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncMaxdoc
> :    [junit4]   2> 1067135 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncMaxdoc
> :    [junit4]   2> 1067140 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testBlockJoin
> :    [junit4]   2> 1067164 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testBlockJoin
> :    [junit4]   2> 1067169 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testQueryFrange
> :    [junit4]   2> 1067170 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testQueryFrange
> :    [junit4]   2> 1067175 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncNot
> :    [junit4]   2> 1067177 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncNot
> :    [junit4]   2> 1067181 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncDoubleValueBools
> :    [junit4]   2> 1067193 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncDoubleValueBools
> :    [junit4]   2> 1067198 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncRecip
> :    [junit4]   2> 1067199 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncRecip
> :    [junit4]   2> 1067203 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testQueryRaw
> :    [junit4]   2> 1067204 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testQueryRaw
> :    [junit4]   2> 1067209 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testQueryJoin
> :    [junit4]   2> 1067222 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testQueryJoin
> :    [junit4]   2> 1067226 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testQueryLucenePlusSort
> :    [junit4]   2> 1067229 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testQueryLucenePlusSort
> :    [junit4]   2> 1067234 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncTop
> :    [junit4]   2> 1067235 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncTop
> :    [junit4]   2> 1067239 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncSingleValueMathFuncs
> :    [junit4]   2> 1067249 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncSingleValueMathFuncs
> :    [junit4]   2> 1067254 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testParserCoverage
> :    [junit4]   2> 1067254 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testParserCoverage
> :    [junit4]   2> 1067259 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncVector
> :    [junit4]   2> 1067261 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncVector
> :    [junit4]   2> 1067265 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncGhhsin
> :    [junit4]   2> 1067266 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncGhhsin
> :    [junit4]   2> 1067271 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testQueryBbox
> :    [junit4]   2> 1067275 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testQueryBbox
> :    [junit4]   2> 1067279 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncHsin
> :    [junit4]   2> 1067280 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncHsin
> :    [junit4]   2> 1067285 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncTerms
> :    [junit4]   2> 1067316 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncTerms
> :    [junit4]   2> 1067321 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testReRankQuery
> :    [junit4]   2> 1067341 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testReRankQuery
> :    [junit4]   2> 1067345 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testQueryMaxScore
> :    [junit4]   2> 1067350 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testQueryMaxScore
> :    [junit4]   2> 1067355 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testQueryCollapse
> :    [junit4]   2> 1067373 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testQueryCollapse
> :    [junit4]   2> 1067378 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncCurrency
> :    [junit4]   2> 1067385 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncCurrency
> :    [junit4]   2> 1067389 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncSub
> :    [junit4]   2> 1067391 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncSub
> :    [junit4]   2> 1067395 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncDoubleValueMathFuncs
> :    [junit4]   2> 1067403 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncDoubleValueMathFuncs
> :    [junit4]   2> 1067408 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncProduct
> :    [junit4]   2> 1067409 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncProduct
> :    [junit4]   2> 1067414 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testQuerySurround
> :    [junit4]   2> 1067669 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testQuerySurround
> :    [junit4]   2> 1067674 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncField
> :    [junit4]   2> 1067675 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncField
> :    [junit4]   2> 1067680 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncJoindf
> :    [junit4]   2> 1067680 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncJoindf
> :    [junit4]   2> 1067685 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncMax
> :    [junit4]   2> 1067686 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncMax
> :    [junit4]   2> 1067691 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncQuery
> :    [junit4]   2> 1067692 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncQuery
> :    [junit4]   2> 1067697 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncScale
> :    [junit4]   2> 1067706 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncScale
> :    [junit4]   2> 1067711 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncMathConsts
> :    [junit4]   2> 1067712 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncMathConsts
> :    [junit4]   2> 1067716 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncBools
> :    [junit4]   2> 1067717 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncBools
> :    [junit4]   2> 1067722 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncStrdist
> :    [junit4]   2> 1067738 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncStrdist
> :    [junit4]   2> 1067743 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testQuerySwitch
> :    [junit4]   2> 1067746 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testQuerySwitch
> :    [junit4]   2> 1067751 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testQueryFunc
> :    [junit4]   2> 1067753 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testQueryFunc
> :    [junit4]   2> 1067757 T2891 oas.SolrTestCaseJ4.setUp ###Starting
> testFuncSttf
> :    [junit4]   2> 1067758 T2891 oas.SolrTestCaseJ4.tearDown ###Ending
> testFuncSttf
> :    [junit4]   2> 1067760 T2891 oas.SolrTestCaseJ4.deleteCore
> ###deleteCore
> :    [junit4]   2> 1067760 T2891 oasc.CoreContainer.shutdown Shutting down
> CoreContainer instance=830398897
> :    [junit4]   2> 1067761 T2891 oasc.SolrCore.close [collection1]
>  CLOSING SolrCore org.apache.solr.core.SolrCore@1b4d383e
> :    [junit4]   2> 1067775 T2891 oasu.DirectUpdateHandler2.close closing
> DirectUpdateHandler2{commits=0,autocommits=0,soft
> autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
> :    [junit4]   2> 1067775 T2891 oasu.SolrCoreState.decrefSolrCoreState
> Closing SolrCoreState
> :    [junit4]   2> 1067775 T2891
> oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has
> reached 0 - closing IndexWriter
> :    [junit4]   2> 1067775 T2891
> oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with
> IndexWriterCloser
> :    [junit4]   2> 1067777 T2891 oasc.SolrCore.closeSearcher [collection1]
> Closing main searcher on request.
> :    [junit4]   2> 1067777 T2891 oasc.CachingDirectoryFactory.close
> Closing MockDirectoryFactory - 2 directories currently being tracked
> :    [junit4]   2> 1067777 T2891
> oasc.CachingDirectoryFactory.closeCacheValue looking to close
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.search.QueryEqualityTest-894023E3DFD774C6-001/init-core-data-001
> [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.search.QueryEqualityTest-894023E3DFD774C6-001/init-core-data-001;done=false>>]
> :    [junit4]   2> 1067778 T2891 oasc.CachingDirectoryFactory.close
> Closing directory:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.search.QueryEqualityTest-894023E3DFD774C6-001/init-core-data-001
> :    [junit4]   2> 1067778 T2891
> oasc.CachingDirectoryFactory.closeCacheValue looking to close
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.search.QueryEqualityTest-894023E3DFD774C6-001/init-core-data-001/index
> [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.search.QueryEqualityTest-894023E3DFD774C6-001/init-core-data-001/index;done=false>>]
> :    [junit4]   2> 1067778 T2891 oasc.CachingDirectoryFactory.close
> Closing directory:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.search.QueryEqualityTest-894023E3DFD774C6-001/init-core-data-001/index
> :    [junit4]   2> NOTE: test params are: codec=Lucene49: {},
> docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {},
> locale=en_PH, timezone=America/Port-au-Prince
> :    [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation
> 1.7.0_60 (64-bit)/cpus=16,threads=1,free=392664904,total=459276288
> :    [junit4]   2> NOTE: All tests run in this JVM:
> [DirectUpdateHandlerTest, CoreAdminCreateDiscoverTest,
> TestQuerySenderListener, MinimalSchemaTest, TestSolrDeletionPolicy1,
> CollectionsAPIDistributedZkTest, TestLuceneMatchVersion,
> TestQuerySenderNoQuery, TestManagedStopFilterFactory,
> TestDynamicFieldCollectionResource, TestSearchPerf, SortByFunctionTest,
> TestStressRecovery, TestCustomSort, SuggesterFSTTest, TestFaceting,
> TestStressLucene, TestChildDocTransformer, DirectSolrConnectionTest,
> EnumFieldTest, SolrIndexSplitterTest, IndexBasedSpellCheckerTest,
> TestDocSet, DocValuesMultiTest, CustomCollectionTest,
> LegacyHTMLStripCharFilterTest, TestSchemaVersionResource,
> ConnectionManagerTest, TestMergePolicyConfig, TestPseudoReturnFields,
> TestFieldSortValues, OverseerRolesTest, DateFieldTest,
> TermVectorComponentDistributedTest, TestIBSimilarityFactory,
> TestSolrXmlPersistence, FieldAnalysisRequestHandlerTest,
> DistribCursorPagingTest, SimpleFacetsTest, DistanceFunctionTest,
> TestSolrXMLSeria
>  lizer, TestExtendedDismaxParser, HdfsBasicDistributedZk2Test,
> DocumentBuilderTest, FileUtilsTest, UpdateParamsTest,
> DocumentAnalysisRequestHandlerTest, UnloadDistributedZkTest,
> CircularListTest, ZkNodePropsTest, ScriptEngineTest, BasicZkTest,
> DistributedQueryComponentOptimizationTest, TestCSVResponseWriter,
> ParsingFieldUpdateProcessorsTest, HdfsRecoveryZkTest, OverseerStatusTest,
> StatsComponentTest, TestWriterPerf, ClusterStateUpdateTest,
> TestUniqueKeyFieldResource, TestNumberUtils, QueryEqualityTest]
> :    [junit4]   2> NOTE: reproduce with: ant test
>  -Dtestcase=QueryEqualityTest -Dtests.seed=894023E3DFD774C6
> -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_PH
> -Dtests.timezone=America/Port-au-Prince -Dtests.file.encoding=ISO-8859-1
> :    [junit4] ERROR   0.00s J0 | QueryEqualityTest (suite) <<<
> :    [junit4]    > Throwable #1: java.lang.AssertionError:
> testParserCoverage was run w/o any other method explicitly testing qparser:
> terms
> :    [junit4]    >      at
> __randomizedtesting.SeedInfo.seed([894023E3DFD774C6]:0)
> :    [junit4]    >      at
> org.apache.solr.search.QueryEqualityTest.afterClassParserCoverageTest(QueryEqualityTest.java:62)
> :    [junit4]    >      at java.lang.Thread.run(Thread.java:745)
> :    [junit4] Completed on J0 in 2.65s, 70 tests, 1 failure <<< FAILURES!
> :
> : [...truncated 383 lines...]
> :    [junit4] Suite: org.apache.solr.cloud.MultiThreadedOCPTest
> :    [junit4]   2> Creating dataDir:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/init-core-data-001
> :    [junit4]   2> 3591190 T5910 oas.SolrTestCaseJ4.buildSSLConfig
> Randomized ssl (false) and clientAuth (false)
> :    [junit4]   2> 3591191 T5910
> oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext
> system property: /
> :    [junit4]   2> 3591195 T5910 oas.SolrTestCaseJ4.setUp ###Starting
> testDistribSearch
> :    [junit4]   2> 3591196 T5910 oasc.ZkTestServer.run STARTING ZK TEST
> SERVER
> :    [junit4]   1> client port:0.0.0.0/0.0.0.0:0
> :    [junit4]   2> 3591197 T5911
> oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
> :    [junit4]   2> 3591297 T5910 oasc.ZkTestServer.run start zk server on
> port:53984
> :    [junit4]   2> 3591298 T5910 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
> :    [junit4]   2> 3591301 T5917 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@4230cb67
> name:ZooKeeperConnection Watcher:127.0.0.1:53984 got event WatchedEvent
> state:SyncConnected type:None path:null path:null type:None
> :    [junit4]   2> 3591301 T5910 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
> :    [junit4]   2> 3591301 T5910 oascc.SolrZkClient.makePath makePath:
> /solr
> :    [junit4]   2> 3591305 T5910 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
> :    [junit4]   2> 3591305 T5919 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@719a6a80
> name:ZooKeeperConnection Watcher:127.0.0.1:53984/solr got event
> WatchedEvent state:SyncConnected type:None path:null path:null type:None
> :    [junit4]   2> 3591306 T5910 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
> :    [junit4]   2> 3591306 T5910 oascc.SolrZkClient.makePath makePath:
> /collections/collection1
> :    [junit4]   2> 3591308 T5910 oascc.SolrZkClient.makePath makePath:
> /collections/collection1/shards
> :    [junit4]   2> 3591309 T5910 oascc.SolrZkClient.makePath makePath:
> /collections/control_collection
> :    [junit4]   2> 3591311 T5910 oascc.SolrZkClient.makePath makePath:
> /collections/control_collection/shards
> :    [junit4]   2> 3591313 T5910 oasc.AbstractZkTestCase.putConfig put
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
> to /configs/conf1/solrconfig.xml
> :    [junit4]   2> 3591313 T5910 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/solrconfig.xml
> :    [junit4]   2> 3591316 T5910 oasc.AbstractZkTestCase.putConfig put
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/schema.xml
> to /configs/conf1/schema.xml
> :    [junit4]   2> 3591317 T5910 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/schema.xml
> :    [junit4]   2> 3591419 T5910 oasc.AbstractZkTestCase.putConfig put
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
> to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
> :    [junit4]   2> 3591419 T5910 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/solrconfig.snippet.randomindexconfig.xml
> :    [junit4]   2> 3591421 T5910 oasc.AbstractZkTestCase.putConfig put
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
> to /configs/conf1/stopwords.txt
> :    [junit4]   2> 3591422 T5910 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/stopwords.txt
> :    [junit4]   2> 3591424 T5910 oasc.AbstractZkTestCase.putConfig put
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/protwords.txt
> to /configs/conf1/protwords.txt
> :    [junit4]   2> 3591424 T5910 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/protwords.txt
> :    [junit4]   2> 3591426 T5910 oasc.AbstractZkTestCase.putConfig put
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/currency.xml
> to /configs/conf1/currency.xml
> :    [junit4]   2> 3591427 T5910 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/currency.xml
> :    [junit4]   2> 3591429 T5910 oasc.AbstractZkTestCase.putConfig put
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
> to /configs/conf1/enumsConfig.xml
> :    [junit4]   2> 3591429 T5910 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/enumsConfig.xml
> :    [junit4]   2> 3591431 T5910 oasc.AbstractZkTestCase.putConfig put
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
> to /configs/conf1/open-exchange-rates.json
> :    [junit4]   2> 3591432 T5910 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/open-exchange-rates.json
> :    [junit4]   2> 3591434 T5910 oasc.AbstractZkTestCase.putConfig put
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
> to /configs/conf1/mapping-ISOLatin1Accent.txt
> :    [junit4]   2> 3591434 T5910 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/mapping-ISOLatin1Accent.txt
> :    [junit4]   2> 3591436 T5910 oasc.AbstractZkTestCase.putConfig put
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
> to /configs/conf1/old_synonyms.txt
> :    [junit4]   2> 3591437 T5910 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/old_synonyms.txt
> :    [junit4]   2> 3591438 T5910 oasc.AbstractZkTestCase.putConfig put
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
> to /configs/conf1/synonyms.txt
> :    [junit4]   2> 3591439 T5910 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/synonyms.txt
> :    [junit4]   2> 3592574 T5910 oejs.Server.doStart jetty-8.1.10.v20130312
> :    [junit4]   2> 3592578 T5910 oejs.AbstractConnector.doStart Started
> SocketConnector@127.0.0.1:44580
> :    [junit4]   2> 3592579 T5910 oass.SolrDispatchFilter.init
> SolrDispatchFilter.init()
> :    [junit4]   2> 3592579 T5910 oasc.SolrResourceLoader.locateSolrHome
> JNDI not configured for solr (NoInitialContextEx)
> :    [junit4]   2> 3592579 T5910 oasc.SolrResourceLoader.locateSolrHome
> using system property solr.solr.home:
> ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-002
> :    [junit4]   2> 3592579 T5910 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> './solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-002/'
> :    [junit4]   2> 3592609 T5910 oasc.ConfigSolr.fromFile Loading
> container configuration from
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-002/solr.xml
> :    [junit4]   2> 3592662 T5910 oasc.CoreContainer.<init> New
> CoreContainer 1199701395
> :    [junit4]   2> 3592662 T5910 oasc.CoreContainer.load Loading cores
> into CoreContainer
> [instanceDir=./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-002/]
> :    [junit4]   2> 3592663 T5910
> oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
> :    [junit4]   2> 3592664 T5910
> oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
> :    [junit4]   2> 3592664 T5910
> oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
> :    [junit4]   2> 3592664 T5910
> oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost
> to: 20
> :    [junit4]   2> 3592664 T5910
> oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> :    [junit4]   2> 3592665 T5910
> oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to:
> 2147483647
> :    [junit4]   2> 3592665 T5910
> oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> :    [junit4]   2> 3592665 T5910
> oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> :    [junit4]   2> 3592665 T5910
> oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> :    [junit4]   2> 3592666 T5910 oasu.UpdateShardHandler.<init> Creating
> UpdateShardHandler HTTP client with params:
> socketTimeout=340000&connTimeout=45000&retry=false
> :    [junit4]   2> 3592666 T5910 oasl.LogWatcher.createWatcher SLF4J impl
> is org.slf4j.impl.Log4jLoggerFactory
> :    [junit4]   2> 3592666 T5910 oasl.LogWatcher.newRegisteredLogWatcher
> Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
> :    [junit4]   2> 3592667 T5910 oasc.CoreContainer.load Host Name:
> 127.0.0.1
> :    [junit4]   2> 3592667 T5910 oasc.ZkContainer.initZooKeeper Zookeeper
> client=127.0.0.1:53984/solr
> :    [junit4]   2> 3592667 T5910 oasc.ZkController.checkChrootPath zkHost
> includes chroot
> :    [junit4]   2> 3592668 T5910 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
> :    [junit4]   2> 3592669 T5930 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@272ee292
> name:ZooKeeperConnection Watcher:127.0.0.1:53984 got event WatchedEvent
> state:SyncConnected type:None path:null path:null type:None
> :    [junit4]   2> 3592670 T5910 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
> :    [junit4]   2> 3592672 T5910 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
> :    [junit4]   2> 3592672 T5932 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@14120bea
> name:ZooKeeperConnection Watcher:127.0.0.1:53984/solr got event
> WatchedEvent state:SyncConnected type:None path:null path:null type:None
> :    [junit4]   2> 3592673 T5910 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
> :    [junit4]   2> 3592674 T5910 oascc.SolrZkClient.makePath makePath:
> /overseer/queue
> :    [junit4]   2> 3592676 T5910 oascc.SolrZkClient.makePath makePath:
> /overseer/collection-queue-work
> :    [junit4]   2> 3592678 T5910 oascc.SolrZkClient.makePath makePath:
> /overseer/collection-map-running
> :    [junit4]   2> 3592680 T5910 oascc.SolrZkClient.makePath makePath:
> /overseer/collection-map-completed
> :    [junit4]   2> 3592681 T5910 oascc.SolrZkClient.makePath makePath:
> /overseer/collection-map-failure
> :    [junit4]   2> 3592683 T5910 oascc.SolrZkClient.makePath makePath:
> /live_nodes
> :    [junit4]   2> 3592684 T5910 oasc.ZkController.createEphemeralLiveNode
> Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44580_
> :    [junit4]   2> 3592685 T5910 oascc.SolrZkClient.makePath makePath:
> /live_nodes/127.0.0.1:44580_
> :    [junit4]   2> 3592687 T5910 oascc.SolrZkClient.makePath makePath:
> /overseer_elect
> :    [junit4]   2> 3592688 T5910 oascc.SolrZkClient.makePath makePath:
> /overseer_elect/election
> :    [junit4]   2> 3592690 T5910
> oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader
> 127.0.0.1:44580_
> :    [junit4]   2> 3592691 T5910 oascc.SolrZkClient.makePath makePath:
> /overseer_elect/leader
> :    [junit4]   2> 3592692 T5910 oasc.Overseer.start Overseer
> (id=92238083035824131-127.0.0.1:44580_-n_0000000000) starting
> :    [junit4]   2> 3592694 T5910 oascc.SolrZkClient.makePath makePath:
> /overseer/queue-work
> :    [junit4]   2> 3592699 T5934 oasc.OverseerCollectionProcessor.run
> Process current queue of collection creations
> :    [junit4]   2> 3592700 T5910 oascc.SolrZkClient.makePath makePath:
> /clusterstate.json
> :    [junit4]   2> 3592701 T5910 oascc.SolrZkClient.makePath makePath:
> /aliases.json
> :    [junit4]   2> 3592703 T5910
> oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster
> state from ZooKeeper...
> :    [junit4]   2> 3592704 T5933 oasc.Overseer$ClusterStateUpdater.run
> Starting to work on the main queue
> :    [junit4]   2> 3592709 T5935 oasc.ZkController.publish publishing
> core=collection1 state=down collection=control_collection
> :    [junit4]   2> 3592709 T5935 oasc.ZkController.publish numShards not
> found on descriptor - reading it from system property
> :    [junit4]   2> 3592710 T5935 oasc.ZkController.waitForCoreNodeName
> look for our core node name
> :    [junit4]   2> 3592710 T5936
> oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on
> path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> :    [junit4]   2> 3592711 T5933 oascc.ZkStateReader.updateClusterState
> Updating cloud state from ZooKeeper...
> :    [junit4]   2> 3592712 T5933
> oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1
> message={
> :    [junit4]   2>        "operation":"state",
> :    [junit4]   2>        "state":"down",
> :    [junit4]   2>        "base_url":"http://127.0.0.1:44580",
> :    [junit4]   2>        "core":"collection1",
> :    [junit4]   2>        "roles":null,
> :    [junit4]   2>        "node_name":"127.0.0.1:44580_",
> :    [junit4]   2>        "shard":null,
> :    [junit4]   2>        "collection":"control_collection",
> :    [junit4]   2>        "numShards":"1",
> :    [junit4]   2>        "core_node_name":null}
> :    [junit4]   2> 3592712 T5933
> oasc.Overseer$ClusterStateUpdater.createCollection Create collection
> control_collection with shards [shard1]
> :    [junit4]   2> 3592712 T5933
> oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard
> shard=shard1
> :    [junit4]   2> 3592714 T5936
> oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on
> path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> :    [junit4]   2> 3592714 T5936 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> :    [junit4]   2> 3593710 T5935 oasc.ZkController.waitForShardId waiting
> to find shard id in clusterstate for collection1
> :    [junit4]   2> 3593711 T5935 oasc.ZkController.createCollectionZkNode
> Check for collection zkNode:control_collection
> :    [junit4]   2> 3593712 T5935 oasc.ZkController.createCollectionZkNode
> Collection zkNode exists
> :    [junit4]   2> 3593712 T5935 oascc.ZkStateReader.readConfigName Load
> collection config from:/collections/control_collection
> :    [junit4]   2> 3593713 T5935 oascc.ZkStateReader.readConfigName
> path=/collections/control_collection configName=conf1 specified config
> exists in ZooKeeper
> :    [junit4]   2> 3593713 T5935 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> './solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-002/collection1/'
> :    [junit4]   2> 3593714 T5935
> oasc.SolrResourceLoader.replaceClassLoader Adding
> 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-002/collection1/lib/classes/'
> to classloader
> :    [junit4]   2> 3593715 T5935
> oasc.SolrResourceLoader.replaceClassLoader Adding
> 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-002/collection1/lib/.svn/'
> to classloader
> :    [junit4]   2> 3593715 T5935
> oasc.SolrResourceLoader.replaceClassLoader Adding
> 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-002/collection1/lib/README'
> to classloader
> :    [junit4]   2> 3593779 T5935 oasc.SolrConfig.<init> Using Lucene
> MatchVersion: LUCENE_4_10
> :    [junit4]   2> 3593827 T5935 oasc.SolrConfig.<init> Loaded SolrConfig:
> solrconfig.xml
> :    [junit4]   2> 3593928 T5935 oass.IndexSchema.readSchema Reading Solr
> Schema from schema.xml
> :    [junit4]   2> 3593939 T5935 oass.IndexSchema.readSchema [collection1]
> Schema name=test
> :    [junit4]   2> 3594409 T5935 oass.ByteField.init WARN ByteField is
> deprecated and will be removed in 5.0. You should use TrieIntField instead.
> :    [junit4]   2> 3594410 T5935 oass.ShortField.init WARN ShortField is
> deprecated and will be removed in 5.0. You should use TrieIntField instead.
> :    [junit4]   2> 3594411 T5935 oass.OpenExchangeRatesOrgProvider.init
> Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> :    [junit4]   2> 3594423 T5935 oass.IndexSchema.readSchema default
> search field in schema is text
> :    [junit4]   2> 3594427 T5935 oass.IndexSchema.readSchema unique key
> field: id
> :    [junit4]   2> 3594438 T5935 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
> :    [junit4]   2> 3594442 T5935 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
> :    [junit4]   2> 3594446 T5935 oass.OpenExchangeRatesOrgProvider.reload
> Reloading exchange rates from open-exchange-rates.json
> :    [junit4]   2> 3594447 T5935
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
> IMPORTANT NOTE
> :    [junit4]   2> 3594447 T5935
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
> key, got STRING
> :    [junit4]   2> 3594448 T5935 oass.OpenExchangeRatesOrgProvider.reload
> Reloading exchange rates from open-exchange-rates.json
> :    [junit4]   2> 3594449 T5935
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
> IMPORTANT NOTE
> :    [junit4]   2> 3594449 T5935
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
> key, got STRING
> :    [junit4]   2> 3594449 T5935 oasc.CoreContainer.create Creating
> SolrCore 'collection1' using configuration from collection
> control_collection
> :    [junit4]   2> 3594449 T5935 oasc.SolrCore.initDirectoryFactory
> org.apache.solr.core.MockDirectoryFactory
> :    [junit4]   2> 3594450 T5935 oasc.SolrCore.<init> [collection1]
> Opening new SolrCore at
> ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-002/collection1/,
> dataDir=./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-001/control/data/
> :    [junit4]   2> 3594450 T5935 oasc.JmxMonitoredMap.<init> JMX
> monitoring is enabled. Adding Solr mbeans to JMX Server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@7bde656e
> :    [junit4]   2> 3594451 T5935 oasc.CachingDirectoryFactory.get return
> new directory for
> ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-001/control/data
> :    [junit4]   2> 3594451 T5935 oasc.SolrCore.getNewIndexDir New index
> directory detected: old=null
> new=./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-001/control/data/index/
> :    [junit4]   2> 3594451 T5935 oasc.SolrCore.initIndex WARN
> [collection1] Solr index directory
> './solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-001/control/data/index'
> doesn't exist. Creating new index...
> :    [junit4]   2> 3594451 T5935 oasc.CachingDirectoryFactory.get return
> new directory for
> ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-001/control/data/index
> :    [junit4]   2> 3594452 T5935 oasu.RandomMergePolicy.<init>
> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy:
> [LogDocMergePolicy: minMergeSize=1000, mergeFactor=16,
> maxMergeSize=9223372036854775807,
> maxMergeSizeForForcedMerge=9223372036854775807,
> calibrateSizeByDeletes=true, maxMergeDocs=2147483647,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
> :    [junit4]   2> 3594453 T5935 oasc.SolrDeletionPolicy.onCommit
> SolrDeletionPolicy.onCommit: commits: num=1
> :    [junit4]   2>
>  commit{dir=MockDirectoryWrapper(RAMDirectory@5de6da92
> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@78db4089
> ),segFN=segments_1,generation=1}
> :    [junit4]   2> 3594453 T5935 oasc.SolrDeletionPolicy.updateCommits
> newest commit generation = 1
> :    [junit4]   2> 3594457 T5935 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "nodistrib"
> :    [junit4]   2> 3594457 T5935 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "dedupe"
> :    [junit4]   2> 3594457 T5935 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "dedupe"
> :    [junit4]   2> 3594458 T5935 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "stored_sig"
> :    [junit4]   2> 3594458 T5935 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "stored_sig"
> :    [junit4]   2> 3594458 T5935 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
> :    [junit4]   2> 3594459 T5935 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> :    [junit4]   2> 3594459 T5935 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> :    [junit4]   2> 3594459 T5935 oasc.SolrCore.loadUpdateProcessorChains
> no updateRequestProcessorChain defined as default, creating implicit default
> :    [junit4]   2> 3594460 T5935
> oasc.RequestHandlers.initHandlersFromConfig created /update:
> org.apache.solr.handler.UpdateRequestHandler
> :    [junit4]   2> 3594460 T5935
> oasc.RequestHandlers.initHandlersFromConfig created /update/json:
> org.apache.solr.handler.UpdateRequestHandler
> :    [junit4]   2> 3594461 T5935
> oasc.RequestHandlers.initHandlersFromConfig created /update/csv:
> org.apache.solr.handler.UpdateRequestHandler
> :    [junit4]   2> 3594461 T5935
> oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs:
> org.apache.solr.handler.UpdateRequestHandler
> :    [junit4]   2> 3594462 T5935
> oasc.RequestHandlers.initHandlersFromConfig created standard:
> solr.StandardRequestHandler
> :    [junit4]   2> 3594462 T5935
> oasc.RequestHandlers.initHandlersFromConfig created /get:
> solr.RealTimeGetHandler
> :    [junit4]   2> 3594462 T5935
> oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler:
> solr.ReplicationHandler
> :    [junit4]   2> 3594463 T5935
> oasc.RequestHandlers.initHandlersFromConfig created /replication:
> solr.ReplicationHandler
> :    [junit4]   2> 3594463 T5935
> oasc.RequestHandlers.initHandlersFromConfig WARN Multiple requestHandler
> registered to the same name: /update ignoring:
> org.apache.solr.handler.UpdateRequestHandler
> :    [junit4]   2> 3594463 T5935
> oasc.RequestHandlers.initHandlersFromConfig created /update:
> solr.UpdateRequestHandler
> :    [junit4]   2> 3594464 T5935
> oasc.RequestHandlers.initHandlersFromConfig created /admin/:
> org.apache.solr.handler.admin.AdminHandlers
> :    [junit4]   2> 3594464 T5935
> oasc.RequestHandlers.initHandlersFromConfig created /admin/file:
> solr.admin.ShowFileRequestHandler
> :    [junit4]   2> 3594483 T5935 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
> :    [junit4]   2> 3594485 T5935 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
> :    [junit4]   2> 3594487 T5935 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
> :    [junit4]   2> 3594489 T5935 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
> :    [junit4]   2> 3594491 T5935 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
> :    [junit4]   2> 3594497 T5935 oasu.CommitTracker.<init> Hard
> AutoCommit: disabled
> :    [junit4]   2> 3594497 T5935 oasu.CommitTracker.<init> Soft
> AutoCommit: disabled
> :    [junit4]   2> 3594498 T5935 oasu.RandomMergePolicy.<init>
> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy:
> [LogDocMergePolicy: minMergeSize=1000, mergeFactor=43,
> maxMergeSize=9223372036854775807,
> maxMergeSizeForForcedMerge=9223372036854775807,
> calibrateSizeByDeletes=true, maxMergeDocs=2147483647,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.33125372141014287]
> :    [junit4]   2> 3594499 T5935 oasc.SolrDeletionPolicy.onInit
> SolrDeletionPolicy.onInit: commits: num=1
> :    [junit4]   2>
>  commit{dir=MockDirectoryWrapper(RAMDirectory@5de6da92
> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@78db4089
> ),segFN=segments_1,generation=1}
> :    [junit4]   2> 3594499 T5935 oasc.SolrDeletionPolicy.updateCommits
> newest commit generation = 1
> :    [junit4]   2> 3594499 T5935 oass.SolrIndexSearcher.<init> Opening
> Searcher@7900b887[collection1] main
> :    [junit4]   2> 3594500 T5935 oascc.ZkStateReader.readConfigName Load
> collection config from:/collections/control_collection
> :    [junit4]   2> 3594500 T5935 oascc.ZkStateReader.readConfigName
> path=/collections/control_collection configName=conf1 specified config
> exists in ZooKeeper
> :    [junit4]   2> 3594501 T5935 oasr.ManagedResourceStorage.newStorageIO
> Setting up ZooKeeper-based storage for the RestManager with znodeBase:
> /configs/conf1
> :    [junit4]   2> 3594501 T5935
> oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured
> ZooKeeperStorageIO with znodeBase: /configs/conf1
> :    [junit4]   2> 3594501 T5935 oasr.RestManager.init Initializing
> RestManager with initArgs: {}
> :    [junit4]   2> 3594502 T5935 oasr.ManagedResourceStorage.load Reading
> _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
> :    [junit4]   2> 3594502 T5935
> oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data
> found for znode /configs/conf1/_rest_managed.json
> :    [junit4]   2> 3594502 T5935 oasr.ManagedResourceStorage.load Loaded
> null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
> :    [junit4]   2> 3594503 T5935 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/_rest_managed.json
> :    [junit4]   2> 3594505 T5935
> oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to
> new znode /configs/conf1/_rest_managed.json
> :    [junit4]   2> 3594505 T5935
> oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path
> _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
> :    [junit4]   2> 3594505 T5935 oasr.RestManager.init Initializing 0
> registered ManagedResources
> :    [junit4]   2> 3594508 T5937 oasc.SolrCore.registerSearcher
> [collection1] Registered new searcher Searcher@7900b887[collection1]
> main{StandardDirectoryReader(segments_1:1:nrt)}
> :    [junit4]   2> 3594511 T5935 oasc.CoreContainer.registerCore
> registering core: collection1
> :    [junit4]   2> 3594512 T5940 oasc.ZkController.register Register
> replica - core:collection1 address:http://127.0.0.1:44580
> collection:control_collection shard:shard1
> :    [junit4]   2> 3594513 T5910 oass.SolrDispatchFilter.init
> user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
> :    [junit4]   2> 3594513 T5910 oass.SolrDispatchFilter.init
> SolrDispatchFilter.init() done
> :    [junit4]   2> 3594513 T5940 oascc.SolrZkClient.makePath makePath:
> /collections/control_collection/leader_elect/shard1/election
> :    [junit4]   2> 3594514 T5910 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
> :    [junit4]   2> 3594516 T5942 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@46bab9b4
> name:ZooKeeperConnection Watcher:127.0.0.1:53984/solr got event
> WatchedEvent state:SyncConnected type:None path:null path:null type:None
> :    [junit4]   2> 3594516 T5910 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
> :    [junit4]   2> 3594517 T5910
> oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster
> state from ZooKeeper...
> :    [junit4]   2> 3594518 T5940
> oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process
> for shard shard1
> :    [junit4]   2> 3594519 T5910 oasc.ChaosMonkey.monkeyLog monkey: init -
> expire sessions:false cause connection loss:false
> :    [junit4]   2> 3594520 T5936
> oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on
> path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> :    [junit4]   2> 3594520 T5940
> oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas
> found to continue.
> :    [junit4]   2> 3594520 T5940
> oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader -
> try and sync
> :    [junit4]   2> ASYNC  NEW_CORE C1128 name=collection1
> org.apache.solr.core.SolrCore@24159ed7 url=
> http://127.0.0.1:44580/collection1 node=127.0.0.1:44580_
> C1128_STATE=coll:control_collection core:collection1 props:{state=down,
> base_url=http://127.0.0.1:44580, core=collection1,
> node_name=127.0.0.1:44580_}
> :    [junit4]   2> 3594520 T5940 C1128 P44580 oasc.SyncStrategy.sync Sync
> replicas to http://127.0.0.1:44580/collection1/
> :    [junit4]   2> 3594521 T5940 C1128 P44580
> oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
> :    [junit4]   2> 3594521 T5933 oascc.ZkStateReader.updateClusterState
> Updating cloud state from ZooKeeper...
> :    [junit4]   2> 3594521 T5940 C1128 P44580 oasc.SyncStrategy.syncToMe
> http://127.0.0.1:44580/collection1/ has no replicas
> :    [junit4]   2> 3594521 T5940
> oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader:
> http://127.0.0.1:44580/collection1/ shard1
> :    [junit4]   2> 3594521 T5940 oascc.SolrZkClient.makePath makePath:
> /collections/control_collection/leaders/shard1
> :    [junit4]   2> 3594523 T5936
> oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on
> path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> :    [junit4]   2> 3594523 T5936 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> :    [junit4]   2> 3594523 T5943 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> :    [junit4]   2> 3594527 T5933 oascc.ZkStateReader.updateClusterState
> Updating cloud state from ZooKeeper...
> :    [junit4]   2> 3594528 T5936
> oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on
> path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> :    [junit4]   2> 3594630 T5936 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> :    [junit4]   2> 3594630 T5943 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> :    [junit4]   2> 3594679 T5940 oasc.ZkController.register We are
> http://127.0.0.1:44580/collection1/ and leader is
> http://127.0.0.1:44580/collection1/
> :    [junit4]   2> 3594680 T5940 oasc.ZkController.register No LogReplay
> needed for core=collection1 baseURL=http://127.0.0.1:44580
> :    [junit4]   2> 3594680 T5940 oasc.ZkController.checkRecovery I am the
> leader, no recovery necessary
> :    [junit4]   2> 3594680 T5940 oasc.ZkController.publish publishing
> core=collection1 state=active collection=control_collection
> :    [junit4]   2> 3594680 T5940 oasc.ZkController.publish numShards not
> found on descriptor - reading it from system property
> :    [junit4]   2> 3594681 T5936
> oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on
> path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> :    [junit4]   2> 3594682 T5936
> oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on
> path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> :    [junit4]   2> 3594682 T5940 oascc.ZkStateReader.updateClusterState
> Updating cloud state from ZooKeeper...
> :    [junit4]   2> 3594682 T5944
> oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on
> path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> :    [junit4]   2> 3594683 T5933 oascc.ZkStateReader.updateClusterState
> Updating cloud state from ZooKeeper...
> :    [junit4]   2> 3594683 T5933
> oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2
> message={
> :    [junit4]   2>        "operation":"state",
> :    [junit4]   2>        "state":"active",
> :    [junit4]   2>        "base_url":"http://127.0.0.1:44580",
> :    [junit4]   2>        "core":"collection1",
> :    [junit4]   2>        "roles":null,
> :    [junit4]   2>        "node_name":"127.0.0.1:44580_",
> :    [junit4]   2>        "shard":"shard1",
> :    [junit4]   2>        "collection":"control_collection",
> :    [junit4]   2>        "numShards":"2",
> :    [junit4]   2>        "core_node_name":"core_node1"}
> :    [junit4]   2> 3594685 T5944
> oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on
> path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> :    [junit4]   2> 3594786 T5944 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> :    [junit4]   2> 3594786 T5943 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
> :    [junit4]   2> 3595631 T5910
> oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
> :    [junit4]   2> 3595632 T5910 oejs.Server.doStart jetty-8.1.10.v20130312
> :    [junit4]   2> 3595635 T5910 oejs.AbstractConnector.doStart Started
> SocketConnector@127.0.0.1:27736
> :    [junit4]   2> 3595635 T5910 oass.SolrDispatchFilter.init
> SolrDispatchFilter.init()
> :    [junit4]   2> 3595636 T5910 oasc.SolrResourceLoader.locateSolrHome
> JNDI not configured for solr (NoInitialContextEx)
> :    [junit4]   2> 3595636 T5910 oasc.SolrResourceLoader.locateSolrHome
> using system property solr.solr.home:
> ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003
> :    [junit4]   2> 3595636 T5910 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> './solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/'
> :    [junit4]   2> 3595665 T5910 oasc.ConfigSolr.fromFile Loading
> container configuration from
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/solr.xml
> :    [junit4]   2> 3595719 T5910 oasc.CoreContainer.<init> New
> CoreContainer 770910585
> :    [junit4]   2> 3595719 T5910 oasc.CoreContainer.load Loading cores
> into CoreContainer
> [instanceDir=./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/]
> :    [junit4]   2> 3595720 T5910
> oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
> :    [junit4]   2> 3595720 T5910
> oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
> :    [junit4]   2> 3595721 T5910
> oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
> :    [junit4]   2> 3595721 T5910
> oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost
> to: 20
> :    [junit4]   2> 3595721 T5910
> oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
> :    [junit4]   2> 3595721 T5910
> oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to:
> 2147483647
> :    [junit4]   2> 3595722 T5910
> oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
> :    [junit4]   2> 3595722 T5910
> oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
> :    [junit4]   2> 3595722 T5910
> oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
> :    [junit4]   2> 3595723 T5910 oasu.UpdateShardHandler.<init> Creating
> UpdateShardHandler HTTP client with params:
> socketTimeout=340000&connTimeout=45000&retry=false
> :    [junit4]   2> 3595723 T5910 oasl.LogWatcher.createWatcher SLF4J impl
> is org.slf4j.impl.Log4jLoggerFactory
> :    [junit4]   2> 3595723 T5910 oasl.LogWatcher.newRegisteredLogWatcher
> Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
> :    [junit4]   2> 3595723 T5910 oasc.CoreContainer.load Host Name:
> 127.0.0.1
> :    [junit4]   2> 3595724 T5910 oasc.ZkContainer.initZooKeeper Zookeeper
> client=127.0.0.1:53984/solr
> :    [junit4]   2> 3595724 T5910 oasc.ZkController.checkChrootPath zkHost
> includes chroot
> :    [junit4]   2> 3595725 T5910 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
> :    [junit4]   2> 3595726 T5955 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@3727de80
> name:ZooKeeperConnection Watcher:127.0.0.1:53984 got event WatchedEvent
> state:SyncConnected type:None path:null path:null type:None
> :    [junit4]   2> 3595727 T5910 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
> :    [junit4]   2> 3595729 T5910 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
> :    [junit4]   2> 3595730 T5957 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@1a404f0c
> name:ZooKeeperConnection Watcher:127.0.0.1:53984/solr got event
> WatchedEvent state:SyncConnected type:None path:null path:null type:None
> :    [junit4]   2> 3595730 T5910 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
> :    [junit4]   2> 3595735 T5910
> oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster
> state from ZooKeeper...
> :    [junit4]   2> 3596738 T5910 oasc.ZkController.createEphemeralLiveNode
> Register node as live in ZooKeeper:/live_nodes/127.0.0.1:27736_
> :    [junit4]   2> 3596739 T5910 oascc.SolrZkClient.makePath makePath:
> /live_nodes/127.0.0.1:27736_
> :    [junit4]   2> 3596741 T5944 oascc.ZkStateReader$3.process Updating
> live nodes... (2)
> :    [junit4]   2> 3596742 T5958 oascc.ZkStateReader$3.process Updating
> live nodes... (2)
> :    [junit4]   2> 3596742 T5943 oascc.ZkStateReader$3.process Updating
> live nodes... (2)
> :    [junit4]   2> 3596748 T5959 oasc.ZkController.publish publishing
> core=collection1 state=down collection=collection1
> :    [junit4]   2> 3596748 T5959 oasc.ZkController.publish numShards not
> found on descriptor - reading it from system property
> :    [junit4]   2> 3596749 T5944
> oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on
> path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> :    [junit4]   2> 3596750 T5960
> oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on
> path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> :    [junit4]   2> 3596749 T5959 oasc.ZkController.waitForCoreNodeName
> look for our core node name
> :    [junit4]   2> 3596749 T5936
> oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on
> path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> :    [junit4]   2> 3596751 T5933 oascc.ZkStateReader.updateClusterState
> Updating cloud state from ZooKeeper...
> :    [junit4]   2> 3596751 T5933
> oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2
> message={
> :    [junit4]   2>        "operation":"state",
> :    [junit4]   2>        "state":"down",
> :    [junit4]   2>        "base_url":"http://127.0.0.1:27736",
> :    [junit4]   2>        "core":"collection1",
> :    [junit4]   2>        "roles":null,
> :    [junit4]   2>        "node_name":"127.0.0.1:27736_",
> :    [junit4]   2>        "shard":null,
> :    [junit4]   2>        "collection":"collection1",
> :    [junit4]   2>        "numShards":"2",
> :    [junit4]   2>        "core_node_name":null}
> :    [junit4]   2> 3596751 T5933
> oasc.Overseer$ClusterStateUpdater.createCollection Create collection
> collection1 with shards [shard1, shard2]
> :    [junit4]   2> 3596752 T5933
> oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard
> shard=shard2
> :    [junit4]   2> 3596753 T5936
> oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on
> path: /overseer/queue state: SyncConnected type NodeChildrenChanged
> :    [junit4]   2> 3596754 T5936 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> :    [junit4]   2> 3596754 T5958 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> :    [junit4]   2> 3596754 T5943 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
> :    [junit4]   2> 3597750 T5959 oasc.ZkController.waitForShardId waiting
> to find shard id in clusterstate for collection1
> :    [junit4]   2> 3597751 T5959 oasc.ZkController.createCollectionZkNode
> Check for collection zkNode:collection1
> :    [junit4]   2> 3597751 T5959 oasc.ZkController.createCollectionZkNode
> Collection zkNode exists
> :    [junit4]   2> 3597752 T5959 oascc.ZkStateReader.readConfigName Load
> collection config from:/collections/collection1
> :    [junit4]   2> 3597752 T5959 oascc.ZkStateReader.readConfigName
> path=/collections/collection1 configName=conf1 specified config exists in
> ZooKeeper
> :    [junit4]   2> 3597753 T5959 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> './solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/collection1/'
> :    [junit4]   2> 3597754 T5959
> oasc.SolrResourceLoader.replaceClassLoader Adding
> 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/collection1/lib/classes/'
> to classloader
> :    [junit4]   2> 3597755 T5959
> oasc.SolrResourceLoader.replaceClassLoader Adding
> 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/collection1/lib/.svn/'
> to classloader
> :    [junit4]   2> 3597755 T5959
> oasc.SolrResourceLoader.replaceClassLoader Adding
> 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/collection1/lib/README'
> to classloader
> :    [junit4]   2> 3597819 T5959 oasc.SolrConfig.<init> Using Lucene
> MatchVersion: LUCENE_4_10
> :    [junit4]   2> 3597883 T5959 oasc.SolrConfig.<init> Loaded SolrConfig:
> solrconfig.xml
> :    [junit4]   2> 3597984 T5959 oass.IndexSchema.readSchema Reading Solr
> Schema from schema.xml
> :    [junit4]   2> 3597995 T5959 oass.IndexSchema.readSchema [collection1]
> Schema name=test
> :    [junit4]   2> 3598432 T5959 oass.ByteField.init WARN ByteField is
> deprecated and will be removed in 5.0. You should use TrieIntField instead.
> :    [junit4]   2> 3598433 T5959 oass.ShortField.init WARN ShortField is
> deprecated and will be removed in 5.0. You should use TrieIntField instead.
> :    [junit4]   2> 3598433 T5959 oass.OpenExchangeRatesOrgProvider.init
> Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
> :    [junit4]   2> 3598446 T5959 oass.IndexSchema.readSchema default
> search field in schema is text
> :    [junit4]   2> 3598449 T5959 oass.IndexSchema.readSchema unique key
> field: id
> :    [junit4]   2> 3598460 T5959 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
> :    [junit4]   2> 3598465 T5959 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
> :    [junit4]   2> 3598469 T5959 oass.OpenExchangeRatesOrgProvider.reload
> Reloading exchange rates from open-exchange-rates.json
> :    [junit4]   2> 3598469 T5959
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
> IMPORTANT NOTE
> :    [junit4]   2> 3598470 T5959
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
> key, got STRING
> :    [junit4]   2> 3598470 T5959 oass.OpenExchangeRatesOrgProvider.reload
> Reloading exchange rates from open-exchange-rates.json
> :    [junit4]   2> 3598471 T5959
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
> IMPORTANT NOTE
> :    [junit4]   2> 3598471 T5959
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
> key, got STRING
> :    [junit4]   2> 3598471 T5959 oasc.CoreContainer.create Creating
> SolrCore 'collection1' using configuration from collection collection1
> :    [junit4]   2> 3598471 T5959 oasc.SolrCore.initDirectoryFactory
> org.apache.solr.core.MockDirectoryFactory
> :    [junit4]   2> 3598472 T5959 oasc.SolrCore.<init> [collection1]
> Opening new SolrCore at
> ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/collection1/,
> dataDir=./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/collection1/data/
> :    [junit4]   2> 3598472 T5959 oasc.JmxMonitoredMap.<init> JMX
> monitoring is enabled. Adding Solr mbeans to JMX Server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@7bde656e
> :    [junit4]   2> 3598473 T5959 oasc.CachingDirectoryFactory.get return
> new directory for
> ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/collection1/data
> :    [junit4]   2> 3598473 T5959 oasc.SolrCore.getNewIndexDir New index
> directory detected: old=null
> new=./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/collection1/data/index/
> :    [junit4]   2> 3598473 T5959 oasc.SolrCore.initIndex WARN
> [collection1] Solr index directory
> './solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/collection1/data/index'
> doesn't exist. Creating new index...
> :    [junit4]   2> 3598474 T5959 oasc.CachingDirectoryFactory.get return
> new directory for
> ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/collection1/data/index
> :    [junit4]   2> 3598474 T5959 oasu.RandomMergePolicy.<init>
> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy:
> [LogDocMergePolicy: minMergeSize=1000, mergeFactor=16,
> maxMergeSize=9223372036854775807,
> maxMergeSizeForForcedMerge=9223372036854775807,
> calibrateSizeByDeletes=true, maxMergeDocs=2147483647,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
> :    [junit4]   2> 3598475 T5959 oasc.SolrDeletionPolicy.onCommit
> SolrDeletionPolicy.onCommit: commits: num=1
> :    [junit4]   2>
>  commit{dir=MockDirectoryWrapper(RAMDirectory@34b9c3ed
> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@175c4ba0
> ),segFN=segments_1,generation=1}
> :    [junit4]   2> 3598475 T5959 oasc.SolrDeletionPolicy.updateCommits
> newest commit generation = 1
> :    [junit4]   2> 3598480 T5959 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "nodistrib"
> :    [junit4]   2> 3598480 T5959 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "dedupe"
> :    [junit4]   2> 3598480 T5959 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "dedupe"
> :    [junit4]   2> 3598480 T5959 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "stored_sig"
> :    [junit4]   2> 3598481 T5959 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "stored_sig"
> :    [junit4]   2> 3598481 T5959 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
> :    [junit4]   2> 3598481 T5959 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> :    [junit4]   2> 3598482 T5959 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "distrib-dup-test-chain-implicit"
> :    [junit4]   2> 3598482 T5959 oasc.SolrCore.loadUpdateProcessorChains
> no updateRequestProcessorChain defined as default, creating implicit default
> :    [junit4]   2> 3598483 T5959
> oasc.RequestHandlers.initHandlersFromConfig created /update:
> org.apache.solr.handler.UpdateRequestHandler
> :    [junit4]   2> 3598483 T5959
> oasc.RequestHandlers.initHandlersFromConfig created /update/json:
> org.apache.solr.handler.UpdateRequestHandler
> :    [junit4]   2> 3598484 T5959
> oasc.RequestHandlers.initHandlersFromConfig created /update/csv:
> org.apache.solr.handler.UpdateRequestHandler
> :    [junit4]   2> 3598484 T5959
> oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs:
> org.apache.solr.handler.UpdateRequestHandler
> :    [junit4]   2> 3598485 T5959
> oasc.RequestHandlers.initHandlersFromConfig created standard:
> solr.StandardRequestHandler
> :    [junit4]   2> 3598486 T5959
> oasc.RequestHandlers.initHandlersFromConfig created /get:
> solr.RealTimeGetHandler
> :    [junit4]   2> 3598486 T5959
> oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler:
> solr.ReplicationHandler
> :    [junit4]   2> 3598486 T5959
> oasc.RequestHandlers.initHandlersFromConfig create
> :
> : [...truncated too long message...]
> :
> : 3645985 T5910 oasc.CachingDirectoryFactory.close Closing directory:
> ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-006/ocptest1_shard3_replica1/data/index
> :    [junit4]   2> 3645986 T5910 oasc.SolrCore.close
> [ocptest_shardsplit_shard4_replica1]  CLOSING SolrCore
> org.apache.solr.core.SolrCore@2cc6d31a
> :    [junit4]   2> 3645994 T5910 oasu.DirectUpdateHandler2.close closing
> DirectUpdateHandler2{commits=0,autocommits=0,soft
> autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
> :    [junit4]   2> 3645994 T5910 oasu.SolrCoreState.decrefSolrCoreState
> Closing SolrCoreState
> :    [junit4]   2> 3645994 T5910
> oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has
> reached 0 - closing IndexWriter
> :    [junit4]   2> 3645995 T5910
> oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with
> IndexWriterCloser
> :    [junit4]   2> 3645995 T5910 oasc.SolrCore.closeSearcher
> [ocptest_shardsplit_shard4_replica1] Closing main searcher on request.
> :    [junit4]   2> 3645996 T5910 oasc.CachingDirectoryFactory.close
> Closing MockDirectoryFactory - 2 directories currently being tracked
> :    [junit4]   2> 3645996 T5910
> oasc.CachingDirectoryFactory.closeCacheValue looking to close
> ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-006/ocptest_shardsplit_shard4_replica1/data/index
> [CachedDir<<refCount=0;path=./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-006/ocptest_shardsplit_shard4_replica1/data/index;done=false>>]
> :    [junit4]   2> 3645997 T5910 oasc.CachingDirectoryFactory.close
> Closing directory:
> ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-006/ocptest_shardsplit_shard4_replica1/data/index
> :    [junit4]   2> 3645997 T5910
> oasc.CachingDirectoryFactory.closeCacheValue looking to close
> ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-006/ocptest_shardsplit_shard4_replica1/data
> [CachedDir<<refCount=0;path=./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-006/ocptest_shardsplit_shard4_replica1/data;done=false>>]
> :    [junit4]   2> 3645997 T5910 oasc.CachingDirectoryFactory.close
> Closing directory:
> ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-006/ocptest_shardsplit_shard4_replica1/data
> :    [junit4]   2> 3645998 T7442 oasc.Overseer$ClusterStateUpdater.run
> Overseer Loop exiting : 127.0.0.1:18528_
> :    [junit4]   2> 3646000 T7437 oascc.ZkStateReader$3.process WARN
> ZooKeeper watch triggered, but Solr cannot talk to ZK
> :    [junit4]   2> 3646000 T7444
> oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not
> read the data org.apache.zookeeper.KeeperException$SessionExpiredException:
> KeeperErrorCode = Session expired for /overseer_elect/leader
> :    [junit4]   2>      at
> org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
> :    [junit4]   2>      at
> org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
> :    [junit4]   2>      at
> org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
> :    [junit4]   2>      at
> org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:302)
> :    [junit4]   2>      at
> org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:299)
> :    [junit4]   2>      at
> org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
> :    [junit4]   2>      at
> org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:299)
> :    [junit4]   2>      at
> org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:316)
> :    [junit4]   2>      at
> org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
> :    [junit4]   2>      at
> org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:288)
> :    [junit4]   2>
> :    [junit4]   2> 3646001 T5910 oejsh.ContextHandler.doStop stopped
> o.e.j.s.ServletContextHandler{/,null}
> :    [junit4]   2> 3650916 T5910 oas.SolrTestCaseJ4.tearDown ###Ending
> testDistribSearch
> :    [junit4]   2> 3650918 T5910 oasc.ZkTestServer.send4LetterWord
> connecting to 127.0.0.1:53984 53984
> :    [junit4]   2> 3651144 T5911 oasc.ZkTestServer.send4LetterWord
> connecting to 127.0.0.1:53984 53984
> :    [junit4]   2> NOTE: reproduce with: ant test
>  -Dtestcase=MultiThreadedOCPTest -Dtests.method=testDistribSearch
> -Dtests.seed=894023E3DFD774C6 -Dtests.multiplier=3 -Dtests.slow=true
> -Dtests.locale=ar_DZ -Dtests.timezone=Europe/Vilnius
> -Dtests.file.encoding=ISO-8859-1
> :    [junit4] FAILURE 60.0s J0 | MultiThreadedOCPTest.testDistribSearch <<<
> :    [junit4]    > Throwable #1: java.lang.AssertionError: We have a
> failed SPLITSHARD task
> :    [junit4]    >      at
> __randomizedtesting.SeedInfo.seed([894023E3DFD774C6:8A6ADFBA88814FA]:0)
> :    [junit4]    >      at
> org.apache.solr.cloud.MultiThreadedOCPTest.testTaskExclusivity(MultiThreadedOCPTest.java:125)
> :    [junit4]    >      at
> org.apache.solr.cloud.MultiThreadedOCPTest.doTest(MultiThreadedOCPTest.java:71)
> :    [junit4]    >      at
> org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
> :    [junit4]    >      at java.lang.Thread.run(Thread.java:745)
> :    [junit4]   2> 3651162 T5910 oas.SolrTestCaseJ4.deleteCore
> ###deleteCore
> :    [junit4]   2> NOTE: leaving temporary files on disk at:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001
> :    [junit4]   2> 59977 T5909 ccr.ThreadLeakControl.checkThreadLeaks
> WARNING Will linger awaiting termination of 1 leaked thread(s).
> :    [junit4]   2> NOTE: test params are: codec=Lucene41,
> sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=ar_DZ,
> timezone=Europe/Vilnius
> :    [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation
> 1.7.0_60 (64-bit)/cpus=16,threads=1,free=278470064,total=529530880
> :    [junit4]   2> NOTE: All tests run in this JVM:
> [DirectUpdateHandlerTest, CoreAdminCreateDiscoverTest,
> TestQuerySenderListener, MinimalSchemaTest, TestSolrDeletionPolicy1,
> CollectionsAPIDistributedZkTest, TestLuceneMatchVersion,
> TestQuerySenderNoQuery, TestManagedStopFilterFactory,
> TestDynamicFieldCollectionResource, TestSearchPerf, SortByFunctionTest,
> TestStressRecovery, TestCustomSort, SuggesterFSTTest, TestFaceting,
> TestStressLucene, TestChildDocTransformer, DirectSolrConnectionTest,
> EnumFieldTest, SolrIndexSplitterTest, IndexBasedSpellCheckerTest,
> TestDocSet, DocValuesMultiTest, CustomCollectionTest,
> LegacyHTMLStripCharFilterTest, TestSchemaVersionResource,
> ConnectionManagerTest, TestMergePolicyConfig, TestPseudoReturnFields,
> TestFieldSortValues, OverseerRolesTest, DateFieldTest,
> TermVectorComponentDistributedTest, TestIBSimilarityFactory,
> TestSolrXmlPersistence, FieldAnalysisRequestHandlerTest,
> DistribCursorPagingTest, SimpleFacetsTest, DistanceFunctionTest,
> TestSolrXMLSeria
>  lizer, TestExtendedDismaxParser, HdfsBasicDistributedZk2Test,
> DocumentBuilderTest, FileUtilsTest, UpdateParamsTest,
> DocumentAnalysisRequestHandlerTest, UnloadDistributedZkTest,
> CircularListTest, ZkNodePropsTest, ScriptEngineTest, BasicZkTest,
> DistributedQueryComponentOptimizationTest, TestCSVResponseWriter,
> ParsingFieldUpdateProcessorsTest, HdfsRecoveryZkTest, OverseerStatusTest,
> StatsComponentTest, TestWriterPerf, ClusterStateUpdateTest,
> TestUniqueKeyFieldResource, TestNumberUtils, QueryEqualityTest,
> DocExpirationUpdateProcessorFactoryTest, TestComponentsName,
> TestConfigSets, RequiredFieldsTest, TestRestManager,
> TestLMJelinekMercerSimilarityFactory, DateMathParserTest,
> SuggestComponentTest, LeaderElectionTest, MergeStrategyTest,
> ReplicationFactorTest, URLClassifyProcessorTest, TestFileDictionaryLookup,
> PrimUtilsTest, BlockCacheTest, SuggesterTest, SolrIndexConfigTest,
> FastVectorHighlighterTest, TestSolr4Spatial, BasicDistributedZkTest,
> TestUtils, BasicFunctionalityTest, BlockDirect
>  oryTest, TestRecovery, ExternalFileFieldSortTest, TestGroupingSearch,
> TestSolrJ, DistributedDebugComponentTest, TestSchemaSimilarityResource,
> CoreMergeIndexesAdminHandlerTest, TestDocumentBuilder, TestSolr4Spatial2,
> TestSolrDeletionPolicy2, TestManagedResourceStorage, TestCharFilters,
> UniqFieldsUpdateProcessorFactoryTest, ShardSplitTest,
> TestCloudManagedSchemaConcurrent, MultiThreadedOCPTest]
> :    [junit4] Completed on J0 in 60.51s, 1 test, 1 failure <<< FAILURES!
> :
> : [...truncated 627 lines...]
> : BUILD FAILED
> :
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:474:
> The following error occurred while executing this line:
> :
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:454:
> The following error occurred while executing this line:
> :
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:45:
> The following error occurred while executing this line:
> :
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/extra-targets.xml:37:
> The following error occurred while executing this line:
> :
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:189:
> The following error occurred while executing this line:
> :
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:496:
> The following error occurred while executing this line:
> :
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1299:
> The following error occurred while executing this line:
> :
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:923:
> There were test failures: 411 suites, 1711 tests, 1 suite-level error, 1
> failure, 53 ignored (19 assumptions)
> :
> : Total time: 123 minutes 13 seconds
> : Build step 'Invoke Ant' marked build as failure
> : Archiving artifacts
> : Sending artifact delta relative to Lucene-Solr-Tests-4.x-Java7 #2040
> : Archived 3 artifacts
> : Archive block size is 32768
> : Received 0 blocks and 196987264 bytes
> : Compression is 0.0%
> : Took 36 sec
> : Recording test results
> : Email was triggered for: Failure
> : Sending email for trigger: Failure
> :
> :
> :
>
> -Hoss
> http://www.lucidworks.com/

Re: [JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 2049 - Still Failing

Posted by Chris Hostetter <ho...@fucit.org>.
Smiley,

QueryEqualityTest has a sanity check built into it to ensure no one adds a 
new built-in QParser w/o writting some query equality tests for it ... it 
seems to have caught you....


: Date: Thu, 7 Aug 2014 20:23:23 +0000 (UTC)
: From: Apache Jenkins Server <je...@builds.apache.org>
: Reply-To: dev@lucene.apache.org
: To: dev@lucene.apache.org
: Subject: [JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 2049 - Still Failing
: 
: Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/2049/
: 
: 2 tests failed.
: FAILED:  junit.framework.TestSuite.org.apache.solr.search.QueryEqualityTest
: 
: Error Message:
: testParserCoverage was run w/o any other method explicitly testing qparser: terms
: 
: Stack Trace:
: java.lang.AssertionError: testParserCoverage was run w/o any other method explicitly testing qparser: terms
: 	at __randomizedtesting.SeedInfo.seed([894023E3DFD774C6]:0)
: 	at org.junit.Assert.fail(Assert.java:93)
: 	at org.junit.Assert.assertTrue(Assert.java:43)
: 	at org.apache.solr.search.QueryEqualityTest.afterClassParserCoverageTest(QueryEqualityTest.java:62)
: 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
: 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
: 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
: 	at java.lang.reflect.Method.invoke(Method.java:606)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:790)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
: 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
: 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
: 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
: 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
: 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
: 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
: 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
: 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
: 	at java.lang.Thread.run(Thread.java:745)
: 
: 
: FAILED:  org.apache.solr.cloud.MultiThreadedOCPTest.testDistribSearch
: 
: Error Message:
: We have a failed SPLITSHARD task
: 
: Stack Trace:
: java.lang.AssertionError: We have a failed SPLITSHARD task
: 	at __randomizedtesting.SeedInfo.seed([894023E3DFD774C6:8A6ADFBA88814FA]:0)
: 	at org.junit.Assert.fail(Assert.java:93)
: 	at org.junit.Assert.assertTrue(Assert.java:43)
: 	at org.apache.solr.cloud.MultiThreadedOCPTest.testTaskExclusivity(MultiThreadedOCPTest.java:125)
: 	at org.apache.solr.cloud.MultiThreadedOCPTest.doTest(MultiThreadedOCPTest.java:71)
: 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
: 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
: 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
: 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
: 	at java.lang.reflect.Method.invoke(Method.java:606)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
: 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
: 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
: 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
: 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
: 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
: 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
: 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
: 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
: 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
: 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
: 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
: 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
: 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
: 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
: 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
: 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
: 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
: 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
: 	at java.lang.Thread.run(Thread.java:745)
: 
: 
: 
: 
: Build Log:
: [...truncated 13182 lines...]
:    [junit4] Suite: org.apache.solr.search.QueryEqualityTest
:    [junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.search.QueryEqualityTest-894023E3DFD774C6-001/init-core-data-001
:    [junit4]   2> 1065206 T2891 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
:    [junit4]   2> 1065208 T2891 oas.SolrTestCaseJ4.initCore ####initCore
:    [junit4]   2> 1065208 T2891 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/'
:    [junit4]   2> 1065209 T2891 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
:    [junit4]   2> 1065210 T2891 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/README' to classloader
:    [junit4]   2> 1065210 T2891 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
:    [junit4]   2> 1065344 T2891 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
:    [junit4]   2> 1065414 T2891 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
:    [junit4]   2> 1065415 T2891 oass.IndexSchema.readSchema Reading Solr Schema from schema15.xml
:    [junit4]   2> 1065425 T2891 oass.IndexSchema.readSchema [null] Schema name=test
:    [junit4]   2> 1065818 T2891 oass.IndexSchema.readSchema default search field in schema is text
:    [junit4]   2> 1065820 T2891 oass.IndexSchema.readSchema unique key field: id
:    [junit4]   2> 1065822 T2891 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
:    [junit4]   2> 1065825 T2891 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
:    [junit4]   2> 1065836 T2891 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
:    [junit4]   2> 1065837 T2891 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr
:    [junit4]   2> 1065837 T2891 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/'
:    [junit4]   2> 1065878 T2891 oasc.CoreContainer.<init> New CoreContainer 830398897
:    [junit4]   2> 1065878 T2891 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/]
:    [junit4]   2> 1065879 T2891 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
:    [junit4]   2> 1065879 T2891 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
:    [junit4]   2> 1065879 T2891 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
:    [junit4]   2> 1065879 T2891 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
:    [junit4]   2> 1065880 T2891 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
:    [junit4]   2> 1065880 T2891 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
:    [junit4]   2> 1065880 T2891 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
:    [junit4]   2> 1065880 T2891 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
:    [junit4]   2> 1065880 T2891 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
:    [junit4]   2> 1065883 T2891 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=30000&connTimeout=30000&retry=false
:    [junit4]   2> 1065884 T2891 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
:    [junit4]   2> 1065884 T2891 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
:    [junit4]   2> 1065884 T2891 oasc.CoreContainer.load Host Name: 
:    [junit4]   2> 1065888 T2892 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/'
:    [junit4]   2> 1065890 T2892 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
:    [junit4]   2> 1065890 T2892 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/README' to classloader
:    [junit4]   2> 1065890 T2892 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
:    [junit4]   2> 1065950 T2892 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
:    [junit4]   2> 1066019 T2892 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
:    [junit4]   2> 1066020 T2892 oass.IndexSchema.readSchema Reading Solr Schema from schema15.xml
:    [junit4]   2> 1066031 T2892 oass.IndexSchema.readSchema [collection1] Schema name=test
:    [junit4]   2> 1066425 T2892 oass.IndexSchema.readSchema default search field in schema is text
:    [junit4]   2> 1066428 T2892 oass.IndexSchema.readSchema unique key field: id
:    [junit4]   2> 1066430 T2892 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
:    [junit4]   2> 1066435 T2892 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
:    [junit4]   2> 1066450 T2892 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/
:    [junit4]   2> 1066450 T2892 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
:    [junit4]   2> 1066451 T2892 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.search.QueryEqualityTest-894023E3DFD774C6-001/init-core-data-001/
:    [junit4]   2> 1066451 T2892 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bde656e
:    [junit4]   2> 1066452 T2892 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.search.QueryEqualityTest-894023E3DFD774C6-001/init-core-data-001
:    [junit4]   2> 1066452 T2892 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.search.QueryEqualityTest-894023E3DFD774C6-001/init-core-data-001/index/
:    [junit4]   2> 1066452 T2892 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.search.QueryEqualityTest-894023E3DFD774C6-001/init-core-data-001/index' doesn't exist. Creating new index...
:    [junit4]   2> 1066453 T2892 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.search.QueryEqualityTest-894023E3DFD774C6-001/init-core-data-001/index
:    [junit4]   2> 1066454 T2892 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=12.4951171875, floorSegmentMB=2.103515625, forceMergeDeletesPctAllowed=8.686604790539262, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.17091186665069513
:    [junit4]   2> 1066455 T2892 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
:    [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@35a71706 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1beedab1)),segFN=segments_1,generation=1}
:    [junit4]   2> 1066455 T2892 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
:    [junit4]   2> 1066455 T2892 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
:    [junit4]   2> 1066459 T2892 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
:    [junit4]   2> 1066460 T2892 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
:    [junit4]   2> 1066460 T2892 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe-allfields"
:    [junit4]   2> 1066460 T2892 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
:    [junit4]   2> 1066461 T2892 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
:    [junit4]   2> 1066461 T2892 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
:    [junit4]   2> 1066461 T2892 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "uniq-fields"
:    [junit4]   2> 1066461 T2892 oasup.UniqFieldsUpdateProcessorFactory.init WARN Use of the 'fields' init param in UniqFieldsUpdateProcessorFactory is deprecated, please use 'fieldName' (or another FieldMutatingUpdateProcessorFactory selector option) instead
:    [junit4]   2> 1066462 T2892 oasup.UniqFieldsUpdateProcessorFactory.init Replacing 'fields' init param with (individual) 'fieldName' params
:    [junit4]   2> 1066462 T2892 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
:    [junit4]   2> 1066462 T2892 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
:    [junit4]   2> 1066463 T2892 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
:    [junit4]   2> 1066463 T2892 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
:    [junit4]   2> 1066463 T2892 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
:    [junit4]   2> 1066464 T2892 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
:    [junit4]   2> 1066464 T2892 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
:    [junit4]   2> 1066465 T2892 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
:    [junit4]   2> 1066465 T2892 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
:    [junit4]   2> 1066465 T2892 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
:    [junit4]   2> 1066466 T2892 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
:    [junit4]   2> 1066466 T2892 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
:    [junit4]   2> 1066467 T2892 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
:    [junit4]   2> 1066467 T2892 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
:    [junit4]   2> 1066468 T2892 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
:    [junit4]   2> 1066468 T2892 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
:    [junit4]   2> 1066469 T2892 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
:    [junit4]   2> 1066469 T2892 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
:    [junit4]   2> 1066469 T2892 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
:    [junit4]   2> 1066470 T2892 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
:    [junit4]   2> 1066470 T2892 oasc.RequestHandlers.initHandlersFromConfig WARN Multiple requestHandler registered to the same name: /update ignoring: org.apache.solr.handler.UpdateRequestHandler
:    [junit4]   2> 1066470 T2892 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
:    [junit4]   2> 1066471 T2892 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
:    [junit4]   2> 1066471 T2892 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
:    [junit4]   2> 1066472 T2892 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
:    [junit4]   2> 1066472 T2892 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
:    [junit4]   2> 1066473 T2892 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
:    [junit4]   2> 1066473 T2892 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
:    [junit4]   2> 1066474 T2892 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
:    [junit4]   2> 1066474 T2892 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
:    [junit4]   2> 1066475 T2892 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
:    [junit4]   2> 1066475 T2892 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
:    [junit4]   2> 1066494 T2892 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
:    [junit4]   2> 1066496 T2892 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
:    [junit4]   2> 1066498 T2892 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
:    [junit4]   2> 1066500 T2892 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
:    [junit4]   2> 1066502 T2892 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
:    [junit4]   2> 1066504 T2892 oasc.SolrCore.initDeprecatedSupport WARN solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
:    [junit4]   2> 1066506 T2892 oasu.CommitTracker.<init> Hard AutoCommit: disabled
:    [junit4]   2> 1066507 T2892 oasu.CommitTracker.<init> Soft AutoCommit: disabled
:    [junit4]   2> 1066507 T2892 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=49, maxMergeAtOnceExplicit=36, maxMergedSegmentMB=38.9736328125, floorSegmentMB=1.5791015625, forceMergeDeletesPctAllowed=25.466902262123792, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
:    [junit4]   2> 1066508 T2892 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
:    [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@35a71706 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1beedab1)),segFN=segments_1,generation=1}
:    [junit4]   2> 1066508 T2892 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
:    [junit4]   2> 1066509 T2892 oass.SolrIndexSearcher.<init> Opening Searcher@32ea2a58[collection1] main
:    [junit4]   2> 1066509 T2892 oasr.RestManager.init Initializing RestManager with initArgs: {storageIO=org.apache.solr.rest.ManagedResourceStorage$InMemoryStorageIO}
:    [junit4]   2> 1066509 T2892 oasr.ManagedResourceStorage.load Reading _rest_managed.json using InMemoryStorage
:    [junit4]   2> 1066510 T2892 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
:    [junit4]   2> 1066510 T2892 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using InMemoryStorage
:    [junit4]   2> 1066510 T2892 oasr.RestManager.init Initializing 0 registered ManagedResources
:    [junit4]   2> 1066510 T2892 oashc.SpellCheckComponent.inform Initializing spell checkers
:    [junit4]   2> 1066531 T2892 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
:    [junit4]   2> 1066579 T2893 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@32ea2a58[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
:    [junit4]   2> 1066582 T2892 oasc.CoreContainer.registerCore registering core: collection1
:    [junit4]   2> 1066585 T2891 oas.SolrTestCaseJ4.initCore ####initCore end
:    [junit4]   2> 1066589 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncGeodist
:    [junit4]   2> 1066626 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncGeodist
:    [junit4]   2> 1066632 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQueryLucene
:    [junit4]   2> 1066635 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQueryLucene
:    [junit4]   2> 1066640 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncOrd
:    [junit4]   2> 1066640 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncOrd
:    [junit4]   2> 1066645 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncMod
:    [junit4]   2> 1066646 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncMod
:    [junit4]   2> 1066651 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncCscore
:    [junit4]   2> 1066658 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncCscore
:    [junit4]   2> 1066663 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncDist
:    [junit4]   2> 1066664 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncDist
:    [junit4]   2> 1066668 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncExists
:    [junit4]   2> 1066679 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncExists
:    [junit4]   2> 1066684 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncMap
:    [junit4]   2> 1066693 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncMap
:    [junit4]   2> 1066698 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncRord
:    [junit4]   2> 1066699 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncRord
:    [junit4]   2> 1066704 T2891 oas.SolrTestCaseJ4.setUp ###Starting testField
:    [junit4]   2> 1066704 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testField
:    [junit4]   2> 1066709 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQueryComplexPhrase
:    [junit4]   2> 1066860 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQueryComplexPhrase
:    [junit4]   2> 1066865 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQuerySimple
:    [junit4]   2> 1066887 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQuerySimple
:    [junit4]   2> 1066892 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncGeohash
:    [junit4]   2> 1066893 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncGeohash
:    [junit4]   2> 1066898 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQueryDismax
:    [junit4]   2> 1066906 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQueryDismax
:    [junit4]   2> 1066911 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQueryGeofilt
:    [junit4]   2> 1066915 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQueryGeofilt
:    [junit4]   2> 1066921 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQueryPrefix
:    [junit4]   2> 1066921 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQueryPrefix
:    [junit4]   2> 1066936 T2891 oas.SolrTestCaseJ4.setUp ###Starting testTestFuncs
:    [junit4]   2> 1066941 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testTestFuncs
:    [junit4]   2> 1066946 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncSqedist
:    [junit4]   2> 1066947 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncSqedist
:    [junit4]   2> 1066952 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncSum
:    [junit4]   2> 1066954 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncSum
:    [junit4]   2> 1066959 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncIf
:    [junit4]   2> 1066966 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncIf
:    [junit4]   2> 1066971 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQueryBoost
:    [junit4]   2> 1066980 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQueryBoost
:    [junit4]   2> 1066985 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncDef
:    [junit4]   2> 1067003 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncDef
:    [junit4]   2> 1067008 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncNumdocs
:    [junit4]   2> 1067017 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncNumdocs
:    [junit4]   2> 1067022 T2891 oas.SolrTestCaseJ4.setUp ###Starting testDateMathParsingEquality
:    [junit4]   2> 1067025 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testDateMathParsingEquality
:    [junit4]   2> 1067029 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncMin
:    [junit4]   2> 1067031 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncMin
:    [junit4]   2> 1067036 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQueryTerm
:    [junit4]   2> 1067036 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQueryTerm
:    [junit4]   2> 1067041 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncDiv
:    [junit4]   2> 1067042 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncDiv
:    [junit4]   2> 1067047 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncBoost
:    [junit4]   2> 1067048 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncBoost
:    [junit4]   2> 1067053 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncMs
:    [junit4]   2> 1067070 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncMs
:    [junit4]   2> 1067075 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncNorm
:    [junit4]   2> 1067097 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncNorm
:    [junit4]   2> 1067103 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncLiteral
:    [junit4]   2> 1067103 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncLiteral
:    [junit4]   2> 1067108 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncLinear
:    [junit4]   2> 1067117 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncLinear
:    [junit4]   2> 1067122 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncTestfunc
:    [junit4]   2> 1067123 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncTestfunc
:    [junit4]   2> 1067128 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQueryNested
:    [junit4]   2> 1067129 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQueryNested
:    [junit4]   2> 1067135 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncMaxdoc
:    [junit4]   2> 1067135 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncMaxdoc
:    [junit4]   2> 1067140 T2891 oas.SolrTestCaseJ4.setUp ###Starting testBlockJoin
:    [junit4]   2> 1067164 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testBlockJoin
:    [junit4]   2> 1067169 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQueryFrange
:    [junit4]   2> 1067170 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQueryFrange
:    [junit4]   2> 1067175 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncNot
:    [junit4]   2> 1067177 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncNot
:    [junit4]   2> 1067181 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncDoubleValueBools
:    [junit4]   2> 1067193 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncDoubleValueBools
:    [junit4]   2> 1067198 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncRecip
:    [junit4]   2> 1067199 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncRecip
:    [junit4]   2> 1067203 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQueryRaw
:    [junit4]   2> 1067204 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQueryRaw
:    [junit4]   2> 1067209 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQueryJoin
:    [junit4]   2> 1067222 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQueryJoin
:    [junit4]   2> 1067226 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQueryLucenePlusSort
:    [junit4]   2> 1067229 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQueryLucenePlusSort
:    [junit4]   2> 1067234 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncTop
:    [junit4]   2> 1067235 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncTop
:    [junit4]   2> 1067239 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncSingleValueMathFuncs
:    [junit4]   2> 1067249 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncSingleValueMathFuncs
:    [junit4]   2> 1067254 T2891 oas.SolrTestCaseJ4.setUp ###Starting testParserCoverage
:    [junit4]   2> 1067254 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testParserCoverage
:    [junit4]   2> 1067259 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncVector
:    [junit4]   2> 1067261 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncVector
:    [junit4]   2> 1067265 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncGhhsin
:    [junit4]   2> 1067266 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncGhhsin
:    [junit4]   2> 1067271 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQueryBbox
:    [junit4]   2> 1067275 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQueryBbox
:    [junit4]   2> 1067279 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncHsin
:    [junit4]   2> 1067280 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncHsin
:    [junit4]   2> 1067285 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncTerms
:    [junit4]   2> 1067316 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncTerms
:    [junit4]   2> 1067321 T2891 oas.SolrTestCaseJ4.setUp ###Starting testReRankQuery
:    [junit4]   2> 1067341 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testReRankQuery
:    [junit4]   2> 1067345 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQueryMaxScore
:    [junit4]   2> 1067350 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQueryMaxScore
:    [junit4]   2> 1067355 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQueryCollapse
:    [junit4]   2> 1067373 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQueryCollapse
:    [junit4]   2> 1067378 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncCurrency
:    [junit4]   2> 1067385 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncCurrency
:    [junit4]   2> 1067389 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncSub
:    [junit4]   2> 1067391 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncSub
:    [junit4]   2> 1067395 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncDoubleValueMathFuncs
:    [junit4]   2> 1067403 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncDoubleValueMathFuncs
:    [junit4]   2> 1067408 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncProduct
:    [junit4]   2> 1067409 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncProduct
:    [junit4]   2> 1067414 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQuerySurround
:    [junit4]   2> 1067669 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQuerySurround
:    [junit4]   2> 1067674 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncField
:    [junit4]   2> 1067675 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncField
:    [junit4]   2> 1067680 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncJoindf
:    [junit4]   2> 1067680 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncJoindf
:    [junit4]   2> 1067685 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncMax
:    [junit4]   2> 1067686 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncMax
:    [junit4]   2> 1067691 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncQuery
:    [junit4]   2> 1067692 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncQuery
:    [junit4]   2> 1067697 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncScale
:    [junit4]   2> 1067706 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncScale
:    [junit4]   2> 1067711 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncMathConsts
:    [junit4]   2> 1067712 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncMathConsts
:    [junit4]   2> 1067716 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncBools
:    [junit4]   2> 1067717 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncBools
:    [junit4]   2> 1067722 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncStrdist
:    [junit4]   2> 1067738 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncStrdist
:    [junit4]   2> 1067743 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQuerySwitch
:    [junit4]   2> 1067746 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQuerySwitch
:    [junit4]   2> 1067751 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQueryFunc
:    [junit4]   2> 1067753 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQueryFunc
:    [junit4]   2> 1067757 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncSttf
:    [junit4]   2> 1067758 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncSttf
:    [junit4]   2> 1067760 T2891 oas.SolrTestCaseJ4.deleteCore ###deleteCore
:    [junit4]   2> 1067760 T2891 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=830398897
:    [junit4]   2> 1067761 T2891 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1b4d383e
:    [junit4]   2> 1067775 T2891 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
:    [junit4]   2> 1067775 T2891 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
:    [junit4]   2> 1067775 T2891 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
:    [junit4]   2> 1067775 T2891 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
:    [junit4]   2> 1067777 T2891 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
:    [junit4]   2> 1067777 T2891 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
:    [junit4]   2> 1067777 T2891 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.search.QueryEqualityTest-894023E3DFD774C6-001/init-core-data-001 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.search.QueryEqualityTest-894023E3DFD774C6-001/init-core-data-001;done=false>>]
:    [junit4]   2> 1067778 T2891 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.search.QueryEqualityTest-894023E3DFD774C6-001/init-core-data-001
:    [junit4]   2> 1067778 T2891 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.search.QueryEqualityTest-894023E3DFD774C6-001/init-core-data-001/index [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.search.QueryEqualityTest-894023E3DFD774C6-001/init-core-data-001/index;done=false>>]
:    [junit4]   2> 1067778 T2891 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.search.QueryEqualityTest-894023E3DFD774C6-001/init-core-data-001/index
:    [junit4]   2> NOTE: test params are: codec=Lucene49: {}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=en_PH, timezone=America/Port-au-Prince
:    [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_60 (64-bit)/cpus=16,threads=1,free=392664904,total=459276288
:    [junit4]   2> NOTE: All tests run in this JVM: [DirectUpdateHandlerTest, CoreAdminCreateDiscoverTest, TestQuerySenderListener, MinimalSchemaTest, TestSolrDeletionPolicy1, CollectionsAPIDistributedZkTest, TestLuceneMatchVersion, TestQuerySenderNoQuery, TestManagedStopFilterFactory, TestDynamicFieldCollectionResource, TestSearchPerf, SortByFunctionTest, TestStressRecovery, TestCustomSort, SuggesterFSTTest, TestFaceting, TestStressLucene, TestChildDocTransformer, DirectSolrConnectionTest, EnumFieldTest, SolrIndexSplitterTest, IndexBasedSpellCheckerTest, TestDocSet, DocValuesMultiTest, CustomCollectionTest, LegacyHTMLStripCharFilterTest, TestSchemaVersionResource, ConnectionManagerTest, TestMergePolicyConfig, TestPseudoReturnFields, TestFieldSortValues, OverseerRolesTest, DateFieldTest, TermVectorComponentDistributedTest, TestIBSimilarityFactory, TestSolrXmlPersistence, FieldAnalysisRequestHandlerTest, DistribCursorPagingTest, SimpleFacetsTest, DistanceFunctionTest, TestSolrXMLSeria
 lizer, TestExtendedDismaxParser, HdfsBasicDistributedZk2Test, DocumentBuilderTest, FileUtilsTest, UpdateParamsTest, DocumentAnalysisRequestHandlerTest, UnloadDistributedZkTest, CircularListTest, ZkNodePropsTest, ScriptEngineTest, BasicZkTest, DistributedQueryComponentOptimizationTest, TestCSVResponseWriter, ParsingFieldUpdateProcessorsTest, HdfsRecoveryZkTest, OverseerStatusTest, StatsComponentTest, TestWriterPerf, ClusterStateUpdateTest, TestUniqueKeyFieldResource, TestNumberUtils, QueryEqualityTest]
:    [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=QueryEqualityTest -Dtests.seed=894023E3DFD774C6 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_PH -Dtests.timezone=America/Port-au-Prince -Dtests.file.encoding=ISO-8859-1
:    [junit4] ERROR   0.00s J0 | QueryEqualityTest (suite) <<<
:    [junit4]    > Throwable #1: java.lang.AssertionError: testParserCoverage was run w/o any other method explicitly testing qparser: terms
:    [junit4]    > 	at __randomizedtesting.SeedInfo.seed([894023E3DFD774C6]:0)
:    [junit4]    > 	at org.apache.solr.search.QueryEqualityTest.afterClassParserCoverageTest(QueryEqualityTest.java:62)
:    [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
:    [junit4] Completed on J0 in 2.65s, 70 tests, 1 failure <<< FAILURES!
: 
: [...truncated 383 lines...]
:    [junit4] Suite: org.apache.solr.cloud.MultiThreadedOCPTest
:    [junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/init-core-data-001
:    [junit4]   2> 3591190 T5910 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
:    [junit4]   2> 3591191 T5910 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
:    [junit4]   2> 3591195 T5910 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
:    [junit4]   2> 3591196 T5910 oasc.ZkTestServer.run STARTING ZK TEST SERVER
:    [junit4]   1> client port:0.0.0.0/0.0.0.0:0
:    [junit4]   2> 3591197 T5911 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
:    [junit4]   2> 3591297 T5910 oasc.ZkTestServer.run start zk server on port:53984
:    [junit4]   2> 3591298 T5910 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
:    [junit4]   2> 3591301 T5917 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4230cb67 name:ZooKeeperConnection Watcher:127.0.0.1:53984 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 3591301 T5910 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
:    [junit4]   2> 3591301 T5910 oascc.SolrZkClient.makePath makePath: /solr
:    [junit4]   2> 3591305 T5910 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
:    [junit4]   2> 3591305 T5919 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@719a6a80 name:ZooKeeperConnection Watcher:127.0.0.1:53984/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 3591306 T5910 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
:    [junit4]   2> 3591306 T5910 oascc.SolrZkClient.makePath makePath: /collections/collection1
:    [junit4]   2> 3591308 T5910 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
:    [junit4]   2> 3591309 T5910 oascc.SolrZkClient.makePath makePath: /collections/control_collection
:    [junit4]   2> 3591311 T5910 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
:    [junit4]   2> 3591313 T5910 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
:    [junit4]   2> 3591313 T5910 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
:    [junit4]   2> 3591316 T5910 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
:    [junit4]   2> 3591317 T5910 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
:    [junit4]   2> 3591419 T5910 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
:    [junit4]   2> 3591419 T5910 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
:    [junit4]   2> 3591421 T5910 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
:    [junit4]   2> 3591422 T5910 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
:    [junit4]   2> 3591424 T5910 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
:    [junit4]   2> 3591424 T5910 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
:    [junit4]   2> 3591426 T5910 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
:    [junit4]   2> 3591427 T5910 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
:    [junit4]   2> 3591429 T5910 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
:    [junit4]   2> 3591429 T5910 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
:    [junit4]   2> 3591431 T5910 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
:    [junit4]   2> 3591432 T5910 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
:    [junit4]   2> 3591434 T5910 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
:    [junit4]   2> 3591434 T5910 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
:    [junit4]   2> 3591436 T5910 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
:    [junit4]   2> 3591437 T5910 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
:    [junit4]   2> 3591438 T5910 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
:    [junit4]   2> 3591439 T5910 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
:    [junit4]   2> 3592574 T5910 oejs.Server.doStart jetty-8.1.10.v20130312
:    [junit4]   2> 3592578 T5910 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:44580
:    [junit4]   2> 3592579 T5910 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
:    [junit4]   2> 3592579 T5910 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
:    [junit4]   2> 3592579 T5910 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-002
:    [junit4]   2> 3592579 T5910 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-002/'
:    [junit4]   2> 3592609 T5910 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-002/solr.xml
:    [junit4]   2> 3592662 T5910 oasc.CoreContainer.<init> New CoreContainer 1199701395
:    [junit4]   2> 3592662 T5910 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-002/]
:    [junit4]   2> 3592663 T5910 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
:    [junit4]   2> 3592664 T5910 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
:    [junit4]   2> 3592664 T5910 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
:    [junit4]   2> 3592664 T5910 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
:    [junit4]   2> 3592664 T5910 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
:    [junit4]   2> 3592665 T5910 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
:    [junit4]   2> 3592665 T5910 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
:    [junit4]   2> 3592665 T5910 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
:    [junit4]   2> 3592665 T5910 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
:    [junit4]   2> 3592666 T5910 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
:    [junit4]   2> 3592666 T5910 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
:    [junit4]   2> 3592666 T5910 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
:    [junit4]   2> 3592667 T5910 oasc.CoreContainer.load Host Name: 127.0.0.1
:    [junit4]   2> 3592667 T5910 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53984/solr
:    [junit4]   2> 3592667 T5910 oasc.ZkController.checkChrootPath zkHost includes chroot
:    [junit4]   2> 3592668 T5910 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
:    [junit4]   2> 3592669 T5930 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@272ee292 name:ZooKeeperConnection Watcher:127.0.0.1:53984 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 3592670 T5910 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
:    [junit4]   2> 3592672 T5910 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
:    [junit4]   2> 3592672 T5932 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14120bea name:ZooKeeperConnection Watcher:127.0.0.1:53984/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 3592673 T5910 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
:    [junit4]   2> 3592674 T5910 oascc.SolrZkClient.makePath makePath: /overseer/queue
:    [junit4]   2> 3592676 T5910 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
:    [junit4]   2> 3592678 T5910 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
:    [junit4]   2> 3592680 T5910 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
:    [junit4]   2> 3592681 T5910 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
:    [junit4]   2> 3592683 T5910 oascc.SolrZkClient.makePath makePath: /live_nodes
:    [junit4]   2> 3592684 T5910 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44580_
:    [junit4]   2> 3592685 T5910 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:44580_
:    [junit4]   2> 3592687 T5910 oascc.SolrZkClient.makePath makePath: /overseer_elect
:    [junit4]   2> 3592688 T5910 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
:    [junit4]   2> 3592690 T5910 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:44580_
:    [junit4]   2> 3592691 T5910 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
:    [junit4]   2> 3592692 T5910 oasc.Overseer.start Overseer (id=92238083035824131-127.0.0.1:44580_-n_0000000000) starting
:    [junit4]   2> 3592694 T5910 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
:    [junit4]   2> 3592699 T5934 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
:    [junit4]   2> 3592700 T5910 oascc.SolrZkClient.makePath makePath: /clusterstate.json
:    [junit4]   2> 3592701 T5910 oascc.SolrZkClient.makePath makePath: /aliases.json
:    [junit4]   2> 3592703 T5910 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
:    [junit4]   2> 3592704 T5933 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
:    [junit4]   2> 3592709 T5935 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
:    [junit4]   2> 3592709 T5935 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
:    [junit4]   2> 3592710 T5935 oasc.ZkController.waitForCoreNodeName look for our core node name
:    [junit4]   2> 3592710 T5936 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
:    [junit4]   2> 3592711 T5933 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
:    [junit4]   2> 3592712 T5933 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
:    [junit4]   2> 	  "operation":"state",
:    [junit4]   2> 	  "state":"down",
:    [junit4]   2> 	  "base_url":"http://127.0.0.1:44580",
:    [junit4]   2> 	  "core":"collection1",
:    [junit4]   2> 	  "roles":null,
:    [junit4]   2> 	  "node_name":"127.0.0.1:44580_",
:    [junit4]   2> 	  "shard":null,
:    [junit4]   2> 	  "collection":"control_collection",
:    [junit4]   2> 	  "numShards":"1",
:    [junit4]   2> 	  "core_node_name":null}
:    [junit4]   2> 3592712 T5933 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
:    [junit4]   2> 3592712 T5933 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
:    [junit4]   2> 3592714 T5936 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
:    [junit4]   2> 3592714 T5936 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
:    [junit4]   2> 3593710 T5935 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
:    [junit4]   2> 3593711 T5935 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
:    [junit4]   2> 3593712 T5935 oasc.ZkController.createCollectionZkNode Collection zkNode exists
:    [junit4]   2> 3593712 T5935 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
:    [junit4]   2> 3593713 T5935 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
:    [junit4]   2> 3593713 T5935 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-002/collection1/'
:    [junit4]   2> 3593714 T5935 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-002/collection1/lib/classes/' to classloader
:    [junit4]   2> 3593715 T5935 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-002/collection1/lib/.svn/' to classloader
:    [junit4]   2> 3593715 T5935 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-002/collection1/lib/README' to classloader
:    [junit4]   2> 3593779 T5935 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
:    [junit4]   2> 3593827 T5935 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
:    [junit4]   2> 3593928 T5935 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
:    [junit4]   2> 3593939 T5935 oass.IndexSchema.readSchema [collection1] Schema name=test
:    [junit4]   2> 3594409 T5935 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
:    [junit4]   2> 3594410 T5935 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
:    [junit4]   2> 3594411 T5935 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
:    [junit4]   2> 3594423 T5935 oass.IndexSchema.readSchema default search field in schema is text
:    [junit4]   2> 3594427 T5935 oass.IndexSchema.readSchema unique key field: id
:    [junit4]   2> 3594438 T5935 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
:    [junit4]   2> 3594442 T5935 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
:    [junit4]   2> 3594446 T5935 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
:    [junit4]   2> 3594447 T5935 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
:    [junit4]   2> 3594447 T5935 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
:    [junit4]   2> 3594448 T5935 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
:    [junit4]   2> 3594449 T5935 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
:    [junit4]   2> 3594449 T5935 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
:    [junit4]   2> 3594449 T5935 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
:    [junit4]   2> 3594449 T5935 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
:    [junit4]   2> 3594450 T5935 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-002/collection1/, dataDir=./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-001/control/data/
:    [junit4]   2> 3594450 T5935 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bde656e
:    [junit4]   2> 3594451 T5935 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-001/control/data
:    [junit4]   2> 3594451 T5935 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-001/control/data/index/
:    [junit4]   2> 3594451 T5935 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
:    [junit4]   2> 3594451 T5935 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-001/control/data/index
:    [junit4]   2> 3594452 T5935 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=16, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
:    [junit4]   2> 3594453 T5935 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
:    [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@5de6da92 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@78db4089),segFN=segments_1,generation=1}
:    [junit4]   2> 3594453 T5935 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
:    [junit4]   2> 3594457 T5935 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
:    [junit4]   2> 3594457 T5935 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
:    [junit4]   2> 3594457 T5935 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
:    [junit4]   2> 3594458 T5935 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
:    [junit4]   2> 3594458 T5935 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
:    [junit4]   2> 3594458 T5935 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
:    [junit4]   2> 3594459 T5935 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
:    [junit4]   2> 3594459 T5935 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
:    [junit4]   2> 3594459 T5935 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
:    [junit4]   2> 3594460 T5935 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
:    [junit4]   2> 3594460 T5935 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
:    [junit4]   2> 3594461 T5935 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
:    [junit4]   2> 3594461 T5935 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
:    [junit4]   2> 3594462 T5935 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
:    [junit4]   2> 3594462 T5935 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
:    [junit4]   2> 3594462 T5935 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
:    [junit4]   2> 3594463 T5935 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
:    [junit4]   2> 3594463 T5935 oasc.RequestHandlers.initHandlersFromConfig WARN Multiple requestHandler registered to the same name: /update ignoring: org.apache.solr.handler.UpdateRequestHandler
:    [junit4]   2> 3594463 T5935 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
:    [junit4]   2> 3594464 T5935 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
:    [junit4]   2> 3594464 T5935 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
:    [junit4]   2> 3594483 T5935 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
:    [junit4]   2> 3594485 T5935 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
:    [junit4]   2> 3594487 T5935 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
:    [junit4]   2> 3594489 T5935 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
:    [junit4]   2> 3594491 T5935 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
:    [junit4]   2> 3594497 T5935 oasu.CommitTracker.<init> Hard AutoCommit: disabled
:    [junit4]   2> 3594497 T5935 oasu.CommitTracker.<init> Soft AutoCommit: disabled
:    [junit4]   2> 3594498 T5935 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=43, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.33125372141014287]
:    [junit4]   2> 3594499 T5935 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
:    [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@5de6da92 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@78db4089),segFN=segments_1,generation=1}
:    [junit4]   2> 3594499 T5935 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
:    [junit4]   2> 3594499 T5935 oass.SolrIndexSearcher.<init> Opening Searcher@7900b887[collection1] main
:    [junit4]   2> 3594500 T5935 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
:    [junit4]   2> 3594500 T5935 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
:    [junit4]   2> 3594501 T5935 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
:    [junit4]   2> 3594501 T5935 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
:    [junit4]   2> 3594501 T5935 oasr.RestManager.init Initializing RestManager with initArgs: {}
:    [junit4]   2> 3594502 T5935 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
:    [junit4]   2> 3594502 T5935 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
:    [junit4]   2> 3594502 T5935 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
:    [junit4]   2> 3594503 T5935 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
:    [junit4]   2> 3594505 T5935 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
:    [junit4]   2> 3594505 T5935 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
:    [junit4]   2> 3594505 T5935 oasr.RestManager.init Initializing 0 registered ManagedResources
:    [junit4]   2> 3594508 T5937 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7900b887[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
:    [junit4]   2> 3594511 T5935 oasc.CoreContainer.registerCore registering core: collection1
:    [junit4]   2> 3594512 T5940 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:44580 collection:control_collection shard:shard1
:    [junit4]   2> 3594513 T5910 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
:    [junit4]   2> 3594513 T5910 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
:    [junit4]   2> 3594513 T5940 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
:    [junit4]   2> 3594514 T5910 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
:    [junit4]   2> 3594516 T5942 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@46bab9b4 name:ZooKeeperConnection Watcher:127.0.0.1:53984/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 3594516 T5910 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
:    [junit4]   2> 3594517 T5910 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
:    [junit4]   2> 3594518 T5940 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
:    [junit4]   2> 3594519 T5910 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
:    [junit4]   2> 3594520 T5936 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
:    [junit4]   2> 3594520 T5940 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
:    [junit4]   2> 3594520 T5940 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
:    [junit4]   2> ASYNC  NEW_CORE C1128 name=collection1 org.apache.solr.core.SolrCore@24159ed7 url=http://127.0.0.1:44580/collection1 node=127.0.0.1:44580_ C1128_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:44580, core=collection1, node_name=127.0.0.1:44580_}
:    [junit4]   2> 3594520 T5940 C1128 P44580 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:44580/collection1/
:    [junit4]   2> 3594521 T5940 C1128 P44580 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
:    [junit4]   2> 3594521 T5933 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
:    [junit4]   2> 3594521 T5940 C1128 P44580 oasc.SyncStrategy.syncToMe http://127.0.0.1:44580/collection1/ has no replicas
:    [junit4]   2> 3594521 T5940 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:44580/collection1/ shard1
:    [junit4]   2> 3594521 T5940 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
:    [junit4]   2> 3594523 T5936 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
:    [junit4]   2> 3594523 T5936 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
:    [junit4]   2> 3594523 T5943 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
:    [junit4]   2> 3594527 T5933 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
:    [junit4]   2> 3594528 T5936 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
:    [junit4]   2> 3594630 T5936 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
:    [junit4]   2> 3594630 T5943 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
:    [junit4]   2> 3594679 T5940 oasc.ZkController.register We are http://127.0.0.1:44580/collection1/ and leader is http://127.0.0.1:44580/collection1/
:    [junit4]   2> 3594680 T5940 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:44580
:    [junit4]   2> 3594680 T5940 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
:    [junit4]   2> 3594680 T5940 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
:    [junit4]   2> 3594680 T5940 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
:    [junit4]   2> 3594681 T5936 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
:    [junit4]   2> 3594682 T5936 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
:    [junit4]   2> 3594682 T5940 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
:    [junit4]   2> 3594682 T5944 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
:    [junit4]   2> 3594683 T5933 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
:    [junit4]   2> 3594683 T5933 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
:    [junit4]   2> 	  "operation":"state",
:    [junit4]   2> 	  "state":"active",
:    [junit4]   2> 	  "base_url":"http://127.0.0.1:44580",
:    [junit4]   2> 	  "core":"collection1",
:    [junit4]   2> 	  "roles":null,
:    [junit4]   2> 	  "node_name":"127.0.0.1:44580_",
:    [junit4]   2> 	  "shard":"shard1",
:    [junit4]   2> 	  "collection":"control_collection",
:    [junit4]   2> 	  "numShards":"2",
:    [junit4]   2> 	  "core_node_name":"core_node1"}
:    [junit4]   2> 3594685 T5944 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
:    [junit4]   2> 3594786 T5944 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
:    [junit4]   2> 3594786 T5943 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
:    [junit4]   2> 3595631 T5910 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
:    [junit4]   2> 3595632 T5910 oejs.Server.doStart jetty-8.1.10.v20130312
:    [junit4]   2> 3595635 T5910 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:27736
:    [junit4]   2> 3595635 T5910 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
:    [junit4]   2> 3595636 T5910 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
:    [junit4]   2> 3595636 T5910 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003
:    [junit4]   2> 3595636 T5910 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/'
:    [junit4]   2> 3595665 T5910 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/solr.xml
:    [junit4]   2> 3595719 T5910 oasc.CoreContainer.<init> New CoreContainer 770910585
:    [junit4]   2> 3595719 T5910 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/]
:    [junit4]   2> 3595720 T5910 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
:    [junit4]   2> 3595720 T5910 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
:    [junit4]   2> 3595721 T5910 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
:    [junit4]   2> 3595721 T5910 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
:    [junit4]   2> 3595721 T5910 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
:    [junit4]   2> 3595721 T5910 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
:    [junit4]   2> 3595722 T5910 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
:    [junit4]   2> 3595722 T5910 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
:    [junit4]   2> 3595722 T5910 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
:    [junit4]   2> 3595723 T5910 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
:    [junit4]   2> 3595723 T5910 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
:    [junit4]   2> 3595723 T5910 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
:    [junit4]   2> 3595723 T5910 oasc.CoreContainer.load Host Name: 127.0.0.1
:    [junit4]   2> 3595724 T5910 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53984/solr
:    [junit4]   2> 3595724 T5910 oasc.ZkController.checkChrootPath zkHost includes chroot
:    [junit4]   2> 3595725 T5910 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
:    [junit4]   2> 3595726 T5955 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3727de80 name:ZooKeeperConnection Watcher:127.0.0.1:53984 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 3595727 T5910 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
:    [junit4]   2> 3595729 T5910 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
:    [junit4]   2> 3595730 T5957 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a404f0c name:ZooKeeperConnection Watcher:127.0.0.1:53984/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 3595730 T5910 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
:    [junit4]   2> 3595735 T5910 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
:    [junit4]   2> 3596738 T5910 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:27736_
:    [junit4]   2> 3596739 T5910 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:27736_
:    [junit4]   2> 3596741 T5944 oascc.ZkStateReader$3.process Updating live nodes... (2)
:    [junit4]   2> 3596742 T5958 oascc.ZkStateReader$3.process Updating live nodes... (2)
:    [junit4]   2> 3596742 T5943 oascc.ZkStateReader$3.process Updating live nodes... (2)
:    [junit4]   2> 3596748 T5959 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
:    [junit4]   2> 3596748 T5959 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
:    [junit4]   2> 3596749 T5944 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
:    [junit4]   2> 3596750 T5960 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
:    [junit4]   2> 3596749 T5959 oasc.ZkController.waitForCoreNodeName look for our core node name
:    [junit4]   2> 3596749 T5936 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
:    [junit4]   2> 3596751 T5933 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
:    [junit4]   2> 3596751 T5933 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
:    [junit4]   2> 	  "operation":"state",
:    [junit4]   2> 	  "state":"down",
:    [junit4]   2> 	  "base_url":"http://127.0.0.1:27736",
:    [junit4]   2> 	  "core":"collection1",
:    [junit4]   2> 	  "roles":null,
:    [junit4]   2> 	  "node_name":"127.0.0.1:27736_",
:    [junit4]   2> 	  "shard":null,
:    [junit4]   2> 	  "collection":"collection1",
:    [junit4]   2> 	  "numShards":"2",
:    [junit4]   2> 	  "core_node_name":null}
:    [junit4]   2> 3596751 T5933 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
:    [junit4]   2> 3596752 T5933 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
:    [junit4]   2> 3596753 T5936 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
:    [junit4]   2> 3596754 T5936 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
:    [junit4]   2> 3596754 T5958 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
:    [junit4]   2> 3596754 T5943 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
:    [junit4]   2> 3597750 T5959 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
:    [junit4]   2> 3597751 T5959 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
:    [junit4]   2> 3597751 T5959 oasc.ZkController.createCollectionZkNode Collection zkNode exists
:    [junit4]   2> 3597752 T5959 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
:    [junit4]   2> 3597752 T5959 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
:    [junit4]   2> 3597753 T5959 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/collection1/'
:    [junit4]   2> 3597754 T5959 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/collection1/lib/classes/' to classloader
:    [junit4]   2> 3597755 T5959 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/collection1/lib/.svn/' to classloader
:    [junit4]   2> 3597755 T5959 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/collection1/lib/README' to classloader
:    [junit4]   2> 3597819 T5959 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
:    [junit4]   2> 3597883 T5959 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
:    [junit4]   2> 3597984 T5959 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
:    [junit4]   2> 3597995 T5959 oass.IndexSchema.readSchema [collection1] Schema name=test
:    [junit4]   2> 3598432 T5959 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
:    [junit4]   2> 3598433 T5959 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
:    [junit4]   2> 3598433 T5959 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
:    [junit4]   2> 3598446 T5959 oass.IndexSchema.readSchema default search field in schema is text
:    [junit4]   2> 3598449 T5959 oass.IndexSchema.readSchema unique key field: id
:    [junit4]   2> 3598460 T5959 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
:    [junit4]   2> 3598465 T5959 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
:    [junit4]   2> 3598469 T5959 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
:    [junit4]   2> 3598469 T5959 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
:    [junit4]   2> 3598470 T5959 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
:    [junit4]   2> 3598470 T5959 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
:    [junit4]   2> 3598471 T5959 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
:    [junit4]   2> 3598471 T5959 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
:    [junit4]   2> 3598471 T5959 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
:    [junit4]   2> 3598471 T5959 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
:    [junit4]   2> 3598472 T5959 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/collection1/, dataDir=./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/collection1/data/
:    [junit4]   2> 3598472 T5959 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bde656e
:    [junit4]   2> 3598473 T5959 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/collection1/data
:    [junit4]   2> 3598473 T5959 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/collection1/data/index/
:    [junit4]   2> 3598473 T5959 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/collection1/data/index' doesn't exist. Creating new index...
:    [junit4]   2> 3598474 T5959 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/collection1/data/index
:    [junit4]   2> 3598474 T5959 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=16, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
:    [junit4]   2> 3598475 T5959 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
:    [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@34b9c3ed lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@175c4ba0),segFN=segments_1,generation=1}
:    [junit4]   2> 3598475 T5959 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
:    [junit4]   2> 3598480 T5959 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
:    [junit4]   2> 3598480 T5959 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
:    [junit4]   2> 3598480 T5959 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
:    [junit4]   2> 3598480 T5959 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
:    [junit4]   2> 3598481 T5959 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
:    [junit4]   2> 3598481 T5959 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
:    [junit4]   2> 3598481 T5959 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
:    [junit4]   2> 3598482 T5959 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
:    [junit4]   2> 3598482 T5959 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
:    [junit4]   2> 3598483 T5959 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
:    [junit4]   2> 3598483 T5959 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
:    [junit4]   2> 3598484 T5959 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
:    [junit4]   2> 3598484 T5959 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
:    [junit4]   2> 3598485 T5959 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
:    [junit4]   2> 3598486 T5959 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
:    [junit4]   2> 3598486 T5959 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
:    [junit4]   2> 3598486 T5959 oasc.RequestHandlers.initHandlersFromConfig create
: 
: [...truncated too long message...]
: 
: 3645985 T5910 oasc.CachingDirectoryFactory.close Closing directory: ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-006/ocptest1_shard3_replica1/data/index
:    [junit4]   2> 3645986 T5910 oasc.SolrCore.close [ocptest_shardsplit_shard4_replica1]  CLOSING SolrCore org.apache.solr.core.SolrCore@2cc6d31a
:    [junit4]   2> 3645994 T5910 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
:    [junit4]   2> 3645994 T5910 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
:    [junit4]   2> 3645994 T5910 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
:    [junit4]   2> 3645995 T5910 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
:    [junit4]   2> 3645995 T5910 oasc.SolrCore.closeSearcher [ocptest_shardsplit_shard4_replica1] Closing main searcher on request.
:    [junit4]   2> 3645996 T5910 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
:    [junit4]   2> 3645996 T5910 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-006/ocptest_shardsplit_shard4_replica1/data/index [CachedDir<<refCount=0;path=./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-006/ocptest_shardsplit_shard4_replica1/data/index;done=false>>]
:    [junit4]   2> 3645997 T5910 oasc.CachingDirectoryFactory.close Closing directory: ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-006/ocptest_shardsplit_shard4_replica1/data/index
:    [junit4]   2> 3645997 T5910 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-006/ocptest_shardsplit_shard4_replica1/data [CachedDir<<refCount=0;path=./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-006/ocptest_shardsplit_shard4_replica1/data;done=false>>]
:    [junit4]   2> 3645997 T5910 oasc.CachingDirectoryFactory.close Closing directory: ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-006/ocptest_shardsplit_shard4_replica1/data
:    [junit4]   2> 3645998 T7442 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:18528_
:    [junit4]   2> 3646000 T7437 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
:    [junit4]   2> 3646000 T7444 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
:    [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
:    [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
:    [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
:    [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:302)
:    [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:299)
:    [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
:    [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:299)
:    [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:316)
:    [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
:    [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:288)
:    [junit4]   2> 
:    [junit4]   2> 3646001 T5910 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
:    [junit4]   2> 3650916 T5910 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
:    [junit4]   2> 3650918 T5910 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:53984 53984
:    [junit4]   2> 3651144 T5911 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:53984 53984
:    [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=MultiThreadedOCPTest -Dtests.method=testDistribSearch -Dtests.seed=894023E3DFD774C6 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar_DZ -Dtests.timezone=Europe/Vilnius -Dtests.file.encoding=ISO-8859-1
:    [junit4] FAILURE 60.0s J0 | MultiThreadedOCPTest.testDistribSearch <<<
:    [junit4]    > Throwable #1: java.lang.AssertionError: We have a failed SPLITSHARD task
:    [junit4]    > 	at __randomizedtesting.SeedInfo.seed([894023E3DFD774C6:8A6ADFBA88814FA]:0)
:    [junit4]    > 	at org.apache.solr.cloud.MultiThreadedOCPTest.testTaskExclusivity(MultiThreadedOCPTest.java:125)
:    [junit4]    > 	at org.apache.solr.cloud.MultiThreadedOCPTest.doTest(MultiThreadedOCPTest.java:71)
:    [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
:    [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
:    [junit4]   2> 3651162 T5910 oas.SolrTestCaseJ4.deleteCore ###deleteCore
:    [junit4]   2> NOTE: leaving temporary files on disk at: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001
:    [junit4]   2> 59977 T5909 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
:    [junit4]   2> NOTE: test params are: codec=Lucene41, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=ar_DZ, timezone=Europe/Vilnius
:    [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_60 (64-bit)/cpus=16,threads=1,free=278470064,total=529530880
:    [junit4]   2> NOTE: All tests run in this JVM: [DirectUpdateHandlerTest, CoreAdminCreateDiscoverTest, TestQuerySenderListener, MinimalSchemaTest, TestSolrDeletionPolicy1, CollectionsAPIDistributedZkTest, TestLuceneMatchVersion, TestQuerySenderNoQuery, TestManagedStopFilterFactory, TestDynamicFieldCollectionResource, TestSearchPerf, SortByFunctionTest, TestStressRecovery, TestCustomSort, SuggesterFSTTest, TestFaceting, TestStressLucene, TestChildDocTransformer, DirectSolrConnectionTest, EnumFieldTest, SolrIndexSplitterTest, IndexBasedSpellCheckerTest, TestDocSet, DocValuesMultiTest, CustomCollectionTest, LegacyHTMLStripCharFilterTest, TestSchemaVersionResource, ConnectionManagerTest, TestMergePolicyConfig, TestPseudoReturnFields, TestFieldSortValues, OverseerRolesTest, DateFieldTest, TermVectorComponentDistributedTest, TestIBSimilarityFactory, TestSolrXmlPersistence, FieldAnalysisRequestHandlerTest, DistribCursorPagingTest, SimpleFacetsTest, DistanceFunctionTest, TestSolrXMLSeria
 lizer, TestExtendedDismaxParser, HdfsBasicDistributedZk2Test, DocumentBuilderTest, FileUtilsTest, UpdateParamsTest, DocumentAnalysisRequestHandlerTest, UnloadDistributedZkTest, CircularListTest, ZkNodePropsTest, ScriptEngineTest, BasicZkTest, DistributedQueryComponentOptimizationTest, TestCSVResponseWriter, ParsingFieldUpdateProcessorsTest, HdfsRecoveryZkTest, OverseerStatusTest, StatsComponentTest, TestWriterPerf, ClusterStateUpdateTest, TestUniqueKeyFieldResource, TestNumberUtils, QueryEqualityTest, DocExpirationUpdateProcessorFactoryTest, TestComponentsName, TestConfigSets, RequiredFieldsTest, TestRestManager, TestLMJelinekMercerSimilarityFactory, DateMathParserTest, SuggestComponentTest, LeaderElectionTest, MergeStrategyTest, ReplicationFactorTest, URLClassifyProcessorTest, TestFileDictionaryLookup, PrimUtilsTest, BlockCacheTest, SuggesterTest, SolrIndexConfigTest, FastVectorHighlighterTest, TestSolr4Spatial, BasicDistributedZkTest, TestUtils, BasicFunctionalityTest, BlockDirect
 oryTest, TestRecovery, ExternalFileFieldSortTest, TestGroupingSearch, TestSolrJ, DistributedDebugComponentTest, TestSchemaSimilarityResource, CoreMergeIndexesAdminHandlerTest, TestDocumentBuilder, TestSolr4Spatial2, TestSolrDeletionPolicy2, TestManagedResourceStorage, TestCharFilters, UniqFieldsUpdateProcessorFactoryTest, ShardSplitTest, TestCloudManagedSchemaConcurrent, MultiThreadedOCPTest]
:    [junit4] Completed on J0 in 60.51s, 1 test, 1 failure <<< FAILURES!
: 
: [...truncated 627 lines...]
: BUILD FAILED
: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:474: The following error occurred while executing this line:
: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:454: The following error occurred while executing this line:
: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:45: The following error occurred while executing this line:
: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/extra-targets.xml:37: The following error occurred while executing this line:
: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:189: The following error occurred while executing this line:
: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:496: The following error occurred while executing this line:
: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1299: The following error occurred while executing this line:
: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:923: There were test failures: 411 suites, 1711 tests, 1 suite-level error, 1 failure, 53 ignored (19 assumptions)
: 
: Total time: 123 minutes 13 seconds
: Build step 'Invoke Ant' marked build as failure
: Archiving artifacts
: Sending artifact delta relative to Lucene-Solr-Tests-4.x-Java7 #2040
: Archived 3 artifacts
: Archive block size is 32768
: Received 0 blocks and 196987264 bytes
: Compression is 0.0%
: Took 36 sec
: Recording test results
: Email was triggered for: Failure
: Sending email for trigger: Failure
: 
: 
: 

-Hoss
http://www.lucidworks.com/

[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 2049 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/2049/

2 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.search.QueryEqualityTest

Error Message:
testParserCoverage was run w/o any other method explicitly testing qparser: terms

Stack Trace:
java.lang.AssertionError: testParserCoverage was run w/o any other method explicitly testing qparser: terms
	at __randomizedtesting.SeedInfo.seed([894023E3DFD774C6]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.search.QueryEqualityTest.afterClassParserCoverageTest(QueryEqualityTest.java:62)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:790)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.MultiThreadedOCPTest.testDistribSearch

Error Message:
We have a failed SPLITSHARD task

Stack Trace:
java.lang.AssertionError: We have a failed SPLITSHARD task
	at __randomizedtesting.SeedInfo.seed([894023E3DFD774C6:8A6ADFBA88814FA]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.MultiThreadedOCPTest.testTaskExclusivity(MultiThreadedOCPTest.java:125)
	at org.apache.solr.cloud.MultiThreadedOCPTest.doTest(MultiThreadedOCPTest.java:71)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 13182 lines...]
   [junit4] Suite: org.apache.solr.search.QueryEqualityTest
   [junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.search.QueryEqualityTest-894023E3DFD774C6-001/init-core-data-001
   [junit4]   2> 1065206 T2891 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
   [junit4]   2> 1065208 T2891 oas.SolrTestCaseJ4.initCore ####initCore
   [junit4]   2> 1065208 T2891 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/'
   [junit4]   2> 1065209 T2891 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
   [junit4]   2> 1065210 T2891 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 1065210 T2891 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 1065344 T2891 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
   [junit4]   2> 1065414 T2891 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1065415 T2891 oass.IndexSchema.readSchema Reading Solr Schema from schema15.xml
   [junit4]   2> 1065425 T2891 oass.IndexSchema.readSchema [null] Schema name=test
   [junit4]   2> 1065818 T2891 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1065820 T2891 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1065822 T2891 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1065825 T2891 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1065836 T2891 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1065837 T2891 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr
   [junit4]   2> 1065837 T2891 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/'
   [junit4]   2> 1065878 T2891 oasc.CoreContainer.<init> New CoreContainer 830398897
   [junit4]   2> 1065878 T2891 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/]
   [junit4]   2> 1065879 T2891 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 1065879 T2891 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 1065879 T2891 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 1065879 T2891 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1065880 T2891 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1065880 T2891 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1065880 T2891 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1065880 T2891 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1065880 T2891 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1065883 T2891 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=30000&connTimeout=30000&retry=false
   [junit4]   2> 1065884 T2891 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1065884 T2891 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1065884 T2891 oasc.CoreContainer.load Host Name: 
   [junit4]   2> 1065888 T2892 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/'
   [junit4]   2> 1065890 T2892 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
   [junit4]   2> 1065890 T2892 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 1065890 T2892 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 1065950 T2892 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
   [junit4]   2> 1066019 T2892 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1066020 T2892 oass.IndexSchema.readSchema Reading Solr Schema from schema15.xml
   [junit4]   2> 1066031 T2892 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1066425 T2892 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1066428 T2892 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1066430 T2892 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1066435 T2892 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1066450 T2892 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/
   [junit4]   2> 1066450 T2892 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1066451 T2892 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.search.QueryEqualityTest-894023E3DFD774C6-001/init-core-data-001/
   [junit4]   2> 1066451 T2892 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bde656e
   [junit4]   2> 1066452 T2892 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.search.QueryEqualityTest-894023E3DFD774C6-001/init-core-data-001
   [junit4]   2> 1066452 T2892 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.search.QueryEqualityTest-894023E3DFD774C6-001/init-core-data-001/index/
   [junit4]   2> 1066452 T2892 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.search.QueryEqualityTest-894023E3DFD774C6-001/init-core-data-001/index' doesn't exist. Creating new index...
   [junit4]   2> 1066453 T2892 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.search.QueryEqualityTest-894023E3DFD774C6-001/init-core-data-001/index
   [junit4]   2> 1066454 T2892 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=12.4951171875, floorSegmentMB=2.103515625, forceMergeDeletesPctAllowed=8.686604790539262, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.17091186665069513
   [junit4]   2> 1066455 T2892 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@35a71706 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1beedab1)),segFN=segments_1,generation=1}
   [junit4]   2> 1066455 T2892 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1066455 T2892 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
   [junit4]   2> 1066459 T2892 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1066460 T2892 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1066460 T2892 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe-allfields"
   [junit4]   2> 1066460 T2892 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
   [junit4]   2> 1066461 T2892 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1066461 T2892 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1066461 T2892 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "uniq-fields"
   [junit4]   2> 1066461 T2892 oasup.UniqFieldsUpdateProcessorFactory.init WARN Use of the 'fields' init param in UniqFieldsUpdateProcessorFactory is deprecated, please use 'fieldName' (or another FieldMutatingUpdateProcessorFactory selector option) instead
   [junit4]   2> 1066462 T2892 oasup.UniqFieldsUpdateProcessorFactory.init Replacing 'fields' init param with (individual) 'fieldName' params
   [junit4]   2> 1066462 T2892 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
   [junit4]   2> 1066462 T2892 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1066463 T2892 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1066463 T2892 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1066463 T2892 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1066464 T2892 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1066464 T2892 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1066465 T2892 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1066465 T2892 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1066465 T2892 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1066466 T2892 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1066466 T2892 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1066467 T2892 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1066467 T2892 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
   [junit4]   2> 1066468 T2892 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
   [junit4]   2> 1066468 T2892 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1066469 T2892 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1066469 T2892 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
   [junit4]   2> 1066469 T2892 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
   [junit4]   2> 1066470 T2892 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
   [junit4]   2> 1066470 T2892 oasc.RequestHandlers.initHandlersFromConfig WARN Multiple requestHandler registered to the same name: /update ignoring: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1066470 T2892 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1066471 T2892 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1066471 T2892 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1066472 T2892 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1066472 T2892 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1066473 T2892 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1066473 T2892 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1066474 T2892 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1066474 T2892 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1066475 T2892 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
   [junit4]   2> 1066475 T2892 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
   [junit4]   2> 1066494 T2892 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1066496 T2892 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1066498 T2892 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1066500 T2892 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1066502 T2892 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1066504 T2892 oasc.SolrCore.initDeprecatedSupport WARN solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
   [junit4]   2> 1066506 T2892 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1066507 T2892 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1066507 T2892 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=49, maxMergeAtOnceExplicit=36, maxMergedSegmentMB=38.9736328125, floorSegmentMB=1.5791015625, forceMergeDeletesPctAllowed=25.466902262123792, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 1066508 T2892 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@35a71706 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1beedab1)),segFN=segments_1,generation=1}
   [junit4]   2> 1066508 T2892 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1066509 T2892 oass.SolrIndexSearcher.<init> Opening Searcher@32ea2a58[collection1] main
   [junit4]   2> 1066509 T2892 oasr.RestManager.init Initializing RestManager with initArgs: {storageIO=org.apache.solr.rest.ManagedResourceStorage$InMemoryStorageIO}
   [junit4]   2> 1066509 T2892 oasr.ManagedResourceStorage.load Reading _rest_managed.json using InMemoryStorage
   [junit4]   2> 1066510 T2892 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
   [junit4]   2> 1066510 T2892 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using InMemoryStorage
   [junit4]   2> 1066510 T2892 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1066510 T2892 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 1066531 T2892 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 1066579 T2893 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@32ea2a58[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1066582 T2892 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1066585 T2891 oas.SolrTestCaseJ4.initCore ####initCore end
   [junit4]   2> 1066589 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncGeodist
   [junit4]   2> 1066626 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncGeodist
   [junit4]   2> 1066632 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQueryLucene
   [junit4]   2> 1066635 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQueryLucene
   [junit4]   2> 1066640 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncOrd
   [junit4]   2> 1066640 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncOrd
   [junit4]   2> 1066645 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncMod
   [junit4]   2> 1066646 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncMod
   [junit4]   2> 1066651 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncCscore
   [junit4]   2> 1066658 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncCscore
   [junit4]   2> 1066663 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncDist
   [junit4]   2> 1066664 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncDist
   [junit4]   2> 1066668 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncExists
   [junit4]   2> 1066679 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncExists
   [junit4]   2> 1066684 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncMap
   [junit4]   2> 1066693 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncMap
   [junit4]   2> 1066698 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncRord
   [junit4]   2> 1066699 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncRord
   [junit4]   2> 1066704 T2891 oas.SolrTestCaseJ4.setUp ###Starting testField
   [junit4]   2> 1066704 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testField
   [junit4]   2> 1066709 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQueryComplexPhrase
   [junit4]   2> 1066860 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQueryComplexPhrase
   [junit4]   2> 1066865 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQuerySimple
   [junit4]   2> 1066887 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQuerySimple
   [junit4]   2> 1066892 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncGeohash
   [junit4]   2> 1066893 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncGeohash
   [junit4]   2> 1066898 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQueryDismax
   [junit4]   2> 1066906 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQueryDismax
   [junit4]   2> 1066911 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQueryGeofilt
   [junit4]   2> 1066915 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQueryGeofilt
   [junit4]   2> 1066921 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQueryPrefix
   [junit4]   2> 1066921 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQueryPrefix
   [junit4]   2> 1066936 T2891 oas.SolrTestCaseJ4.setUp ###Starting testTestFuncs
   [junit4]   2> 1066941 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testTestFuncs
   [junit4]   2> 1066946 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncSqedist
   [junit4]   2> 1066947 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncSqedist
   [junit4]   2> 1066952 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncSum
   [junit4]   2> 1066954 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncSum
   [junit4]   2> 1066959 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncIf
   [junit4]   2> 1066966 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncIf
   [junit4]   2> 1066971 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQueryBoost
   [junit4]   2> 1066980 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQueryBoost
   [junit4]   2> 1066985 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncDef
   [junit4]   2> 1067003 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncDef
   [junit4]   2> 1067008 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncNumdocs
   [junit4]   2> 1067017 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncNumdocs
   [junit4]   2> 1067022 T2891 oas.SolrTestCaseJ4.setUp ###Starting testDateMathParsingEquality
   [junit4]   2> 1067025 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testDateMathParsingEquality
   [junit4]   2> 1067029 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncMin
   [junit4]   2> 1067031 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncMin
   [junit4]   2> 1067036 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQueryTerm
   [junit4]   2> 1067036 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQueryTerm
   [junit4]   2> 1067041 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncDiv
   [junit4]   2> 1067042 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncDiv
   [junit4]   2> 1067047 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncBoost
   [junit4]   2> 1067048 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncBoost
   [junit4]   2> 1067053 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncMs
   [junit4]   2> 1067070 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncMs
   [junit4]   2> 1067075 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncNorm
   [junit4]   2> 1067097 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncNorm
   [junit4]   2> 1067103 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncLiteral
   [junit4]   2> 1067103 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncLiteral
   [junit4]   2> 1067108 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncLinear
   [junit4]   2> 1067117 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncLinear
   [junit4]   2> 1067122 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncTestfunc
   [junit4]   2> 1067123 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncTestfunc
   [junit4]   2> 1067128 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQueryNested
   [junit4]   2> 1067129 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQueryNested
   [junit4]   2> 1067135 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncMaxdoc
   [junit4]   2> 1067135 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncMaxdoc
   [junit4]   2> 1067140 T2891 oas.SolrTestCaseJ4.setUp ###Starting testBlockJoin
   [junit4]   2> 1067164 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testBlockJoin
   [junit4]   2> 1067169 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQueryFrange
   [junit4]   2> 1067170 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQueryFrange
   [junit4]   2> 1067175 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncNot
   [junit4]   2> 1067177 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncNot
   [junit4]   2> 1067181 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncDoubleValueBools
   [junit4]   2> 1067193 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncDoubleValueBools
   [junit4]   2> 1067198 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncRecip
   [junit4]   2> 1067199 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncRecip
   [junit4]   2> 1067203 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQueryRaw
   [junit4]   2> 1067204 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQueryRaw
   [junit4]   2> 1067209 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQueryJoin
   [junit4]   2> 1067222 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQueryJoin
   [junit4]   2> 1067226 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQueryLucenePlusSort
   [junit4]   2> 1067229 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQueryLucenePlusSort
   [junit4]   2> 1067234 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncTop
   [junit4]   2> 1067235 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncTop
   [junit4]   2> 1067239 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncSingleValueMathFuncs
   [junit4]   2> 1067249 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncSingleValueMathFuncs
   [junit4]   2> 1067254 T2891 oas.SolrTestCaseJ4.setUp ###Starting testParserCoverage
   [junit4]   2> 1067254 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testParserCoverage
   [junit4]   2> 1067259 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncVector
   [junit4]   2> 1067261 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncVector
   [junit4]   2> 1067265 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncGhhsin
   [junit4]   2> 1067266 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncGhhsin
   [junit4]   2> 1067271 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQueryBbox
   [junit4]   2> 1067275 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQueryBbox
   [junit4]   2> 1067279 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncHsin
   [junit4]   2> 1067280 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncHsin
   [junit4]   2> 1067285 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncTerms
   [junit4]   2> 1067316 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncTerms
   [junit4]   2> 1067321 T2891 oas.SolrTestCaseJ4.setUp ###Starting testReRankQuery
   [junit4]   2> 1067341 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testReRankQuery
   [junit4]   2> 1067345 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQueryMaxScore
   [junit4]   2> 1067350 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQueryMaxScore
   [junit4]   2> 1067355 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQueryCollapse
   [junit4]   2> 1067373 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQueryCollapse
   [junit4]   2> 1067378 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncCurrency
   [junit4]   2> 1067385 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncCurrency
   [junit4]   2> 1067389 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncSub
   [junit4]   2> 1067391 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncSub
   [junit4]   2> 1067395 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncDoubleValueMathFuncs
   [junit4]   2> 1067403 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncDoubleValueMathFuncs
   [junit4]   2> 1067408 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncProduct
   [junit4]   2> 1067409 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncProduct
   [junit4]   2> 1067414 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQuerySurround
   [junit4]   2> 1067669 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQuerySurround
   [junit4]   2> 1067674 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncField
   [junit4]   2> 1067675 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncField
   [junit4]   2> 1067680 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncJoindf
   [junit4]   2> 1067680 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncJoindf
   [junit4]   2> 1067685 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncMax
   [junit4]   2> 1067686 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncMax
   [junit4]   2> 1067691 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncQuery
   [junit4]   2> 1067692 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncQuery
   [junit4]   2> 1067697 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncScale
   [junit4]   2> 1067706 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncScale
   [junit4]   2> 1067711 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncMathConsts
   [junit4]   2> 1067712 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncMathConsts
   [junit4]   2> 1067716 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncBools
   [junit4]   2> 1067717 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncBools
   [junit4]   2> 1067722 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncStrdist
   [junit4]   2> 1067738 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncStrdist
   [junit4]   2> 1067743 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQuerySwitch
   [junit4]   2> 1067746 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQuerySwitch
   [junit4]   2> 1067751 T2891 oas.SolrTestCaseJ4.setUp ###Starting testQueryFunc
   [junit4]   2> 1067753 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testQueryFunc
   [junit4]   2> 1067757 T2891 oas.SolrTestCaseJ4.setUp ###Starting testFuncSttf
   [junit4]   2> 1067758 T2891 oas.SolrTestCaseJ4.tearDown ###Ending testFuncSttf
   [junit4]   2> 1067760 T2891 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 1067760 T2891 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=830398897
   [junit4]   2> 1067761 T2891 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1b4d383e
   [junit4]   2> 1067775 T2891 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
   [junit4]   2> 1067775 T2891 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 1067775 T2891 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 1067775 T2891 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 1067777 T2891 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 1067777 T2891 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 1067777 T2891 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.search.QueryEqualityTest-894023E3DFD774C6-001/init-core-data-001 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.search.QueryEqualityTest-894023E3DFD774C6-001/init-core-data-001;done=false>>]
   [junit4]   2> 1067778 T2891 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.search.QueryEqualityTest-894023E3DFD774C6-001/init-core-data-001
   [junit4]   2> 1067778 T2891 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.search.QueryEqualityTest-894023E3DFD774C6-001/init-core-data-001/index [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.search.QueryEqualityTest-894023E3DFD774C6-001/init-core-data-001/index;done=false>>]
   [junit4]   2> 1067778 T2891 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.search.QueryEqualityTest-894023E3DFD774C6-001/init-core-data-001/index
   [junit4]   2> NOTE: test params are: codec=Lucene49: {}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=en_PH, timezone=America/Port-au-Prince
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_60 (64-bit)/cpus=16,threads=1,free=392664904,total=459276288
   [junit4]   2> NOTE: All tests run in this JVM: [DirectUpdateHandlerTest, CoreAdminCreateDiscoverTest, TestQuerySenderListener, MinimalSchemaTest, TestSolrDeletionPolicy1, CollectionsAPIDistributedZkTest, TestLuceneMatchVersion, TestQuerySenderNoQuery, TestManagedStopFilterFactory, TestDynamicFieldCollectionResource, TestSearchPerf, SortByFunctionTest, TestStressRecovery, TestCustomSort, SuggesterFSTTest, TestFaceting, TestStressLucene, TestChildDocTransformer, DirectSolrConnectionTest, EnumFieldTest, SolrIndexSplitterTest, IndexBasedSpellCheckerTest, TestDocSet, DocValuesMultiTest, CustomCollectionTest, LegacyHTMLStripCharFilterTest, TestSchemaVersionResource, ConnectionManagerTest, TestMergePolicyConfig, TestPseudoReturnFields, TestFieldSortValues, OverseerRolesTest, DateFieldTest, TermVectorComponentDistributedTest, TestIBSimilarityFactory, TestSolrXmlPersistence, FieldAnalysisRequestHandlerTest, DistribCursorPagingTest, SimpleFacetsTest, DistanceFunctionTest, TestSolrXMLSerializer, TestExtendedDismaxParser, HdfsBasicDistributedZk2Test, DocumentBuilderTest, FileUtilsTest, UpdateParamsTest, DocumentAnalysisRequestHandlerTest, UnloadDistributedZkTest, CircularListTest, ZkNodePropsTest, ScriptEngineTest, BasicZkTest, DistributedQueryComponentOptimizationTest, TestCSVResponseWriter, ParsingFieldUpdateProcessorsTest, HdfsRecoveryZkTest, OverseerStatusTest, StatsComponentTest, TestWriterPerf, ClusterStateUpdateTest, TestUniqueKeyFieldResource, TestNumberUtils, QueryEqualityTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=QueryEqualityTest -Dtests.seed=894023E3DFD774C6 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_PH -Dtests.timezone=America/Port-au-Prince -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   0.00s J0 | QueryEqualityTest (suite) <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: testParserCoverage was run w/o any other method explicitly testing qparser: terms
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([894023E3DFD774C6]:0)
   [junit4]    > 	at org.apache.solr.search.QueryEqualityTest.afterClassParserCoverageTest(QueryEqualityTest.java:62)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4] Completed on J0 in 2.65s, 70 tests, 1 failure <<< FAILURES!

[...truncated 383 lines...]
   [junit4] Suite: org.apache.solr.cloud.MultiThreadedOCPTest
   [junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/init-core-data-001
   [junit4]   2> 3591190 T5910 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 3591191 T5910 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 3591195 T5910 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 3591196 T5910 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 3591197 T5911 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 3591297 T5910 oasc.ZkTestServer.run start zk server on port:53984
   [junit4]   2> 3591298 T5910 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3591301 T5917 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4230cb67 name:ZooKeeperConnection Watcher:127.0.0.1:53984 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3591301 T5910 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3591301 T5910 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 3591305 T5910 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3591305 T5919 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@719a6a80 name:ZooKeeperConnection Watcher:127.0.0.1:53984/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3591306 T5910 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3591306 T5910 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 3591308 T5910 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 3591309 T5910 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 3591311 T5910 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 3591313 T5910 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 3591313 T5910 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 3591316 T5910 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 3591317 T5910 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 3591419 T5910 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 3591419 T5910 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 3591421 T5910 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 3591422 T5910 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 3591424 T5910 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 3591424 T5910 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 3591426 T5910 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 3591427 T5910 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 3591429 T5910 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 3591429 T5910 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 3591431 T5910 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 3591432 T5910 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 3591434 T5910 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 3591434 T5910 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 3591436 T5910 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 3591437 T5910 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 3591438 T5910 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 3591439 T5910 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 3592574 T5910 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 3592578 T5910 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:44580
   [junit4]   2> 3592579 T5910 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 3592579 T5910 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 3592579 T5910 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-002
   [junit4]   2> 3592579 T5910 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-002/'
   [junit4]   2> 3592609 T5910 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-002/solr.xml
   [junit4]   2> 3592662 T5910 oasc.CoreContainer.<init> New CoreContainer 1199701395
   [junit4]   2> 3592662 T5910 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-002/]
   [junit4]   2> 3592663 T5910 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 3592664 T5910 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 3592664 T5910 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 3592664 T5910 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 3592664 T5910 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 3592665 T5910 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 3592665 T5910 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 3592665 T5910 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 3592665 T5910 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 3592666 T5910 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 3592666 T5910 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 3592666 T5910 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 3592667 T5910 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 3592667 T5910 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53984/solr
   [junit4]   2> 3592667 T5910 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 3592668 T5910 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3592669 T5930 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@272ee292 name:ZooKeeperConnection Watcher:127.0.0.1:53984 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3592670 T5910 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3592672 T5910 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3592672 T5932 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14120bea name:ZooKeeperConnection Watcher:127.0.0.1:53984/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3592673 T5910 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3592674 T5910 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 3592676 T5910 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 3592678 T5910 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 3592680 T5910 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 3592681 T5910 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 3592683 T5910 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 3592684 T5910 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44580_
   [junit4]   2> 3592685 T5910 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:44580_
   [junit4]   2> 3592687 T5910 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 3592688 T5910 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 3592690 T5910 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:44580_
   [junit4]   2> 3592691 T5910 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 3592692 T5910 oasc.Overseer.start Overseer (id=92238083035824131-127.0.0.1:44580_-n_0000000000) starting
   [junit4]   2> 3592694 T5910 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 3592699 T5934 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 3592700 T5910 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 3592701 T5910 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 3592703 T5910 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 3592704 T5933 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 3592709 T5935 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 3592709 T5935 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 3592710 T5935 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 3592710 T5936 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3592711 T5933 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 3592712 T5933 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:44580",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:44580_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 3592712 T5933 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 3592712 T5933 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 3592714 T5936 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3592714 T5936 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 3593710 T5935 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 3593711 T5935 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 3593712 T5935 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 3593712 T5935 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 3593713 T5935 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 3593713 T5935 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-002/collection1/'
   [junit4]   2> 3593714 T5935 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-002/collection1/lib/classes/' to classloader
   [junit4]   2> 3593715 T5935 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-002/collection1/lib/.svn/' to classloader
   [junit4]   2> 3593715 T5935 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-002/collection1/lib/README' to classloader
   [junit4]   2> 3593779 T5935 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
   [junit4]   2> 3593827 T5935 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 3593928 T5935 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 3593939 T5935 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 3594409 T5935 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 3594410 T5935 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 3594411 T5935 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 3594423 T5935 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 3594427 T5935 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 3594438 T5935 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 3594442 T5935 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 3594446 T5935 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 3594447 T5935 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 3594447 T5935 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 3594448 T5935 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 3594449 T5935 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 3594449 T5935 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 3594449 T5935 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 3594449 T5935 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 3594450 T5935 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-002/collection1/, dataDir=./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-001/control/data/
   [junit4]   2> 3594450 T5935 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bde656e
   [junit4]   2> 3594451 T5935 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-001/control/data
   [junit4]   2> 3594451 T5935 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-001/control/data/index/
   [junit4]   2> 3594451 T5935 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
   [junit4]   2> 3594451 T5935 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-001/control/data/index
   [junit4]   2> 3594452 T5935 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=16, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 3594453 T5935 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@5de6da92 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@78db4089),segFN=segments_1,generation=1}
   [junit4]   2> 3594453 T5935 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 3594457 T5935 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 3594457 T5935 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 3594457 T5935 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 3594458 T5935 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 3594458 T5935 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 3594458 T5935 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 3594459 T5935 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 3594459 T5935 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 3594459 T5935 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 3594460 T5935 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3594460 T5935 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3594461 T5935 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3594461 T5935 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3594462 T5935 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 3594462 T5935 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 3594462 T5935 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 3594463 T5935 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 3594463 T5935 oasc.RequestHandlers.initHandlersFromConfig WARN Multiple requestHandler registered to the same name: /update ignoring: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3594463 T5935 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 3594464 T5935 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 3594464 T5935 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 3594483 T5935 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3594485 T5935 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3594487 T5935 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3594489 T5935 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3594491 T5935 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3594497 T5935 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 3594497 T5935 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 3594498 T5935 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=43, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.33125372141014287]
   [junit4]   2> 3594499 T5935 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@5de6da92 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@78db4089),segFN=segments_1,generation=1}
   [junit4]   2> 3594499 T5935 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 3594499 T5935 oass.SolrIndexSearcher.<init> Opening Searcher@7900b887[collection1] main
   [junit4]   2> 3594500 T5935 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 3594500 T5935 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 3594501 T5935 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 3594501 T5935 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 3594501 T5935 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 3594502 T5935 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 3594502 T5935 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 3594502 T5935 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 3594503 T5935 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
   [junit4]   2> 3594505 T5935 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
   [junit4]   2> 3594505 T5935 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 3594505 T5935 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 3594508 T5937 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7900b887[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 3594511 T5935 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 3594512 T5940 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:44580 collection:control_collection shard:shard1
   [junit4]   2> 3594513 T5910 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
   [junit4]   2> 3594513 T5910 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 3594513 T5940 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 3594514 T5910 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3594516 T5942 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@46bab9b4 name:ZooKeeperConnection Watcher:127.0.0.1:53984/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3594516 T5910 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3594517 T5910 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 3594518 T5940 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 3594519 T5910 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 3594520 T5936 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3594520 T5940 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 3594520 T5940 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C1128 name=collection1 org.apache.solr.core.SolrCore@24159ed7 url=http://127.0.0.1:44580/collection1 node=127.0.0.1:44580_ C1128_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:44580, core=collection1, node_name=127.0.0.1:44580_}
   [junit4]   2> 3594520 T5940 C1128 P44580 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:44580/collection1/
   [junit4]   2> 3594521 T5940 C1128 P44580 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 3594521 T5933 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 3594521 T5940 C1128 P44580 oasc.SyncStrategy.syncToMe http://127.0.0.1:44580/collection1/ has no replicas
   [junit4]   2> 3594521 T5940 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:44580/collection1/ shard1
   [junit4]   2> 3594521 T5940 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 3594523 T5936 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3594523 T5936 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 3594523 T5943 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 3594527 T5933 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 3594528 T5936 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3594630 T5936 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 3594630 T5943 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 3594679 T5940 oasc.ZkController.register We are http://127.0.0.1:44580/collection1/ and leader is http://127.0.0.1:44580/collection1/
   [junit4]   2> 3594680 T5940 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:44580
   [junit4]   2> 3594680 T5940 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 3594680 T5940 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
   [junit4]   2> 3594680 T5940 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 3594681 T5936 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3594682 T5936 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3594682 T5940 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 3594682 T5944 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3594683 T5933 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 3594683 T5933 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:44580",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:44580_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 3594685 T5944 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3594786 T5944 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 3594786 T5943 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 3595631 T5910 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 3595632 T5910 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 3595635 T5910 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:27736
   [junit4]   2> 3595635 T5910 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 3595636 T5910 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 3595636 T5910 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003
   [junit4]   2> 3595636 T5910 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/'
   [junit4]   2> 3595665 T5910 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/solr.xml
   [junit4]   2> 3595719 T5910 oasc.CoreContainer.<init> New CoreContainer 770910585
   [junit4]   2> 3595719 T5910 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/]
   [junit4]   2> 3595720 T5910 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 3595720 T5910 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 3595721 T5910 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 3595721 T5910 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 3595721 T5910 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 3595721 T5910 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 3595722 T5910 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 3595722 T5910 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 3595722 T5910 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 3595723 T5910 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 3595723 T5910 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 3595723 T5910 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 3595723 T5910 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 3595724 T5910 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53984/solr
   [junit4]   2> 3595724 T5910 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 3595725 T5910 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3595726 T5955 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3727de80 name:ZooKeeperConnection Watcher:127.0.0.1:53984 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3595727 T5910 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3595729 T5910 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3595730 T5957 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a404f0c name:ZooKeeperConnection Watcher:127.0.0.1:53984/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3595730 T5910 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3595735 T5910 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 3596738 T5910 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:27736_
   [junit4]   2> 3596739 T5910 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:27736_
   [junit4]   2> 3596741 T5944 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 3596742 T5958 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 3596742 T5943 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 3596748 T5959 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 3596748 T5959 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 3596749 T5944 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3596750 T5960 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3596749 T5959 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 3596749 T5936 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3596751 T5933 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 3596751 T5933 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:27736",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:27736_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 3596751 T5933 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
   [junit4]   2> 3596752 T5933 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 3596753 T5936 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3596754 T5936 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 3596754 T5958 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 3596754 T5943 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 3597750 T5959 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 3597751 T5959 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 3597751 T5959 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 3597752 T5959 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 3597752 T5959 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 3597753 T5959 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/collection1/'
   [junit4]   2> 3597754 T5959 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/collection1/lib/classes/' to classloader
   [junit4]   2> 3597755 T5959 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/collection1/lib/.svn/' to classloader
   [junit4]   2> 3597755 T5959 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/collection1/lib/README' to classloader
   [junit4]   2> 3597819 T5959 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
   [junit4]   2> 3597883 T5959 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 3597984 T5959 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 3597995 T5959 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 3598432 T5959 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 3598433 T5959 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 3598433 T5959 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 3598446 T5959 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 3598449 T5959 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 3598460 T5959 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 3598465 T5959 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 3598469 T5959 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 3598469 T5959 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 3598470 T5959 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 3598470 T5959 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 3598471 T5959 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 3598471 T5959 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 3598471 T5959 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 3598471 T5959 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 3598472 T5959 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/collection1/, dataDir=./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/collection1/data/
   [junit4]   2> 3598472 T5959 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7bde656e
   [junit4]   2> 3598473 T5959 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/collection1/data
   [junit4]   2> 3598473 T5959 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/collection1/data/index/
   [junit4]   2> 3598473 T5959 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 3598474 T5959 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-003/collection1/data/index
   [junit4]   2> 3598474 T5959 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=16, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 3598475 T5959 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@34b9c3ed lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@175c4ba0),segFN=segments_1,generation=1}
   [junit4]   2> 3598475 T5959 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 3598480 T5959 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 3598480 T5959 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 3598480 T5959 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 3598480 T5959 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 3598481 T5959 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 3598481 T5959 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 3598481 T5959 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 3598482 T5959 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 3598482 T5959 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 3598483 T5959 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3598483 T5959 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3598484 T5959 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3598484 T5959 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3598485 T5959 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 3598486 T5959 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 3598486 T5959 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 3598486 T5959 oasc.RequestHandlers.initHandlersFromConfig create

[...truncated too long message...]

3645985 T5910 oasc.CachingDirectoryFactory.close Closing directory: ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-006/ocptest1_shard3_replica1/data/index
   [junit4]   2> 3645986 T5910 oasc.SolrCore.close [ocptest_shardsplit_shard4_replica1]  CLOSING SolrCore org.apache.solr.core.SolrCore@2cc6d31a
   [junit4]   2> 3645994 T5910 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
   [junit4]   2> 3645994 T5910 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 3645994 T5910 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 3645995 T5910 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 3645995 T5910 oasc.SolrCore.closeSearcher [ocptest_shardsplit_shard4_replica1] Closing main searcher on request.
   [junit4]   2> 3645996 T5910 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 3645996 T5910 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-006/ocptest_shardsplit_shard4_replica1/data/index [CachedDir<<refCount=0;path=./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-006/ocptest_shardsplit_shard4_replica1/data/index;done=false>>]
   [junit4]   2> 3645997 T5910 oasc.CachingDirectoryFactory.close Closing directory: ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-006/ocptest_shardsplit_shard4_replica1/data/index
   [junit4]   2> 3645997 T5910 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-006/ocptest_shardsplit_shard4_replica1/data [CachedDir<<refCount=0;path=./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-006/ocptest_shardsplit_shard4_replica1/data;done=false>>]
   [junit4]   2> 3645997 T5910 oasc.CachingDirectoryFactory.close Closing directory: ./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001/tempDir-006/ocptest_shardsplit_shard4_replica1/data
   [junit4]   2> 3645998 T7442 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:18528_
   [junit4]   2> 3646000 T7437 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 3646000 T7444 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:302)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:299)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:299)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:316)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:288)
   [junit4]   2> 
   [junit4]   2> 3646001 T5910 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
   [junit4]   2> 3650916 T5910 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
   [junit4]   2> 3650918 T5910 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:53984 53984
   [junit4]   2> 3651144 T5911 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:53984 53984
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=MultiThreadedOCPTest -Dtests.method=testDistribSearch -Dtests.seed=894023E3DFD774C6 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar_DZ -Dtests.timezone=Europe/Vilnius -Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE 60.0s J0 | MultiThreadedOCPTest.testDistribSearch <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: We have a failed SPLITSHARD task
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([894023E3DFD774C6:8A6ADFBA88814FA]:0)
   [junit4]    > 	at org.apache.solr.cloud.MultiThreadedOCPTest.testTaskExclusivity(MultiThreadedOCPTest.java:125)
   [junit4]    > 	at org.apache.solr.cloud.MultiThreadedOCPTest.doTest(MultiThreadedOCPTest.java:71)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 3651162 T5910 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.cloud.MultiThreadedOCPTest-894023E3DFD774C6-001
   [junit4]   2> 59977 T5909 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Lucene41, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=ar_DZ, timezone=Europe/Vilnius
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_60 (64-bit)/cpus=16,threads=1,free=278470064,total=529530880
   [junit4]   2> NOTE: All tests run in this JVM: [DirectUpdateHandlerTest, CoreAdminCreateDiscoverTest, TestQuerySenderListener, MinimalSchemaTest, TestSolrDeletionPolicy1, CollectionsAPIDistributedZkTest, TestLuceneMatchVersion, TestQuerySenderNoQuery, TestManagedStopFilterFactory, TestDynamicFieldCollectionResource, TestSearchPerf, SortByFunctionTest, TestStressRecovery, TestCustomSort, SuggesterFSTTest, TestFaceting, TestStressLucene, TestChildDocTransformer, DirectSolrConnectionTest, EnumFieldTest, SolrIndexSplitterTest, IndexBasedSpellCheckerTest, TestDocSet, DocValuesMultiTest, CustomCollectionTest, LegacyHTMLStripCharFilterTest, TestSchemaVersionResource, ConnectionManagerTest, TestMergePolicyConfig, TestPseudoReturnFields, TestFieldSortValues, OverseerRolesTest, DateFieldTest, TermVectorComponentDistributedTest, TestIBSimilarityFactory, TestSolrXmlPersistence, FieldAnalysisRequestHandlerTest, DistribCursorPagingTest, SimpleFacetsTest, DistanceFunctionTest, TestSolrXMLSerializer, TestExtendedDismaxParser, HdfsBasicDistributedZk2Test, DocumentBuilderTest, FileUtilsTest, UpdateParamsTest, DocumentAnalysisRequestHandlerTest, UnloadDistributedZkTest, CircularListTest, ZkNodePropsTest, ScriptEngineTest, BasicZkTest, DistributedQueryComponentOptimizationTest, TestCSVResponseWriter, ParsingFieldUpdateProcessorsTest, HdfsRecoveryZkTest, OverseerStatusTest, StatsComponentTest, TestWriterPerf, ClusterStateUpdateTest, TestUniqueKeyFieldResource, TestNumberUtils, QueryEqualityTest, DocExpirationUpdateProcessorFactoryTest, TestComponentsName, TestConfigSets, RequiredFieldsTest, TestRestManager, TestLMJelinekMercerSimilarityFactory, DateMathParserTest, SuggestComponentTest, LeaderElectionTest, MergeStrategyTest, ReplicationFactorTest, URLClassifyProcessorTest, TestFileDictionaryLookup, PrimUtilsTest, BlockCacheTest, SuggesterTest, SolrIndexConfigTest, FastVectorHighlighterTest, TestSolr4Spatial, BasicDistributedZkTest, TestUtils, BasicFunctionalityTest, BlockDirectoryTest, TestRecovery, ExternalFileFieldSortTest, TestGroupingSearch, TestSolrJ, DistributedDebugComponentTest, TestSchemaSimilarityResource, CoreMergeIndexesAdminHandlerTest, TestDocumentBuilder, TestSolr4Spatial2, TestSolrDeletionPolicy2, TestManagedResourceStorage, TestCharFilters, UniqFieldsUpdateProcessorFactoryTest, ShardSplitTest, TestCloudManagedSchemaConcurrent, MultiThreadedOCPTest]
   [junit4] Completed on J0 in 60.51s, 1 test, 1 failure <<< FAILURES!

[...truncated 627 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:474: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:454: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:45: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:496: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1299: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:923: There were test failures: 411 suites, 1711 tests, 1 suite-level error, 1 failure, 53 ignored (19 assumptions)

Total time: 123 minutes 13 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-Tests-4.x-Java7 #2040
Archived 3 artifacts
Archive block size is 32768
Received 0 blocks and 196987264 bytes
Compression is 0.0%
Took 36 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 2048 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/2048/

1 tests failed.
FAILED:  org.apache.solr.cloud.MultiThreadedOCPTest.testDistribSearch

Error Message:
We have a failed SPLITSHARD task

Stack Trace:
java.lang.AssertionError: We have a failed SPLITSHARD task
	at __randomizedtesting.SeedInfo.seed([F68153FE96B8AAD7:7767DDE6E1E7CAEB]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.MultiThreadedOCPTest.testTaskExclusivity(MultiThreadedOCPTest.java:125)
	at org.apache.solr.cloud.MultiThreadedOCPTest.doTest(MultiThreadedOCPTest.java:71)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11045 lines...]
   [junit4] Suite: org.apache.solr.cloud.MultiThreadedOCPTest
   [junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/init-core-data-001
   [junit4]   2> 609726 T959 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (true)
   [junit4]   2> 609727 T959 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /xit/b
   [junit4]   2> 609736 T959 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 609737 T959 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 609738 T960 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 609838 T959 oasc.ZkTestServer.run start zk server on port:63017
   [junit4]   2> 609841 T959 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 609852 T966 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6545278a name:ZooKeeperConnection Watcher:127.0.0.1:63017 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 609853 T959 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 609853 T959 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 609863 T959 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 609865 T968 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@35413dca name:ZooKeeperConnection Watcher:127.0.0.1:63017/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 609865 T959 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 609866 T959 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 609870 T959 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 609872 T959 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 609875 T959 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 609878 T959 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 609878 T959 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 609885 T959 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 609886 T959 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 609995 T959 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 609996 T959 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 610000 T959 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 610000 T959 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 610004 T959 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 610005 T959 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 610008 T959 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 610009 T959 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 610012 T959 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 610013 T959 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 610016 T959 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 610017 T959 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 610020 T959 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 610021 T959 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 610024 T959 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 610025 T959 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 610028 T959 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 610028 T959 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 611372 T959 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 611377 T959 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:28919
   [junit4]   2> 611378 T959 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 611378 T959 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 611378 T959 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-002
   [junit4]   2> 611379 T959 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-002/'
   [junit4]   2> 611422 T959 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-002/solr.xml
   [junit4]   2> 611490 T959 oasc.CoreContainer.<init> New CoreContainer 2142702214
   [junit4]   2> 611490 T959 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-002/]
   [junit4]   2> 611491 T959 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 611492 T959 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 611492 T959 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 611492 T959 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 611492 T959 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 611493 T959 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 611493 T959 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 611493 T959 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 611493 T959 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 611494 T959 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 611494 T959 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 611495 T959 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 611495 T959 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 611495 T959 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63017/solr
   [junit4]   2> 611495 T959 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 611496 T959 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 611498 T979 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4a1424eb name:ZooKeeperConnection Watcher:127.0.0.1:63017 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 611498 T959 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 611500 T959 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 611502 T981 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@631141dd name:ZooKeeperConnection Watcher:127.0.0.1:63017/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 611502 T959 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 611504 T959 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 611506 T959 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 611509 T959 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 611512 T959 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 611515 T959 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 611518 T959 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 611519 T959 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:28919_xit%2Fb
   [junit4]   2> 611520 T959 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:28919_xit%2Fb
   [junit4]   2> 611523 T959 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 611525 T959 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 611528 T959 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:28919_xit%2Fb
   [junit4]   2> 611528 T959 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 611530 T959 oasc.Overseer.start Overseer (id=92231627421515779-127.0.0.1:28919_xit%2Fb-n_0000000000) starting
   [junit4]   2> 611533 T959 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 611542 T983 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 611542 T959 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 611544 T959 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 611546 T959 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 611549 T982 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 611553 T984 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 611553 T984 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 611555 T984 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 611555 T985 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 611556 T982 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 611557 T982 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:28919/xit/b",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:28919_xit%2Fb",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 611557 T982 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 611562 T982 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 611565 T985 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 611565 T985 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 612556 T984 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 612557 T984 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 612558 T984 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 612558 T984 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 612560 T984 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 612560 T984 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-002/collection1/'
   [junit4]   2> 612562 T984 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-002/collection1/lib/classes/' to classloader
   [junit4]   2> 612563 T984 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-002/collection1/lib/README' to classloader
   [junit4]   2> 612564 T984 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-002/collection1/lib/.svn/' to classloader
   [junit4]   2> 612638 T984 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
   [junit4]   2> 612692 T984 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 612795 T984 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 612813 T984 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 613337 T984 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 613338 T984 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 613339 T984 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 613354 T984 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 613358 T984 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 613384 T984 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 613390 T984 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 613394 T984 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 613396 T984 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 613396 T984 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 613396 T984 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 613397 T984 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 613398 T984 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 613398 T984 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 613398 T984 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 613399 T984 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-002/collection1/, dataDir=./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-001/control/data/
   [junit4]   2> 613399 T984 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2caa89b0
   [junit4]   2> 613400 T984 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-001/control/data
   [junit4]   2> 613400 T984 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-001/control/data/index/
   [junit4]   2> 613400 T984 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
   [junit4]   2> 613401 T984 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-001/control/data/index
   [junit4]   2> 613401 T984 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=47, maxMergedSegmentMB=29.470703125, floorSegmentMB=0.39453125, forceMergeDeletesPctAllowed=13.792285201365804, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 613402 T984 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@5d52e040 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5e2f28f2),segFN=segments_1,generation=1}
   [junit4]   2> 613402 T984 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 613408 T984 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 613408 T984 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 613409 T984 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 613409 T984 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 613409 T984 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 613410 T984 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 613410 T984 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 613410 T984 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 613411 T984 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 613411 T984 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 613412 T984 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 613412 T984 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 613413 T984 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 613414 T984 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 613414 T984 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 613414 T984 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 613415 T984 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 613415 T984 oasc.RequestHandlers.initHandlersFromConfig WARN Multiple requestHandler registered to the same name: /update ignoring: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 613416 T984 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 613416 T984 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 613417 T984 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 613434 T984 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 613436 T984 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 613438 T984 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 613440 T984 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 613442 T984 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 613447 T984 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 613448 T984 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 613448 T984 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@18f10d5f
   [junit4]   2> 613449 T984 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@5d52e040 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5e2f28f2),segFN=segments_1,generation=1}
   [junit4]   2> 613449 T984 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 613450 T984 oass.SolrIndexSearcher.<init> Opening Searcher@53707261[collection1] main
   [junit4]   2> 613450 T984 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 613451 T984 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 613451 T984 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 613452 T984 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 613452 T984 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 613453 T984 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 613453 T984 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 613454 T984 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 613454 T984 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
   [junit4]   2> 613457 T984 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
   [junit4]   2> 613457 T984 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 613458 T984 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 613462 T986 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@53707261[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 613466 T984 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 613467 T989 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:28919/xit/b collection:control_collection shard:shard1
   [junit4]   2> 613468 T959 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
   [junit4]   2> 613468 T959 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 613468 T989 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 613469 T959 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 613470 T991 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@504544b6 name:ZooKeeperConnection Watcher:127.0.0.1:63017/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 613471 T959 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 613472 T959 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 613475 T959 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 613476 T989 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 613478 T985 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 613479 T989 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 613479 T989 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C546 name=collection1 org.apache.solr.core.SolrCore@2a7f1664 url=http://127.0.0.1:28919/xit/b/collection1 node=127.0.0.1:28919_xit%2Fb C546_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:28919/xit/b, core=collection1, node_name=127.0.0.1:28919_xit%2Fb}
   [junit4]   2> 613479 T989 C546 P28919 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:28919/xit/b/collection1/
   [junit4]   2> 613479 T989 C546 P28919 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 613479 T989 C546 P28919 oasc.SyncStrategy.syncToMe http://127.0.0.1:28919/xit/b/collection1/ has no replicas
   [junit4]   2> 613479 T989 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:28919/xit/b/collection1/ shard1
   [junit4]   2> 613480 T989 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 613480 T982 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 613483 T985 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 613484 T985 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 613484 T992 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 613489 T982 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 613491 T985 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 613594 T992 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 613594 T985 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 613639 T989 oasc.ZkController.register We are http://127.0.0.1:28919/xit/b/collection1/ and leader is http://127.0.0.1:28919/xit/b/collection1/
   [junit4]   2> 613640 T989 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:28919/xit/b
   [junit4]   2> 613640 T989 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 613640 T989 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
   [junit4]   2> 613640 T989 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 613642 T985 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 613642 T985 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 613642 T993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 613643 T989 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 613644 T982 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 613645 T982 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:28919/xit/b",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:28919_xit%2Fb",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 613648 T993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 613751 T992 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 613751 T993 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 614364 T959 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 614364 T959 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 614367 T959 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:51242
   [junit4]   2> 614367 T959 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 614368 T959 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 614368 T959 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-003
   [junit4]   2> 614368 T959 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-003/'
   [junit4]   2> 614399 T959 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-003/solr.xml
   [junit4]   2> 614455 T959 oasc.CoreContainer.<init> New CoreContainer 731727875
   [junit4]   2> 614455 T959 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-003/]
   [junit4]   2> 614456 T959 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 614457 T959 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 614457 T959 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 614457 T959 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 614457 T959 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 614458 T959 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 614458 T959 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 614458 T959 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 614459 T959 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 614459 T959 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 614459 T959 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 614460 T959 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 614460 T959 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 614460 T959 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63017/solr
   [junit4]   2> 614460 T959 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 614461 T959 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 614463 T1004 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@62e2d353 name:ZooKeeperConnection Watcher:127.0.0.1:63017 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 614463 T959 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 614466 T959 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 614467 T1006 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4d75c021 name:ZooKeeperConnection Watcher:127.0.0.1:63017/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 614468 T959 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 614475 T959 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 615479 T959 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51242_xit%2Fb
   [junit4]   2> 615481 T959 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51242_xit%2Fb
   [junit4]   2> 615484 T992 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 615484 T993 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 615484 T1007 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 615494 T1008 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 615494 T1008 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 615496 T993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 615496 T1009 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 615496 T1008 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 615496 T985 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 615498 T982 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 615499 T982 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:51242/xit/b",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:51242_xit%2Fb",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 615499 T982 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
   [junit4]   2> 615500 T982 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 615503 T985 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 615504 T1007 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 615504 T992 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 615504 T985 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 616496 T1008 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 616497 T1008 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 616498 T1008 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 616498 T1008 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 616499 T1008 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 616500 T1008 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-003/collection1/'
   [junit4]   2> 616502 T1008 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-003/collection1/lib/README' to classloader
   [junit4]   2> 616502 T1008 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-003/collection1/lib/classes/' to classloader
   [junit4]   2> 616503 T1008 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-003/collection1/lib/.svn/' to classloader
   [junit4]   2> 616587 T1008 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
   [junit4]   2> 616637 T1008 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 616739 T1008 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 616756 T1008 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 617215 T1008 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 617216 T1008 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 617217 T1008 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 617232 T1008 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 617235 T1008 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 617264 T1008 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 617269 T1008 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 617274 T1008 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 617276 T1008 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 617276 T1008 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 617276 T1008 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 617278 T1008 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 617278 T1008 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 617278 T1008 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 617279 T1008 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 617279 T1008 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-003/collection1/, dataDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-003/collection1/data/
   [junit4]   2> 617279 T1008 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2caa89b0
   [junit4]   2> 617280 T1008 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-003/collection1/data
   [junit4]   2> 617281 T1008 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-003/collection1/data/index/
   [junit4]   2> 617281 T1008 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-003/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 617282 T1008 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-003/collection1/data/index
   [junit4]   2> 617282 T1008 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=47, maxMergedSegmentMB=29.470703125, floorSegmentMB=0.39453125, forceMergeDeletesPctAllowed=13.792285201365804, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 617283 T1008 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@55afb6a4 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@a2beec),segFN=segments_1,generation=1}
   [junit4]   2> 617284 T1008 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 617291 T1008 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 617292 T1008 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 617292 T1008 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 617292 T1008 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 617293 T1008 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 617293 T1008 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 617294 T1008 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 617294 T1008 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 617294 T1008 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 617295 T1008 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 617296 T1008 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 617297 T1008 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 617298 T1008 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 617299 T1008 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 617299 T1008 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 617300 T1008 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 617300 T1008 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 617301 T1008 oasc.RequestHandlers.initHandlersFromConfig WARN Multiple requestHandler registered to the same name: /update ignoring: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 617301 T1008 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 617302 T1008 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 617302 T1008 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 617322 T1008 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 617324 T1008 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 617327 T1008 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 617329 T1008 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 617331 T1008 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 617337 T1008 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 617337 T1008 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 617338 T1008 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@150871ac
   [junit4]   2> 617339 T1008 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@55afb6a4 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@a2beec),segFN=segments_1,generation=1}
   [junit4]   2> 617339 T1008 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 617340 T1008 oass.SolrIndexSearcher.<init> Opening Searcher@34ac551e[collection1] main
   [junit4]   2> 617340 T1008 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 617342 T1008 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 617342 T1008 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 617343 T1008 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 617343 T1008 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 617343 T1008 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 617345 T1008 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 617345 T1008 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 617346 T1008 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
   [junit4]   2> 617346 T1008 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 617351 T1010 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@34ac551e[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 617356 T1008 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 617357 T1013 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51242/xit/b collection:collection1 shard:shard2
   [junit4]   2> 617358 T959 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
   [junit4]   2> 617358 T959 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 617359 T1013 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 617367 T1013 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 617369 T985 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 617370 T1013 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 617370 T1013 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C547 name=collection1 org.apache.solr.core.SolrCore@c81556a url=http://127.0.0.1:51242/xit/b/collection1 node=127.0.0.1:51242_xit%2Fb C547_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:51242/xit/b, core=collection1, node_name=127.0.0.1:51242_xit%2Fb}
   [junit4]   2> 617370 T1013 C547 P51242 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51242/xit/b/collection1/
   [junit4]   2> 617371 T1013 C547 P51242 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 617371 T1013 C547 P51242 oasc.SyncStrategy.syncToMe http://127.0.0.1:51242/xit/b/collection1/ has no replicas
   [junit4]   2> 617371 T982 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 617371 T1013 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51242/xit/b/collection1/ shard2
   [junit4]   2> 617372 T1013 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 617375 T985 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 617376 T992 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 617376 T985 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 617377 T1007 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 617382 T982 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 617385 T985 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 617488 T1007 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 617488 T985 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 617488 T992 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 617532 T1013 oasc.ZkController.register We are http://127.0.0.1:51242/xit/b/collection1/ and leader is http://127.0.0.1:51242/xit/b/collection1/
   [junit4]   2> 617533 T1013 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51242/xit/b
   [junit4]   2> 617533 T1013 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 617533 T1013 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 617534 T1013 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 617536 T985 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 617536 T1009 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 617537 T1013 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 617536 T993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 617539 T982 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 617539 T982 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:51242/xit/b",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:51242_xit%2Fb",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 617542 T993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 617645 T993 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 617645 T1007 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 617645 T992 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 618515 T959 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 618515 T959 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 618518 T959 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:13334
   [junit4]   2> 618519 T959 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 618519 T959 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 618519 T959 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-004
   [junit4]   2> 618519 T959 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-004/'
   [junit4]   2> 618550 T959 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-004/solr.xml
   [junit4]   2> 618604 T959 oasc.CoreContainer.<init> New CoreContainer 830893697
   [junit4]   2> 618605 T959 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-004/]
   [junit4]   2> 618606 T959 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 618606 T959 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 618606 T959 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 618606 T959 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 618607 T959 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 618607 T959 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 618607 T959 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 618608 T959 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 618608 T959 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 618608 T959 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 618609 T959 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 618609 T959 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 618609 T959 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 618609 T959 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63017/solr
   [junit4]   2> 618610 T959 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 618611 T959 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 618612 T1024 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@70c0f08d name:ZooKeeperConnection Watcher:127.0.0.1:63017 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 618613 T959 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 618616 T959 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 618617 T1026 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7cd3c5b7 name:ZooKeeperConnection Watcher:127.0.0.1:63017/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 618617 T959 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 618624 T959 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 619628 T959 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:13334_xit%2Fb
   [junit4]   2> 619630 T959 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:13334_xit%2Fb
   [junit4]   2> 619635 T992 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 619635 T1007 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 619635 T993 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 619640 T1027 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 619650 T1028 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 619651 T1028 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 619652 T993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 619652 T1028 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 619652 T985 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 619652 T1009 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 619654 T982 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 619655 T982 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:13334/xit/b",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:13334_xit%2Fb",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 619655 T982 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
   [junit4]   2> 619656 T982 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 619659 T1009 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 619660 T1007 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 619660 T992 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 619660 T1027 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 619660 T1009 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 620653 T1028 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 620654 T1028 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 620655 T1028 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 620655 T1028 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 620657 T1028 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 620657 T1028 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-004/collection1/'
   [junit4]   2> 620659 T1028 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-004/collection1/lib/README' to classloader
   [junit4]   2> 620659 T1028 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-004/collection1/lib/classes/' to classloader
   [junit4]   2> 620660 T1028 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-004/collection1/lib/.svn/' to classloader
   [junit4]   2> 620730 T1028 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
   [junit4]   2> 620781 T1028 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 620884 T1028 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 620901 T1028 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 621404 T1028 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 621405 T1028 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 621406 T1028 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 621423 T1028 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 621426 T1028 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 621453 T1028 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 621459 T1028 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 621464 T1028 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 621465 T1028 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 621466 T1028 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 621466 T1028 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 621467 T1028 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 621468 T1028 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 621468 T1028 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 621468 T1028 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 621469 T1028 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-004/collection1/, dataDir=./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-004/collection1/data/
   [junit4]   2> 621469 T1028 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2caa89b0
   [junit4]   2> 621470 T1028 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-004/collection1/data
   [junit4]   2> 621470 T1028 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-004/collection1/data/index/
   [junit4]   2> 621470 T1028 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-004/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 621471 T1028 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-004/collection1/data/index
   [junit4]   2> 621471 T1028 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=47, maxMergedSegmentMB=29.470703125, floorSegmentMB=0.39453125, forceMergeDeletesPctAllowed=13.792285201365804, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 621472 T1028 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@3b04def1 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@37ca3e27),segFN=segments_1,generation=1}
   [junit4]   2> 621473 T1028 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 621480 T1028 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 621481 T1028 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 621481 T1028 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 621481 T1028 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 621482 T1028 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 621482 T1028 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 621483 T1028 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 621483 T1028 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 621483 T1028 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 621484 T1028 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 621485 T1028 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 621486 T1028 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 621486 T1028 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 621487 T1028 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 621488 T1028 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 621488 T1028 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 621489 T1028 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 621490 T1028 oasc.RequestHandlers.initHandlersFromConfig WARN Multiple requestHandler registered to the same name: /update ignoring: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 621490 T1028 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 621490 T1028 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 621491 T1028 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 621513 T1028 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 621515 T1028 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 621517 T1028 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 621520 T1028 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 621522 T1028 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 621527 T1028 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 621527 T1028 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 621529 T1028 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@132cda0
   [junit4]   2> 621529 T1028 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@3b04def1 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@37ca3e27),segFN=segments_1,generation=1}
   [junit4]   2> 621530 T1028 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 621530 T1028 oass.SolrIndexSearcher.<init> Opening Searcher@490d3fa7[collection1] main
   [junit4]   2> 621530 T1028 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 621532 T1028 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 621532 T1028 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 621533 T1028 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 621533 T1028 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 621533 T1028 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 621535 T1028 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 621535 T1028 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 621535 T1028 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
   [junit4]   2> 621535 T1028 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 621541 T1029 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@490d3fa7[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 621546 T1028 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 621547 T1032 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:13334/xit/b collection:collection1 shard:shard1
   [junit4]   2> 621548 T959 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
   [junit4]   2> 621549 T959 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 621549 T1032 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 621556 T1032 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 621558 T1009 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 621559 T1032 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 621559 T1032 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C548 name=collection1 org.apache.solr.core.SolrCore@50ac3df7 url=http://127.0.0.1:13334/xit/b/collection1 node=127.0.0.1:13334_xit%2Fb C548_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:13334/xit/b, core=collection1, node_name=127.0.0.1:13334_xit%2Fb}
   [junit4]   2> 621559 T1032 C548 P13334 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:13334/xit/b/collection1/
   [junit4]   2> 621560 T1032 C548 P13334 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 621560 T1032 C548 P13334 oasc.SyncStrategy.syncToMe http://127.0.0.1:13334/xit/b/collection1/ has no replicas
   [junit4]   2> 621560 T1032 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:13334/xit/b/collection1/ shard1
   [junit4]   2> 621560 T982 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 621560 T1032 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 621564 T1009 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 621565 T992 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 621565 T1007 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 621565 T1009 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 621565 T1027 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 621570 T982 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 621574 T1009 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 621677 T1027 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 621677 T1009 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 621677 T992 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 621677 T1007 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 621720 T1032 oasc.ZkController.register We are http://127.0.0.1:13334/xit/b/collection1/ and leader is http://127.0.0.1:13334/xit/b/collection1/
   [junit4]   2> 621721 T1032 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:13334/xit/b
   [junit4]   2> 621721 T1032 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 621721 T1032 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 621721 T1032 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 621723 T1009 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 621723 T985 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 621724 T1032 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 621723 T993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 621726 T982 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 621726 T982 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:13334/xit/b",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:13334_xit%2Fb",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node2"}
   [junit4]   2> 621729 T993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 621832 T1007 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 621832 T993 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 621832 T1027 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 621832 T992 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent 

[...truncated too long message...]

re.SolrCore@6487a55d
   [junit4]   2> 671414 T959 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
   [junit4]   2> 671414 T959 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 671415 T959 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 671415 T959 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 671416 T959 oasc.SolrCore.closeSearcher [ocptest_shardsplit_shard1_0_replica1] Closing main searcher on request.
   [junit4]   2> 671416 T959 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 671417 T959 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-006/ocptest_shardsplit_shard1_0_replica1/data [CachedDir<<refCount=0;path=./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-006/ocptest_shardsplit_shard1_0_replica1/data;done=false>>]
   [junit4]   2> 671417 T959 oasc.CachingDirectoryFactory.close Closing directory: ./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-006/ocptest_shardsplit_shard1_0_replica1/data
   [junit4]   2> 671417 T959 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-006/ocptest_shardsplit_shard1_0_replica1/data/index [CachedDir<<refCount=0;path=./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-006/ocptest_shardsplit_shard1_0_replica1/data/index;done=false>>]
   [junit4]   2> 671418 T959 oasc.CachingDirectoryFactory.close Closing directory: ./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-006/ocptest_shardsplit_shard1_0_replica1/data/index
   [junit4]   2> 671418 T1067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 671418 T959 oasc.SolrCore.close [ocptest_shardsplit_shard1_1_replica1]  CLOSING SolrCore org.apache.solr.core.SolrCore@6747044d
   [junit4]   2> 671431 T959 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
   [junit4]   2> 671432 T959 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 671432 T959 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 671432 T959 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 671433 T959 oasc.SolrCore.closeSearcher [ocptest_shardsplit_shard1_1_replica1] Closing main searcher on request.
   [junit4]   2> 671434 T959 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 671434 T959 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-006/ocptest_shardsplit_shard1_1_replica1/data [CachedDir<<refCount=0;path=./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-006/ocptest_shardsplit_shard1_1_replica1/data;done=false>>]
   [junit4]   2> 671434 T959 oasc.CachingDirectoryFactory.close Closing directory: ./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-006/ocptest_shardsplit_shard1_1_replica1/data
   [junit4]   2> 671435 T959 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-006/ocptest_shardsplit_shard1_1_replica1/data/index [CachedDir<<refCount=0;path=./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-006/ocptest_shardsplit_shard1_1_replica1/data/index;done=false>>]
   [junit4]   2> 671435 T959 oasc.CachingDirectoryFactory.close Closing directory: ./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001/tempDir-006/ocptest_shardsplit_shard1_1_replica1/data/index
   [junit4]   2> 671438 T2511 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:57639_xit%2Fb
   [junit4]   2> 672940 T1067 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 672941 T2513 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:302)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:299)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:299)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:316)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:288)
   [junit4]   2> 
   [junit4]   2> 672942 T959 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/xit/b,null}
   [junit4]   2> 676440 T959 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
   [junit4]   2> 676443 T959 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:63017 63017
   [junit4]   2> 676609 T960 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:63017 63017
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=MultiThreadedOCPTest -Dtests.method=testDistribSearch -Dtests.seed=F68153FE96B8AAD7 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=et_EE -Dtests.timezone=Asia/Kuala_Lumpur -Dtests.file.encoding=UTF-8
   [junit4] FAILURE 67.0s J1 | MultiThreadedOCPTest.testDistribSearch <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: We have a failed SPLITSHARD task
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([F68153FE96B8AAD7:7767DDE6E1E7CAEB]:0)
   [junit4]    > 	at org.apache.solr.cloud.MultiThreadedOCPTest.testTaskExclusivity(MultiThreadedOCPTest.java:125)
   [junit4]    > 	at org.apache.solr.cloud.MultiThreadedOCPTest.doTest(MultiThreadedOCPTest.java:71)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 676683 T959 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-F68153FE96B8AAD7-001
   [junit4]   2> 66963 T958 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene49), sim=DefaultSimilarity, locale=et_EE, timezone=Asia/Kuala_Lumpur
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_60 (64-bit)/cpus=16,threads=1,free=145060848,total=469762048
   [junit4]   2> NOTE: All tests run in this JVM: [TestRandomDVFaceting, DeleteReplicaTest, TestReplicationHandler, DirectSolrConnectionTest, TestAddFieldRealTimeGet, TestChildDocTransformer, SolrIndexSplitterTest, ConvertedLegacyTest, TestNonNRTOpen, PrimUtilsTest, MultiThreadedOCPTest]
   [junit4] Completed on J1 in 67.53s, 1 test, 1 failure <<< FAILURES!

[...truncated 1169 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:467: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:447: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:45: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:496: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1299: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:923: There were test failures: 411 suites, 1707 tests, 1 failure, 53 ignored (19 assumptions)

Total time: 119 minutes 50 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-Tests-4.x-Java7 #2040
Archived 3 artifacts
Archive block size is 32768
Received 0 blocks and 189963741 bytes
Compression is 0.0%
Took 32 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 2047 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/2047/

1 tests failed.
FAILED:  org.apache.solr.cloud.MultiThreadedOCPTest.testDistribSearch

Error Message:
We have a failed SPLITSHARD task

Stack Trace:
java.lang.AssertionError: We have a failed SPLITSHARD task
	at __randomizedtesting.SeedInfo.seed([E7DA52ED07612379:663CDCF5703E4345]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.MultiThreadedOCPTest.testTaskExclusivity(MultiThreadedOCPTest.java:125)
	at org.apache.solr.cloud.MultiThreadedOCPTest.doTest(MultiThreadedOCPTest.java:71)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11562 lines...]
   [junit4] Suite: org.apache.solr.cloud.MultiThreadedOCPTest
   [junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/init-core-data-001
   [junit4]   2> 3697920 T10201 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
   [junit4]   2> 3697921 T10201 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /vfcch/
   [junit4]   2> 3697926 T10201 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 3697927 T10201 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 3697928 T10202 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 3698028 T10201 oasc.ZkTestServer.run start zk server on port:51990
   [junit4]   2> 3698030 T10201 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3698034 T10208 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@585c8af7 name:ZooKeeperConnection Watcher:127.0.0.1:51990 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3698034 T10201 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3698034 T10201 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 3698039 T10201 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3698040 T10210 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2bd60545 name:ZooKeeperConnection Watcher:127.0.0.1:51990/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3698041 T10201 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3698041 T10201 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 3698044 T10201 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 3698046 T10201 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 3698047 T10201 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 3698049 T10201 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 3698050 T10201 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 3698053 T10201 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 3698053 T10201 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 3698056 T10201 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 3698056 T10201 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 3698058 T10201 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 3698059 T10201 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 3698061 T10201 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 3698062 T10201 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 3698064 T10201 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 3698064 T10201 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 3698066 T10201 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 3698067 T10201 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 3698069 T10201 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 3698070 T10201 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 3698072 T10201 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 3698073 T10201 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 3698075 T10201 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 3698076 T10201 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 3698078 T10201 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 3698078 T10201 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 3698082 T10201 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3698083 T10212 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@257cd29f name:ZooKeeperConnection Watcher:127.0.0.1:51990/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3698083 T10201 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3699327 T10201 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 3699331 T10201 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 3699335 T10201 oejs.AbstractConnector.doStart Started SslSocketConnector@127.0.0.1:24880
   [junit4]   2> 3699338 T10201 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 3699338 T10201 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 3699338 T10201 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-002
   [junit4]   2> 3699339 T10201 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-002/'
   [junit4]   2> 3699370 T10201 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-002/solr.xml
   [junit4]   2> 3699442 T10201 oasc.CoreContainer.<init> New CoreContainer 891290148
   [junit4]   2> 3699442 T10201 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-002/]
   [junit4]   2> 3699443 T10201 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 3699443 T10201 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 3699444 T10201 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 3699444 T10201 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 3699444 T10201 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 3699444 T10201 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 3699445 T10201 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 3699445 T10201 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 3699445 T10201 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 3699447 T10201 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 3699449 T10201 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 3699449 T10201 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 3699449 T10201 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 3699450 T10201 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51990/solr
   [junit4]   2> 3699450 T10201 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 3699450 T10201 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3699452 T10223 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@70fa75d5 name:ZooKeeperConnection Watcher:127.0.0.1:51990 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3699453 T10201 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3699457 T10201 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3699458 T10225 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6ea1d85d name:ZooKeeperConnection Watcher:127.0.0.1:51990/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3699458 T10201 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3699460 T10201 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 3699462 T10201 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 3699464 T10201 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 3699466 T10201 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 3699468 T10201 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 3699470 T10201 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 3699471 T10201 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:24880_vfcch
   [junit4]   2> 3699472 T10201 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:24880_vfcch
   [junit4]   2> 3699473 T10201 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 3699475 T10201 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 3699477 T10201 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:24880_vfcch
   [junit4]   2> 3699477 T10201 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 3699479 T10201 oasc.Overseer.start Overseer (id=92224851745243140-127.0.0.1:24880_vfcch-n_0000000000) starting
   [junit4]   2> 3699481 T10201 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 3699486 T10227 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 3699487 T10201 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 3699489 T10201 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 3699490 T10201 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 3699491 T10226 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 3699505 T10228 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 3699505 T10228 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 3699506 T10228 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 3699506 T10229 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3699507 T10226 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 3699508 T10226 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:24880/vfcch",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:24880_vfcch",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 3699508 T10226 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 3699508 T10226 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 3699510 T10229 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3699510 T10229 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 3700506 T10228 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 3700507 T10228 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 3700507 T10228 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 3700508 T10228 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 3700508 T10228 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 3700509 T10228 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-002/collection1/'
   [junit4]   2> 3700511 T10228 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-002/collection1/lib/classes/' to classloader
   [junit4]   2> 3700512 T10228 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-002/collection1/lib/README' to classloader
   [junit4]   2> 3700512 T10228 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-002/collection1/lib/.svn/' to classloader
   [junit4]   2> 3700578 T10228 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
   [junit4]   2> 3700627 T10228 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 3700628 T10228 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 3700639 T10228 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 3701174 T10228 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 3701175 T10228 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 3701176 T10228 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 3701190 T10228 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 3701193 T10228 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 3701205 T10228 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 3701210 T10228 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 3701214 T10228 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 3701215 T10228 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 3701215 T10228 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 3701215 T10228 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 3701216 T10228 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 3701216 T10228 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 3701216 T10228 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 3701217 T10228 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 3701217 T10228 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-002/collection1/, dataDir=./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-001/control/data/
   [junit4]   2> 3701217 T10228 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3b839c48
   [junit4]   2> 3701218 T10228 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-001/control/data
   [junit4]   2> 3701218 T10228 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-001/control/data/index/
   [junit4]   2> 3701219 T10228 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
   [junit4]   2> 3701219 T10228 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-001/control/data/index
   [junit4]   2> 3701219 T10228 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=91.2353515625, floorSegmentMB=0.875, forceMergeDeletesPctAllowed=7.996995550491594, segmentsPerTier=40.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.606403223940675
   [junit4]   2> 3701220 T10228 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@504ec82d lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@361f3d5b),segFN=segments_1,generation=1}
   [junit4]   2> 3701221 T10228 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 3701225 T10228 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 3701225 T10228 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 3701225 T10228 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 3701226 T10228 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 3701226 T10228 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 3701226 T10228 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 3701227 T10228 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 3701227 T10228 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 3701227 T10228 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 3701228 T10228 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3701228 T10228 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3701229 T10228 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3701229 T10228 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3701230 T10228 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 3701230 T10228 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 3701230 T10228 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 3701231 T10228 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 3701231 T10228 oasc.RequestHandlers.initHandlersFromConfig WARN Multiple requestHandler registered to the same name: /update ignoring: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3701232 T10228 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 3701232 T10228 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 3701232 T10228 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 3701254 T10228 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3701257 T10228 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3701259 T10228 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3701261 T10228 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3701263 T10228 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3701270 T10228 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 3701270 T10228 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 3701271 T10228 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=13, maxMergeAtOnceExplicit=10, maxMergedSegmentMB=86.125, floorSegmentMB=2.01953125, forceMergeDeletesPctAllowed=15.34754236117492, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 3701272 T10228 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@504ec82d lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@361f3d5b),segFN=segments_1,generation=1}
   [junit4]   2> 3701272 T10228 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 3701272 T10228 oass.SolrIndexSearcher.<init> Opening Searcher@5cf5a5f9[collection1] main
   [junit4]   2> 3701273 T10228 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 3701274 T10228 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 3701274 T10228 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 3701274 T10228 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 3701275 T10228 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 3701275 T10228 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 3701275 T10228 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 3701276 T10228 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 3701276 T10228 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
   [junit4]   2> 3701278 T10228 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
   [junit4]   2> 3701278 T10228 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 3701279 T10228 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 3701282 T10230 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5cf5a5f9[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 3701284 T10228 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 3701285 T10233 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:24880/vfcch collection:control_collection shard:shard1
   [junit4]   2> 3701286 T10201 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
   [junit4]   2> 3701286 T10201 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 3701286 T10233 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 3701291 T10233 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 3701292 T10201 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3701292 T10229 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3701293 T10235 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@536c2580 name:ZooKeeperConnection Watcher:127.0.0.1:51990/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3701293 T10233 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 3701293 T10201 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3701294 T10226 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 3701294 T10233 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C1868 name=collection1 org.apache.solr.core.SolrCore@2da3273a url=https://127.0.0.1:24880/vfcch/collection1 node=127.0.0.1:24880_vfcch C1868_STATE=coll:control_collection core:collection1 props:{state=down, base_url=https://127.0.0.1:24880/vfcch, core=collection1, node_name=127.0.0.1:24880_vfcch}
   [junit4]   2> 3701295 T10233 C1868 P24880 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:24880/vfcch/collection1/
   [junit4]   2> 3701296 T10201 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 3701296 T10233 C1868 P24880 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 3701296 T10233 C1868 P24880 oasc.SyncStrategy.syncToMe https://127.0.0.1:24880/vfcch/collection1/ has no replicas
   [junit4]   2> 3701297 T10233 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:24880/vfcch/collection1/ shard1
   [junit4]   2> 3701297 T10233 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 3701297 T10229 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3701297 T10201 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 3701298 T10236 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 3701298 T10229 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 3701302 T10229 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3701303 T10226 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 3701304 T10229 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3701406 T10229 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 3701406 T10236 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 3701454 T10233 oasc.ZkController.register We are https://127.0.0.1:24880/vfcch/collection1/ and leader is https://127.0.0.1:24880/vfcch/collection1/
   [junit4]   2> 3701455 T10233 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:24880/vfcch
   [junit4]   2> 3701455 T10233 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 3701455 T10233 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
   [junit4]   2> 3701455 T10233 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 3701456 T10229 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3701457 T10237 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3701457 T10238 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3701457 T10233 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 3701458 T10226 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 3701459 T10226 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:24880/vfcch",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:24880_vfcch",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 3701460 T10238 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3701562 T10238 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 3701562 T10236 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 3702709 T10201 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 3702709 T10201 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 3702714 T10201 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 3702716 T10201 oejs.AbstractConnector.doStart Started SslSocketConnector@127.0.0.1:11729
   [junit4]   2> 3702718 T10201 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 3702718 T10201 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 3702718 T10201 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-003
   [junit4]   2> 3702719 T10201 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-003/'
   [junit4]   2> 3702779 T10201 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-003/solr.xml
   [junit4]   2> 3702841 T10201 oasc.CoreContainer.<init> New CoreContainer 1285928103
   [junit4]   2> 3702842 T10201 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-003/]
   [junit4]   2> 3702843 T10201 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 3702843 T10201 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 3702843 T10201 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 3702844 T10201 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 3702844 T10201 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 3702844 T10201 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 3702844 T10201 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 3702844 T10201 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 3702845 T10201 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 3702847 T10201 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 3702848 T10201 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 3702849 T10201 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 3702849 T10201 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 3702849 T10201 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51990/solr
   [junit4]   2> 3702849 T10201 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 3702850 T10201 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3702851 T10249 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7915eb18 name:ZooKeeperConnection Watcher:127.0.0.1:51990 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3702853 T10201 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3702855 T10201 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3702856 T10251 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@63199a5d name:ZooKeeperConnection Watcher:127.0.0.1:51990/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3702856 T10201 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3702861 T10201 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 3703864 T10201 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:11729_vfcch
   [junit4]   2> 3703865 T10201 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:11729_vfcch
   [junit4]   2> 3703868 T10236 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 3703868 T10252 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 3703868 T10238 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 3703876 T10253 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 3703876 T10253 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 3703877 T10238 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3703877 T10237 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3703877 T10229 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3703877 T10253 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 3703878 T10226 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 3703879 T10226 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:11729/vfcch",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:11729_vfcch",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 3703879 T10226 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
   [junit4]   2> 3703879 T10226 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 3703881 T10229 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3703882 T10236 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 3703882 T10252 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 3703882 T10229 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 3704878 T10253 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 3704879 T10253 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 3704880 T10253 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 3704880 T10253 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 3704881 T10253 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 3704881 T10253 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-003/collection1/'
   [junit4]   2> 3704882 T10253 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-003/collection1/lib/.svn/' to classloader
   [junit4]   2> 3704883 T10253 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-003/collection1/lib/README' to classloader
   [junit4]   2> 3704884 T10253 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-003/collection1/lib/classes/' to classloader
   [junit4]   2> 3704950 T10253 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
   [junit4]   2> 3705000 T10253 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 3705001 T10253 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 3705012 T10253 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 3705533 T10253 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 3705535 T10253 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 3705536 T10253 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 3705550 T10253 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 3705554 T10253 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 3705565 T10253 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 3705569 T10253 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 3705573 T10253 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 3705574 T10253 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 3705574 T10253 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 3705575 T10253 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 3705575 T10253 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 3705575 T10253 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 3705576 T10253 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 3705576 T10253 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 3705576 T10253 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-003/collection1/, dataDir=./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-003/collection1/data/
   [junit4]   2> 3705577 T10253 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3b839c48
   [junit4]   2> 3705577 T10253 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-003/collection1/data
   [junit4]   2> 3705578 T10253 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-003/collection1/data/index/
   [junit4]   2> 3705578 T10253 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-003/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 3705578 T10253 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-003/collection1/data/index
   [junit4]   2> 3705579 T10253 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=91.2353515625, floorSegmentMB=0.875, forceMergeDeletesPctAllowed=7.996995550491594, segmentsPerTier=40.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.606403223940675
   [junit4]   2> 3705580 T10253 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@74ab0a6c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1b581772),segFN=segments_1,generation=1}
   [junit4]   2> 3705580 T10253 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 3705585 T10253 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 3705585 T10253 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 3705586 T10253 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 3705586 T10253 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 3705586 T10253 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 3705586 T10253 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 3705587 T10253 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 3705587 T10253 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 3705587 T10253 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 3705588 T10253 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3705589 T10253 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3705589 T10253 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3705590 T10253 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3705590 T10253 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 3705591 T10253 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 3705591 T10253 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 3705592 T10253 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 3705592 T10253 oasc.RequestHandlers.initHandlersFromConfig WARN Multiple requestHandler registered to the same name: /update ignoring: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3705592 T10253 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 3705593 T10253 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 3705593 T10253 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 3705615 T10253 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3705617 T10253 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3705619 T10253 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3705621 T10253 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3705624 T10253 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3705629 T10253 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 3705629 T10253 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 3705630 T10253 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=13, maxMergeAtOnceExplicit=10, maxMergedSegmentMB=86.125, floorSegmentMB=2.01953125, forceMergeDeletesPctAllowed=15.34754236117492, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 3705631 T10253 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@74ab0a6c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1b581772),segFN=segments_1,generation=1}
   [junit4]   2> 3705631 T10253 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 3705631 T10253 oass.SolrIndexSearcher.<init> Opening Searcher@3cb9ff3b[collection1] main
   [junit4]   2> 3705632 T10253 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 3705633 T10253 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 3705633 T10253 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 3705633 T10253 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 3705633 T10253 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 3705634 T10253 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 3705634 T10253 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 3705635 T10253 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 3705635 T10253 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
   [junit4]   2> 3705635 T10253 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 3705639 T10254 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3cb9ff3b[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 3705642 T10253 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 3705643 T10257 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:11729/vfcch collection:collection1 shard:shard2
   [junit4]   2> 3705643 T10201 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
   [junit4]   2> 3705644 T10257 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 3705644 T10201 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 3705648 T10257 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 3705650 T10229 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3705650 T10257 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 3705650 T10257 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C1869 name=collection1 org.apache.solr.core.SolrCore@42e726e url=https://127.0.0.1:11729/vfcch/collection1 node=127.0.0.1:11729_vfcch C1869_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:11729/vfcch, core=collection1, node_name=127.0.0.1:11729_vfcch}
   [junit4]   2> 3705650 T10257 C1869 P11729 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:11729/vfcch/collection1/
   [junit4]   2> 3705651 T10257 C1869 P11729 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 3705651 T10226 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 3705651 T10257 C1869 P11729 oasc.SyncStrategy.syncToMe https://127.0.0.1:11729/vfcch/collection1/ has no replicas
   [junit4]   2> 3705651 T10257 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:11729/vfcch/collection1/ shard2
   [junit4]   2> 3705652 T10257 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 3705653 T10229 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3705653 T10229 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 3705654 T10252 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 3705653 T10236 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 3705656 T10226 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 3705658 T10229 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3705759 T10229 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 3705759 T10252 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 3705759 T10236 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 3705808 T10257 oasc.ZkController.register We are https://127.0.0.1:11729/vfcch/collection1/ and leader is https://127.0.0.1:11729/vfcch/collection1/
   [junit4]   2> 3705809 T10257 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:11729/vfcch
   [junit4]   2> 3705809 T10257 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 3705809 T10257 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 3705809 T10257 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 3705810 T10229 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3705810 T10238 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3705810 T10237 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3705811 T10257 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 3705812 T10226 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 3705813 T10226 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:11729/vfcch",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:11729_vfcch",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 3705814 T10237 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3705916 T10252 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 3705916 T10237 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 3705916 T10236 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 3706832 T10201 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 3706833 T10201 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 3706838 T10201 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 3706840 T10201 oejs.AbstractConnector.doStart Started SslSocketConnector@127.0.0.1:11399
   [junit4]   2> 3706842 T10201 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 3706842 T10201 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 3706843 T10201 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-004
   [junit4]   2> 3706843 T10201 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-004/'
   [junit4]   2> 3706886 T10201 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-004/solr.xml
   [junit4]   2> 3706959 T10201 oasc.CoreContainer.<init> New CoreContainer 920278947
   [junit4]   2> 3706959 T10201 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-004/]
   [junit4]   2> 3706960 T10201 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 3706961 T10201 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 3706961 T10201 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 3706961 T10201 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 3706961 T10201 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 3706962 T10201 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 3706962 T10201 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 3706962 T10201 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 3706962 T10201 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 3706964 T10201 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 3706966 T10201 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 3706966 T10201 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 3706967 T10201 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 3706967 T10201 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51990/solr
   [junit4]   2> 3706967 T10201 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 3706968 T10201 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3706969 T10268 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ef2528e name:ZooKeeperConnection Watcher:127.0.0.1:51990 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3706970 T10201 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3706973 T10201 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3706974 T10270 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12f78e75 name:ZooKeeperConnection Watcher:127.0.0.1:51990/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3706974 T10201 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3706979 T10201 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 3707981 T10201 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:11399_vfcch
   [junit4]   2> 3707982 T10201 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:11399_vfcch
   [junit4]   2> 3707985 T10252 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 3707985 T10271 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 3707985 T10236 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 3707985 T10237 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 3707993 T10272 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 3707993 T10272 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 3707994 T10237 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3707994 T10229 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3707994 T10238 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3707994 T10272 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 3707995 T10226 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 3707995 T10226 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:11399/vfcch",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:11399_vfcch",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 3707996 T10226 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
   [junit4]   2> 3707996 T10226 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 3707997 T10238 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3707998 T10238 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 3707998 T10236 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 3707998 T10271 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 3707998 T10252 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 3708995 T10272 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 3708996 T10272 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 3708997 T10272 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 3708997 T10272 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 3708998 T10272 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 3708998 T10272 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-004/collection1/'
   [junit4]   2> 3709000 T10272 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-004/collection1/lib/classes/' to classloader
   [junit4]   2> 3709001 T10272 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-004/collection1/lib/README' to classloader
   [junit4]   2> 3709001 T10272 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-004/collection1/lib/.svn/' to classloader
   [junit4]   2> 3709067 T10272 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
   [junit4]   2> 3709116 T10272 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 3709117 T10272 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 3709128 T10272 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 3709594 T10272 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 3709596 T10272 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 3709597 T10272 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 3709610 T10272 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 3709614 T10272 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 3709624 T10272 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 3709629 T10272 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 3709633 T10272 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 3709634 T10272 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 3709635 T10272 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 3709635 T10272 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 3709636 T10272 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 3709637 T10272 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 3709637 T10272 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 3709637 T10272 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 3709638 T10272 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-004/collection1/, dataDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-004/collection1/data/
   [junit4]   2> 3709638 T10272 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3b839c48
   [junit4]   2> 3709641 T10272 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-004/collection1/data
   [junit4]   2> 3709641 T10272 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-004/collection1/data/index/
   [junit4]   2> 3709642 T10272 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-004/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 3709642 T10272 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-004/collection1/data/index
   [junit4]   2> 3709643 T10272 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=91.2353515625, floorSegmentMB=0.875, forceMergeDeletesPctAllowed=7.996995550491594, segmentsPerTier=40.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.606403223940675
   [junit4]   2> 3709644 T10272 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@1a1eb0d lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@13b3c201),segFN=segments_1,generation=1}
   [junit4]   2> 3709645 T10272 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 3709652 T10272 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 3709653 T10272 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 3709653 T10272 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 3709654 T10272 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 3709654 T10272 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 3709654 T10272 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 3709655 T10272 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 3709656 T10272 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 3709656 T10272 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 3709657 T10272 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3709657 T10272 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3709658 T10272 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3709658 T10272 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3709659 T10272 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 3709659 T10272 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 3709660 T10272 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 3709660 T10272 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 3709660 T10272 oasc.RequestHandlers.initHandlersFromConfig WARN Multiple requestHandler registered to the same name: /update ignoring: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3709661 T10272 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 3709661 T10272 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 3709662 T10272 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 3709682 T10272 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3709684 T10272 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3709686 T10272 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3709688 T10272 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3709691 T10272 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3709696 T10272 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 3709697 T10272 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 3709697 T10272 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=13, maxMergeAtOnceExplicit=10, maxMergedSegmentMB=86.125, floorSegmentMB=2.01953125, forceMergeDeletesPctAllowed=15.34754236117492, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 3709698 T10272 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@1a1eb0d lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@13b3c201),segFN=segments_1,generation=1}
   [junit4]   2> 3709698 T10272 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 3709699 T10272 oass.SolrIndexSearcher.<init> Opening Searcher@3a345d79[collection1] main
   [junit4]   2> 3709699 T10272 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 3709700 T10272 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 3709700 T10272 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 3709701 T10272 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 3709701 T10272 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 3709701 T10272 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 3709702 T10272 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 3709702 T10272 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 3709703 T10272 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
   [junit4]   2> 3709703 T10272 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 3709707 T10273 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3a345d79[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 3709710 T10272 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 3709711 T10276 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:11399/vfcch collection:collection1 shard:shard1
   [junit4]   2> 3709711 T10201 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
   [junit4]   2> 3709711 T10201 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 3709712 T10276 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 3709715 T10276 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 3709717 T10238 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3709717 T10276 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 3709717 T10276 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C1870 name=collection1 org.apache.solr.core.SolrCore@acc14fe url=https://127.0.0.1:11399/vfcch/collection1 node=127.0.0.1:11399_vfcch C1870_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:11399/vfcch, core=collection1, node_name=127.0.0.1:11399_vfcch}
   [junit4]   2> 3709718 T10276 C1870 P11399 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:11399/vfcch/collection1/
   [junit4]   2> 3709718 T10276 C1870 P11399 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 3709718 T10226 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 3709718 T10276 C1870 P11399 oasc.SyncStrategy.syncToMe https://127.0.0.1:11399/vfcch/collection1/ has no replicas
   [junit4]   2> 3709719 T10276 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:11399/vfcch/collection1/ shard1
   [junit4]   2> 3709719 T10276 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 3709720 T10238 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3709721 T10238 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 3709721 T10236 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 3709721 T10271 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 3709721 T10252 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 3709724 T10226 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 3709726 T10238 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3709827 T10236 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 3709828 T10238 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 3709828 T10271 oascc.ZkS

[...truncated too long message...]

dex [CachedDir<<refCount=0;path=./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-006/ocptest3_shard4_replica1/data/index;done=false>>]
   [junit4]   2> 3811228 T10201 oasc.CachingDirectoryFactory.close Closing directory: ./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-006/ocptest3_shard4_replica1/data/index
   [junit4]   2> 3811228 T10201 oasc.SolrCore.close [ocptest2_shard4_replica1]  CLOSING SolrCore org.apache.solr.core.SolrCore@588d0097
   [junit4]   2> 3811235 T10201 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
   [junit4]   2> 3811236 T10201 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 3811236 T10201 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 3811237 T10201 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 3811237 T10201 oasc.SolrCore.closeSearcher [ocptest2_shard4_replica1] Closing main searcher on request.
   [junit4]   2> 3811238 T10201 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 3811238 T10201 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-006/ocptest2_shard4_replica1/data/index [CachedDir<<refCount=0;path=./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-006/ocptest2_shard4_replica1/data/index;done=false>>]
   [junit4]   2> 3811238 T10201 oasc.CachingDirectoryFactory.close Closing directory: ./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-006/ocptest2_shard4_replica1/data/index
   [junit4]   2> 3811239 T10201 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-006/ocptest2_shard4_replica1/data [CachedDir<<refCount=0;path=./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-006/ocptest2_shard4_replica1/data;done=false>>]
   [junit4]   2> 3811239 T10201 oasc.CachingDirectoryFactory.close Closing directory: ./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001/tempDir-006/ocptest2_shard4_replica1/data
   [junit4]   2> 3811240 T11779 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:48677_vfcch
   [junit4]   2> 3812742 T11781 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:302)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:299)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:299)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:316)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:288)
   [junit4]   2> 
   [junit4]   2> 3812742 T11754 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 3812746 T10201 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/vfcch,null}
   [junit4]   2> 3815426 T10201 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
   [junit4]   2> 3815429 T10201 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:51990 51990
   [junit4]   2> 3816322 T10202 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:51990 51990
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=MultiThreadedOCPTest -Dtests.method=testDistribSearch -Dtests.seed=E7DA52ED07612379 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ga_IE -Dtests.timezone=GB-Eire -Dtests.file.encoding=US-ASCII
   [junit4] FAILURE  118s J1 | MultiThreadedOCPTest.testDistribSearch <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: We have a failed SPLITSHARD task
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([E7DA52ED07612379:663CDCF5703E4345]:0)
   [junit4]    > 	at org.apache.solr.cloud.MultiThreadedOCPTest.testTaskExclusivity(MultiThreadedOCPTest.java:125)
   [junit4]    > 	at org.apache.solr.cloud.MultiThreadedOCPTest.doTest(MultiThreadedOCPTest.java:71)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 3816352 T10201 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-E7DA52ED07612379-001
   [junit4]   2> NOTE: test params are: codec=Lucene40, sim=DefaultSimilarity, locale=ga_IE, timezone=GB-Eire
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_60 (64-bit)/cpus=16,threads=1,free=254698056,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [CoreAdminHandlerTest, AtomicUpdatesTest, TestCollationField, UUIDUpdateProcessorFallbackTest, TestRealTimeGet, QueryElevationComponentTest, DistributedIntervalFacetingTest, TestQuerySenderNoQuery, CurrencyFieldXmlFileTest, TestArbitraryIndexDir, BlockCacheTest, TestFieldCollectionResource, TestDFRSimilarityFactory, EchoParamsTest, CursorPagingTest, TestQueryTypes, TestQuerySenderListener, CoreContainerCoreInitFailuresTest, ConnectionManagerTest, TestCoreDiscovery, BadCopyFieldTest, TermVectorComponentTest, TestReplicationHandler, SpellPossibilityIteratorTest, ResourceLoaderTest, TestValueSourceCache, SolrXmlInZkTest, TestDefaultSimilarityFactory, DistanceFunctionTest, TestLFUCache, TestCodecSupport, TestSchemaNameResource, SortByFunctionTest, RegexBoostProcessorTest, CustomCollectionTest, TestSolrXMLSerializer, TestOmitPositions, TestBM25SimilarityFactory, TestReplicationHandlerBackup, PathHierarchyTokenizerFactoryTest, TestCollectionAPI, FieldMutatingUpdateProcessorTest, AddSchemaFieldsUpdateProcessorFactoryTest, TestNumberUtils, StressHdfsTest, TestFoldingMultitermQuery, TestRTGBase, TestSolrQueryParserDefaultOperatorResource, TestFiltering, TestCopyFieldCollectionResource, TestSolrDeletionPolicy1, WordBreakSolrSpellCheckerTest, EnumFieldTest, ConvertedLegacyTest, TestBinaryResponseWriter, CursorMarkTest, TestLuceneMatchVersion, DocValuesTest, TestConfigSets, ResponseLogComponentTest, CachingDirectoryFactoryTest, TestManagedResourceStorage, AnalyticsMergeStrategyTest, TestUniqueKeyFieldResource, PreAnalyzedFieldTest, SolrCmdDistributorTest, SolrIndexConfigTest, SuggesterTest, XmlUpdateRequestHandlerTest, TestPhraseSuggestions, OutputWriterTest, TestSearcherReuse, MigrateRouteKeyTest, DistributedQueryComponentOptimizationTest, DateMathParserTest, HighlighterTest, TestGroupingSearch, TestRandomMergePolicy, QueryResultKeyTest, TestMiniSolrCloudCluster, SolrTestCaseJ4Test, SystemInfoHandlerTest, DistributedExpandComponentTest, JSONWriterTest, ShardRoutingCustomTest, TestSimpleQParserPlugin, TestCSVLoader, SpellCheckCollatorTest, SimplePostToolTest, TestUtils, CacheHeaderTest, OverseerRolesTest, TestInitQParser, HdfsCollectionsAPIDistributedZkTest, HdfsLockFactoryTest, SyncSliceTest, TestSurroundQueryParser, TestSolrIndexConfig, ChaosMonkeySafeLeaderTest, RollingRestartTest, ShardSplitTest, CollectionsAPIDistributedZkTest, TestDistributedSearch, TestCloudSchemaless, MultiThreadedOCPTest]
   [junit4] Completed on J1 in 118.47s, 1 test, 1 failure <<< FAILURES!

[...truncated 616 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:467: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:447: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:45: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:496: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1299: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:923: There were test failures: 411 suites, 1707 tests, 1 failure, 52 ignored (18 assumptions)

Total time: 126 minutes 56 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-Tests-4.x-Java7 #2040
Archived 3 artifacts
Archive block size is 32768
Received 0 blocks and 195414824 bytes
Compression is 0.0%
Took 34 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 2046 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/2046/

1 tests failed.
FAILED:  org.apache.solr.cloud.MultiThreadedOCPTest.testDistribSearch

Error Message:
We have a failed SPLITSHARD task

Stack Trace:
java.lang.AssertionError: We have a failed SPLITSHARD task
	at __randomizedtesting.SeedInfo.seed([EA97083AC58390AA:6B718622B2DCF096]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.MultiThreadedOCPTest.testTaskExclusivity(MultiThreadedOCPTest.java:125)
	at org.apache.solr.cloud.MultiThreadedOCPTest.doTest(MultiThreadedOCPTest.java:71)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 10987 lines...]
   [junit4] Suite: org.apache.solr.cloud.MultiThreadedOCPTest
   [junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/init-core-data-001
   [junit4]   2> 737772 T5436 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 737773 T5436 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 737778 T5436 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 737779 T5436 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 737780 T5437 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 737880 T5436 oasc.ZkTestServer.run start zk server on port:59768
   [junit4]   2> 737882 T5436 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 737885 T5443 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2ff6153d name:ZooKeeperConnection Watcher:127.0.0.1:59768 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 737885 T5436 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 737886 T5436 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 737890 T5436 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 737891 T5445 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@46ce6989 name:ZooKeeperConnection Watcher:127.0.0.1:59768/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 737891 T5436 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 737891 T5436 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 737894 T5436 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 737896 T5436 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 737898 T5436 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 737900 T5436 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 737901 T5436 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 737904 T5436 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 737905 T5436 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 738007 T5436 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 738007 T5436 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 738010 T5436 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 738010 T5436 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 738013 T5436 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 738013 T5436 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 738016 T5436 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 738016 T5436 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 738018 T5436 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 738019 T5436 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 738021 T5436 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 738022 T5436 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 738024 T5436 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 738025 T5436 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 738027 T5436 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 738028 T5436 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 738030 T5436 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 738030 T5436 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 739085 T5436 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 739090 T5436 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:64920
   [junit4]   2> 739091 T5436 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 739091 T5436 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 739091 T5436 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-002
   [junit4]   2> 739092 T5436 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-002/'
   [junit4]   2> 739122 T5436 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-002/solr.xml
   [junit4]   2> 739176 T5436 oasc.CoreContainer.<init> New CoreContainer 657716368
   [junit4]   2> 739176 T5436 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-002/]
   [junit4]   2> 739177 T5436 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 739177 T5436 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 739178 T5436 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 739178 T5436 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 739178 T5436 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 739178 T5436 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 739179 T5436 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 739179 T5436 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 739179 T5436 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 739180 T5436 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 739180 T5436 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 739180 T5436 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 739181 T5436 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 739181 T5436 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59768/solr
   [junit4]   2> 739181 T5436 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 739182 T5436 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 739183 T5456 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@43fd2e0b name:ZooKeeperConnection Watcher:127.0.0.1:59768 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 739184 T5436 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 739186 T5436 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 739187 T5458 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5baecab9 name:ZooKeeperConnection Watcher:127.0.0.1:59768/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 739187 T5436 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 739189 T5436 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 739191 T5436 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 739194 T5436 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 739196 T5436 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 739198 T5436 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 739200 T5436 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 739201 T5436 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64920_
   [junit4]   2> 739202 T5436 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:64920_
   [junit4]   2> 739204 T5436 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 739205 T5436 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 739208 T5436 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:64920_
   [junit4]   2> 739208 T5436 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 739210 T5436 oasc.Overseer.start Overseer (id=92214587333083139-127.0.0.1:64920_-n_0000000000) starting
   [junit4]   2> 739212 T5436 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 739218 T5460 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 739218 T5436 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 739220 T5436 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 739221 T5436 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 739223 T5459 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 739228 T5461 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 739228 T5461 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 739229 T5461 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 739229 T5462 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 739231 T5459 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 739231 T5459 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:64920",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:64920_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 739231 T5459 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 739232 T5459 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 739233 T5462 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 739234 T5462 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 740229 T5461 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 740230 T5461 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 740231 T5461 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 740231 T5461 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 740232 T5461 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 740232 T5461 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-002/collection1/'
   [junit4]   2> 740234 T5461 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-002/collection1/lib/classes/' to classloader
   [junit4]   2> 740234 T5461 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-002/collection1/lib/README' to classloader
   [junit4]   2> 740235 T5461 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-002/collection1/lib/.svn/' to classloader
   [junit4]   2> 740323 T5461 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
   [junit4]   2> 740372 T5461 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 740473 T5461 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 740484 T5461 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 740919 T5461 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 740919 T5461 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 740920 T5461 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 740934 T5461 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 740938 T5461 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 740950 T5461 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 740955 T5461 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 740959 T5461 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 740960 T5461 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 740960 T5461 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 740960 T5461 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 740961 T5461 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 740961 T5461 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 740962 T5461 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 740962 T5461 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 740962 T5461 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-002/collection1/, dataDir=./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-001/control/data/
   [junit4]   2> 740963 T5461 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5628c7f8
   [junit4]   2> 740964 T5461 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-001/control/data
   [junit4]   2> 740964 T5461 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-001/control/data/index/
   [junit4]   2> 740964 T5461 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
   [junit4]   2> 740964 T5461 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-001/control/data/index
   [junit4]   2> 740965 T5461 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=41, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 740966 T5461 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@111a9a00 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1f108a1),segFN=segments_1,generation=1}
   [junit4]   2> 740966 T5461 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 740971 T5461 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 740971 T5461 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 740972 T5461 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 740972 T5461 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 740972 T5461 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 740972 T5461 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 740973 T5461 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 740973 T5461 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 740974 T5461 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 740974 T5461 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 740975 T5461 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 740975 T5461 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 740976 T5461 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 740976 T5461 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 740977 T5461 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 740977 T5461 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 740978 T5461 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 740978 T5461 oasc.RequestHandlers.initHandlersFromConfig WARN Multiple requestHandler registered to the same name: /update ignoring: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 740978 T5461 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 740979 T5461 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 740979 T5461 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 740998 T5461 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 741000 T5461 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 741002 T5461 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 741004 T5461 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 741006 T5461 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 741012 T5461 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 741012 T5461 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 741013 T5461 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=20, maxMergedSegmentMB=85.5556640625, floorSegmentMB=1.986328125, forceMergeDeletesPctAllowed=3.572738955541407, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 741014 T5461 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@111a9a00 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1f108a1),segFN=segments_1,generation=1}
   [junit4]   2> 741014 T5461 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 741014 T5461 oass.SolrIndexSearcher.<init> Opening Searcher@10ca407d[collection1] main
   [junit4]   2> 741014 T5461 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 741015 T5461 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 741016 T5461 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 741016 T5461 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 741016 T5461 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 741017 T5461 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 741017 T5461 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 741018 T5461 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 741018 T5461 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
   [junit4]   2> 741020 T5461 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
   [junit4]   2> 741020 T5461 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 741021 T5461 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 741024 T5463 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@10ca407d[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 741028 T5461 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 741028 T5466 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:64920 collection:control_collection shard:shard1
   [junit4]   2> 741029 T5436 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
   [junit4]   2> 741029 T5436 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 741029 T5466 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 741031 T5436 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 741032 T5468 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@79894a99 name:ZooKeeperConnection Watcher:127.0.0.1:59768/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 741032 T5436 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 741034 T5436 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 741036 T5466 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 741036 T5436 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 741037 T5462 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 741037 T5466 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 741038 T5466 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C320 name=collection1 org.apache.solr.core.SolrCore@5d50168b url=http://127.0.0.1:64920/collection1 node=127.0.0.1:64920_ C320_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:64920, core=collection1, node_name=127.0.0.1:64920_}
   [junit4]   2> 741038 T5466 C320 P64920 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:64920/collection1/
   [junit4]   2> 741038 T5466 C320 P64920 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 741038 T5459 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 741039 T5466 C320 P64920 oasc.SyncStrategy.syncToMe http://127.0.0.1:64920/collection1/ has no replicas
   [junit4]   2> 741039 T5466 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:64920/collection1/ shard1
   [junit4]   2> 741039 T5466 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 741041 T5462 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 741041 T5462 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 741042 T5469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 741045 T5459 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 741047 T5462 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 741148 T5462 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 741148 T5469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 741197 T5466 oasc.ZkController.register We are http://127.0.0.1:64920/collection1/ and leader is http://127.0.0.1:64920/collection1/
   [junit4]   2> 741198 T5466 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:64920
   [junit4]   2> 741198 T5466 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 741198 T5466 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
   [junit4]   2> 741198 T5466 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 741199 T5462 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 741200 T5470 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 741200 T5466 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 741200 T5471 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 741201 T5459 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 741202 T5459 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:64920",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:64920_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 741204 T5471 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 741305 T5471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 741305 T5469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 742105 T5436 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 742106 T5436 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 742109 T5436 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:54293
   [junit4]   2> 742110 T5436 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 742110 T5436 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 742110 T5436 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-003
   [junit4]   2> 742110 T5436 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-003/'
   [junit4]   2> 742141 T5436 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-003/solr.xml
   [junit4]   2> 742196 T5436 oasc.CoreContainer.<init> New CoreContainer 878802189
   [junit4]   2> 742196 T5436 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-003/]
   [junit4]   2> 742197 T5436 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 742197 T5436 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 742198 T5436 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 742198 T5436 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 742198 T5436 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 742198 T5436 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 742199 T5436 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 742199 T5436 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 742199 T5436 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 742200 T5436 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 742200 T5436 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 742200 T5436 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 742201 T5436 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 742201 T5436 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59768/solr
   [junit4]   2> 742201 T5436 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 742202 T5436 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 742203 T5482 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6a4bc358 name:ZooKeeperConnection Watcher:127.0.0.1:59768 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 742204 T5436 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 742206 T5436 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 742207 T5484 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@634c00c5 name:ZooKeeperConnection Watcher:127.0.0.1:59768/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 742207 T5436 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 742213 T5436 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 743215 T5436 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54293_
   [junit4]   2> 743216 T5436 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54293_
   [junit4]   2> 743236 T5471 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 743236 T5485 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 743236 T5469 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 743243 T5486 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 743243 T5486 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 743244 T5471 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 743244 T5462 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 743244 T5486 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 743244 T5470 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 743245 T5459 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 743246 T5459 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:54293",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:54293_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 743246 T5459 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
   [junit4]   2> 743246 T5459 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 743248 T5470 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 743249 T5485 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 743249 T5470 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 743249 T5469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 744245 T5486 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 744246 T5486 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 744246 T5486 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 744247 T5486 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 744247 T5486 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 744248 T5486 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-003/collection1/'
   [junit4]   2> 744249 T5486 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-003/collection1/lib/.svn/' to classloader
   [junit4]   2> 744250 T5486 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-003/collection1/lib/classes/' to classloader
   [junit4]   2> 744250 T5486 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-003/collection1/lib/README' to classloader
   [junit4]   2> 744316 T5486 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
   [junit4]   2> 744364 T5486 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 744465 T5486 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 744476 T5486 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 744912 T5486 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 744914 T5486 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 744915 T5486 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 744929 T5486 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 744932 T5486 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 744944 T5486 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 744949 T5486 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 744953 T5486 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 744954 T5486 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 744954 T5486 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 744955 T5486 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 744956 T5486 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 744956 T5486 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 744956 T5486 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 744956 T5486 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 744957 T5486 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-003/collection1/, dataDir=./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-003/collection1/data/
   [junit4]   2> 744957 T5486 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5628c7f8
   [junit4]   2> 744958 T5486 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-003/collection1/data
   [junit4]   2> 744958 T5486 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-003/collection1/data/index/
   [junit4]   2> 744958 T5486 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-003/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 744959 T5486 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-003/collection1/data/index
   [junit4]   2> 744959 T5486 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=41, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 744960 T5486 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@695e78a8 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@59db3440),segFN=segments_1,generation=1}
   [junit4]   2> 744961 T5486 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 744966 T5486 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 744967 T5486 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 744967 T5486 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 744967 T5486 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 744968 T5486 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 744968 T5486 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 744968 T5486 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 744969 T5486 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 744969 T5486 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 744970 T5486 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 744970 T5486 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 744971 T5486 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 744972 T5486 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 744972 T5486 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 744973 T5486 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 744973 T5486 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 744974 T5486 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 744974 T5486 oasc.RequestHandlers.initHandlersFromConfig WARN Multiple requestHandler registered to the same name: /update ignoring: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 744975 T5486 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 744975 T5486 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 744976 T5486 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 744994 T5486 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 744996 T5486 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 744999 T5486 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 745001 T5486 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 745003 T5486 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 745007 T5486 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 745008 T5486 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 745009 T5486 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=20, maxMergedSegmentMB=85.5556640625, floorSegmentMB=1.986328125, forceMergeDeletesPctAllowed=3.572738955541407, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 745009 T5486 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@695e78a8 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@59db3440),segFN=segments_1,generation=1}
   [junit4]   2> 745010 T5486 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 745010 T5486 oass.SolrIndexSearcher.<init> Opening Searcher@27377ebd[collection1] main
   [junit4]   2> 745010 T5486 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 745011 T5486 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 745011 T5486 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 745012 T5486 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 745012 T5486 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 745012 T5486 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 745013 T5486 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 745014 T5486 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 745014 T5486 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
   [junit4]   2> 745014 T5486 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 745019 T5487 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@27377ebd[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 745023 T5486 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 745024 T5490 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:54293 collection:collection1 shard:shard2
   [junit4]   2> 745024 T5436 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
   [junit4]   2> 745025 T5436 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 745025 T5490 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 745030 T5490 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 745031 T5470 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 745032 T5490 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 745032 T5490 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C321 name=collection1 org.apache.solr.core.SolrCore@59ee3b78 url=http://127.0.0.1:54293/collection1 node=127.0.0.1:54293_ C321_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:54293, core=collection1, node_name=127.0.0.1:54293_}
   [junit4]   2> 745032 T5490 C321 P54293 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:54293/collection1/
   [junit4]   2> 745032 T5490 C321 P54293 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 745033 T5459 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 745033 T5490 C321 P54293 oasc.SyncStrategy.syncToMe http://127.0.0.1:54293/collection1/ has no replicas
   [junit4]   2> 745033 T5490 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:54293/collection1/ shard2
   [junit4]   2> 745033 T5490 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 745035 T5470 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 745036 T5470 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 745036 T5469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 745036 T5485 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 745038 T5470 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 745039 T5459 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 745041 T5470 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 745142 T5485 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 745142 T5470 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 745142 T5469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 745191 T5490 oasc.ZkController.register We are http://127.0.0.1:54293/collection1/ and leader is http://127.0.0.1:54293/collection1/
   [junit4]   2> 745192 T5490 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54293
   [junit4]   2> 745192 T5490 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 745192 T5490 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 745192 T5490 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 745193 T5470 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 745193 T5471 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 745193 T5462 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 745194 T5490 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 745195 T5459 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 745196 T5459 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:54293",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:54293_",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 745197 T5462 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 745299 T5469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 745299 T5462 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 745299 T5485 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 746090 T5436 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 746091 T5436 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 746094 T5436 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:65364
   [junit4]   2> 746094 T5436 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 746095 T5436 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 746095 T5436 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-004
   [junit4]   2> 746095 T5436 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-004/'
   [junit4]   2> 746125 T5436 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-004/solr.xml
   [junit4]   2> 746194 T5436 oasc.CoreContainer.<init> New CoreContainer 716898859
   [junit4]   2> 746195 T5436 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-004/]
   [junit4]   2> 746196 T5436 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 746196 T5436 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 746196 T5436 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 746197 T5436 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 746197 T5436 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 746197 T5436 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 746197 T5436 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 746198 T5436 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 746198 T5436 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 746198 T5436 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 746199 T5436 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 746199 T5436 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 746199 T5436 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 746200 T5436 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59768/solr
   [junit4]   2> 746200 T5436 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 746201 T5436 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 746202 T5501 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5b8b6af7 name:ZooKeeperConnection Watcher:127.0.0.1:59768 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 746203 T5436 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 746205 T5436 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 746206 T5503 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3d9fb2b3 name:ZooKeeperConnection Watcher:127.0.0.1:59768/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 746206 T5436 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 746211 T5436 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 747214 T5436 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65364_
   [junit4]   2> 747215 T5436 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:65364_
   [junit4]   2> 747218 T5469 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 747218 T5485 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 747218 T5504 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 747218 T5462 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 747225 T5505 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 747225 T5505 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 747226 T5462 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 747226 T5470 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 747226 T5505 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 747226 T5471 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 747227 T5459 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 747228 T5459 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:65364",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:65364_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 747228 T5459 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
   [junit4]   2> 747229 T5459 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 747230 T5471 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 747231 T5485 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 747231 T5471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 747231 T5504 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 747231 T5469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 748227 T5505 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 748228 T5505 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 748229 T5505 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 748229 T5505 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 748230 T5505 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 748230 T5505 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-004/collection1/'
   [junit4]   2> 748232 T5505 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-004/collection1/lib/.svn/' to classloader
   [junit4]   2> 748233 T5505 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-004/collection1/lib/README' to classloader
   [junit4]   2> 748233 T5505 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-004/collection1/lib/classes/' to classloader
   [junit4]   2> 748299 T5505 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
   [junit4]   2> 748348 T5505 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 748449 T5505 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 748460 T5505 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 748895 T5505 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 748896 T5505 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 748897 T5505 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 748911 T5505 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 748914 T5505 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 748927 T5505 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 748931 T5505 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 748936 T5505 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 748936 T5505 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 748937 T5505 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 748937 T5505 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 748938 T5505 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 748938 T5505 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 748938 T5505 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 748939 T5505 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 748939 T5505 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-004/collection1/, dataDir=./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-004/collection1/data/
   [junit4]   2> 748939 T5505 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5628c7f8
   [junit4]   2> 748940 T5505 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-004/collection1/data
   [junit4]   2> 748941 T5505 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-004/collection1/data/index/
   [junit4]   2> 748941 T5505 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-004/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 748941 T5505 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-004/collection1/data/index
   [junit4]   2> 748942 T5505 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=41, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 748943 T5505 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@780a667f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7d2b437e),segFN=segments_1,generation=1}
   [junit4]   2> 748943 T5505 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 748949 T5505 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 748949 T5505 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 748950 T5505 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 748950 T5505 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 748950 T5505 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 748950 T5505 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 748951 T5505 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 748951 T5505 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 748952 T5505 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 748952 T5505 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 748953 T5505 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 748954 T5505 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 748954 T5505 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 748955 T5505 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 748956 T5505 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 748956 T5505 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 748956 T5505 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 748957 T5505 oasc.RequestHandlers.initHandlersFromConfig WARN Multiple requestHandler registered to the same name: /update ignoring: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 748957 T5505 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 748958 T5505 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 748958 T5505 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 748977 T5505 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 748979 T5505 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 748981 T5505 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 748983 T5505 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 748985 T5505 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 748990 T5505 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 748990 T5505 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 748991 T5505 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=20, maxMergedSegmentMB=85.5556640625, floorSegmentMB=1.986328125, forceMergeDeletesPctAllowed=3.572738955541407, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 748992 T5505 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@780a667f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7d2b437e),segFN=segments_1,generation=1}
   [junit4]   2> 748992 T5505 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 748993 T5505 oass.SolrIndexSearcher.<init> Opening Searcher@1c443b17[collection1] main
   [junit4]   2> 748993 T5505 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 748994 T5505 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 748994 T5505 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 748995 T5505 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 748995 T5505 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 748995 T5505 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 748996 T5505 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 748996 T5505 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 748997 T5505 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
   [junit4]   2> 748997 T5505 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 749001 T5506 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1c443b17[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 749006 T5505 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 749006 T5509 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:65364 collection:collection1 shard:shard1
   [junit4]   2> 749007 T5436 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
   [junit4]   2> 749007 T5436 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 749007 T5509 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 749012 T5509 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 749013 T5471 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 749014 T5509 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 749014 T5509 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C322 name=collection1 org.apache.solr.core.SolrCore@1ed9a7bc url=http://127.0.0.1:65364/collection1 node=127.0.0.1:65364_ C322_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:65364, core=collection1, node_name=127.0.0.1:65364_}
   [junit4]   2> 749014 T5509 C322 P65364 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:65364/collection1/
   [junit4]   2> 749015 T5509 C322 P65364 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 749015 T5459 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 749015 T5509 C322 P65364 oasc.SyncStrategy.syncToMe http://127.0.0.1:65364/collection1/ has no replicas
   [junit4]   2> 749015 T5509 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:65364/collection1/ shard1
   [junit4]   2> 749016 T5509 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 749017 T5471 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 749018 T5485 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 749018 T5471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 749018 T5469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 749018 T5504 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 749021 T5459 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 749023 T5471 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 749124 T5504 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 749124 T5469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 749124 T5471 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 749124 T5485 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 749172 T5509 oasc.ZkController.register We are http://127.0.0.1:65364/collection1/ and leader is http://127.0.0.1:65364/collection1/
   [junit4]   2> 749173 T5509 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:65364
   [junit4]   2> 749173 T5509 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 749173 T5509 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 749173 T5509 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 749174 T5471 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 749175 T5462 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 749175 T5470 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 749175 T5509 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 749176 T5459 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 749177 T5459 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:65364",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:65364_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node2"}
   [junit4]   2> 749179 T5470 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 749280 T5470 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 749280 T5485 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 749280 T5504 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 749280 T5469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 750079 T5436 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
   [junit4]   2> 750079 T5436 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 750082 T5436 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:47329
   [junit4]   2> 750083 T5436 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 750083 T5436 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 750083 T5436 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-005
   [junit4]   2> 750084 T5436 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-005/'
   [junit4]   2> 750114 T5436 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-005/solr.xml
   [junit4]   2> 750167 T5436 oasc.CoreContainer.<init> New CoreContainer 564521284
   [junit4]   2> 750168 T5436 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tem

[...truncated too long message...]

../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-006/ocptest3_shard2_replica1/data
   [junit4]   2> 792707 T5436 oasc.CachingDirectoryFactory.closeCacheValue looking to close ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-006/ocptest3_shard2_replica1/data/index [CachedDir<<refCount=0;path=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-006/ocptest3_shard2_replica1/data/index;done=false>>]
   [junit4]   2> 792707 T5436 oasc.CachingDirectoryFactory.close Closing directory: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-006/ocptest3_shard2_replica1/data/index
   [junit4]   2> 792708 T5436 oasc.SolrCore.close [ocptest_shardsplit_shard3_replica1]  CLOSING SolrCore org.apache.solr.core.SolrCore@506fc553
   [junit4]   2> 792718 T5436 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
   [junit4]   2> 792719 T5436 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 792719 T5436 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 792720 T5436 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 792720 T5436 oasc.SolrCore.closeSearcher [ocptest_shardsplit_shard3_replica1] Closing main searcher on request.
   [junit4]   2> 792721 T5436 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 792721 T5436 oasc.CachingDirectoryFactory.closeCacheValue looking to close ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-006/ocptest_shardsplit_shard3_replica1/data/index [CachedDir<<refCount=0;path=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-006/ocptest_shardsplit_shard3_replica1/data/index;done=false>>]
   [junit4]   2> 792721 T5436 oasc.CachingDirectoryFactory.close Closing directory: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-006/ocptest_shardsplit_shard3_replica1/data/index
   [junit4]   2> 792722 T5436 oasc.CachingDirectoryFactory.closeCacheValue looking to close ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-006/ocptest_shardsplit_shard3_replica1/data [CachedDir<<refCount=0;path=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-006/ocptest_shardsplit_shard3_replica1/data;done=false>>]
   [junit4]   2> 792722 T5436 oasc.CachingDirectoryFactory.close Closing directory: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001/tempDir-006/ocptest_shardsplit_shard3_replica1/data
   [junit4]   2> 792723 T6973 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:22978_
   [junit4]   2> 792726 T6975 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:302)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:299)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:299)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:316)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:288)
   [junit4]   2> 
   [junit4]   2> 794225 T5544 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 794227 T5436 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
   [junit4]   2> 799100 T5436 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
   [junit4]   2> 799102 T5436 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:59768 59768
   [junit4]   2> 799222 T5437 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:59768 59768
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=MultiThreadedOCPTest -Dtests.method=testDistribSearch -Dtests.seed=EA97083AC58390AA -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es_PY -Dtests.timezone=Etc/GMT-5 -Dtests.file.encoding=US-ASCII
   [junit4] FAILURE 61.5s J1 | MultiThreadedOCPTest.testDistribSearch <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: We have a failed SPLITSHARD task
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([EA97083AC58390AA:6B718622B2DCF096]:0)
   [junit4]    > 	at org.apache.solr.cloud.MultiThreadedOCPTest.testTaskExclusivity(MultiThreadedOCPTest.java:125)
   [junit4]    > 	at org.apache.solr.cloud.MultiThreadedOCPTest.doTest(MultiThreadedOCPTest.java:71)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 799238 T5436 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-EA97083AC58390AA-001
   [junit4]   2> NOTE: test params are: codec=Lucene46, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=es_PY, timezone=Etc/GMT-5
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_60 (64-bit)/cpus=16,threads=1,free=285334640,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [CustomCollectionTest, RecoveryZkTest, DeleteReplicaTest, TestAddFieldRealTimeGet, TestRandomDVFaceting, TestDynamicFieldCollectionResource, HdfsChaosMonkeySafeLeaderTest, TestCSVLoader, TestExtendedDismaxParser, IndexSchemaTest, TestUpdate, TestFuzzyAnalyzedSuggestions, DirectSolrConnectionTest, ClusterStateTest, TestComponentsName, TestValueSourceCache, FieldMutatingUpdateProcessorTest, CacheHeaderTest, TestLMDirichletSimilarityFactory, SimplePostToolTest, PeerSyncTest, AssignTest, TestShortCircuitedRequests, SolrCmdDistributorTest, PrimUtilsTest, BadIndexSchemaTest, TestStressLucene, TestPHPSerializedResponseWriter, RAMDirectoryFactoryTest, AlternateDirectoryTest, ChaosMonkeySafeLeaderTest, ScriptEngineTest, TestManagedResource, ShardRoutingCustomTest, TestZkChroot, MultiThreadedOCPTest]
   [junit4] Completed on J1 in 61.51s, 1 test, 1 failure <<< FAILURES!

[...truncated 1189 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:467: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:447: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:45: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:496: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1299: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:923: There were test failures: 411 suites, 1707 tests, 1 failure, 52 ignored (18 assumptions)

Total time: 123 minutes 32 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-Tests-4.x-Java7 #2040
Archived 3 artifacts
Archive block size is 32768
Received 0 blocks and 191015601 bytes
Compression is 0.0%
Took 33 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 2045 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/2045/

1 tests failed.
REGRESSION:  org.apache.lucene.analysis.icu.segmentation.TestICUTokenizerCJK.testRandomHugeStrings

Error Message:
some thread(s) failed

Stack Trace:
java.lang.RuntimeException: some thread(s) failed
	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:535)
	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:437)
	at org.apache.lucene.analysis.icu.segmentation.TestICUTokenizerCJK.testRandomHugeStrings(TestICUTokenizerCJK.java:89)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 6276 lines...]
   [junit4] Suite: org.apache.lucene.analysis.icu.segmentation.TestICUTokenizerCJK
   [junit4]   2> TEST FAIL: useCharFilter=false text='dRCgl \ufe5c\ufe57\ufe59\ufe64 p rw glpnydoimb \uabd4\uabe7\uabe0\uabf8\uabf2\uabec\uabc6\uabd0 z <!----><  qrRCGb  nmhegacernj kdbpkj \ue4f00);\u0614\u0014 \u4dca\u4ded\u4dc3\u4de6\u4df1\u4df9\u4dfc gjx zehfxgi \udb40\udc37 162917660  cBnwIydqgxD <! \u0833 h\ufb07\u0f5a\u0250\ua9ff\uea15 \ufd93\ua016v\ud960\udf22\udbf3\udc4a\u01edo \u2de3\u2df0\u2deb\u2de3\u2dea\u2de9\u2de7\u2dec     bistb afkbolj  vqh sixevynx ofluvcvyvslw \ud802\udf49\ud802\udf4d\ud802\udf46\ud802\udf50 n\u0350\uc897\ud833\udf6c bwovtywapb xy \u029a\n\u041dd \u1a1e\u1a07\u1a0d\u1a1f \udad6\uded6\ufb30\u06c9\\\uf78a\u03aa etppkTibXV  \u044c\udb34\udeec \ud802\udf52\ud802\udf58  \ud802\udd29\ud802\udd33\ud802\udd27 \u19ba \ufc9e\u0735\uda79\ude1e\ue6c9\u05ab\u017b\udb06\udd23\u76b8  hcdeef \ua66e\ua654\ua692\ua675\ua69c\ua658\ua683\ua654 iketfjq \ud804\ude77\u02a7\uf074\ufc12\ue3f5 zzmc pqpxjwsmr \u0649\u06c7\u06f1\u06b2 \uf8c6\r mhdnieh dFOz??T eo armrnsq hiiel chtdzhl \u3190\u3197\u3192\u3192\u319a\u3193 dlfy \u0bbd\u0ba2\u0bcc\u0ba5\u0b9f \u11ef\u1194\u118c\u11c8\u11f0\u1102\u1177\u11c4\u11e9\u115e\u1162\u116b \u2c40\u2c3d\u2c1b\u2c0d\u2c2b\u2c47\u2c55 rbm f-zj|xps(({ \u19c5 \u04e4 seb \"\\\"<   \u6228h\uda73\udef4\u000e\u07e6\u001a xacuqpahij hqrgs jujkzg xsm  CqT wkeo \uaa0c\uaa33\uaa49\uaa4b\uaa48\uaa49 \u3113\u3104\u3126\u3106\u3129 \u54c4\u2e50w\u2bd5\u035e\u02d8\u00cd \u19ca \u1dd8 grjxl \ufcdb\u02c3\ud9e3\udec5\u1bc2 iuhn G\u034c\ud8c7\ude3d\u02e3\u01d1< \ud802\udd21\ud802\udd2d\ud802\udd2a ckbtyc |)(|v ymacy \u2b86\u2b04\u2bb3 5i\ub0b4  pa|]iy)  \u0007\u0580\u0447 \ud91e\udf9aD\ud9fa\udfb8\udb4d\udc3b\uda13\udc47\ud92e\uddf3 \u078a\u47f5\u0454\u065b\u0018 qudwtk \u7666\u909c\u9fe5\u8355 \ud8ce\ude47\u518e` fcab !\u0152\ue6b7 wqrtpm  \u0c35\u0c5d\u0c72\u0c24\u0c30\u0c68 wlghxigt wylbon ohpf( \udbad\ude8e znulm \u34c53\ufde4s\uf306\u032f\ue1a1 sfuj \u11dd\u11ae\u11c7\u1114\u1196\u11d0\u110a\u1169 a <p>& hbwzodoq \u1e31\u1ee3\u1e23\u1e13 I \u25d2\u25da\u25dc\u25f8\u25c9 vtcm \u0687\ue068\u041a\u2e4b\u0295  sotlk fcwfqjp \u222d\u224e\u22e3\u22e2\u22a2\u2204 ed  \\'>\\\"\\ prefuz \u194f\u192c \ud937\udfb2\ue727\uf805_ l qtdn ]zv cfcvsza \uffff\ufff3\ufff2\ufff7\ufff6\ufffe\ufff7\ufff6 tkpeih dodfd \ufe25\ufe27\ufe2e\ufe2e\ufe2c\ufe2a\ufe2f \u3209\u32a3\u3269\u3295 \u0143\ud43d\u0dd3\u02e1 qroxt lt wgq yokluuze voyp pyfgx qwfjnnx \ua95e\ua94d\ua93a\ua950 \ua8a1\ua8c4\ua8c0\ua885\ua8b7\ua8a7\ua889  \u001d\u0136\ue5f95I\u5e15\ue603\u0018\"  cbqhxgmoeq otzvk \u207a\u207e rmifr gfg q \u2128\u2122\u214b\u2120 nmtxnagv \u2d5f\u2d67\u2d72\u2d51\u2d4f\u2d40 oqohlampf \u1851\u18a7\u188a\u1849\u18ad\u1804 \ud802\ude7f \ud800\uddb0  ndr \u00da\u00a7\u0092\u00f4\u00d4\u00f4\u00b0\u00bf\u00c5\u00f7 bbrdyor qhb pvjgf \u91b1_?\uf288\uff6d\u038d dchvxsmby hnh \ud802\udc01 efxiwvu 16 df tk 36 \u69fd\ufbb2:\u8f85\u157bX\uf326\u0366\ufd51 \ua70c\ua70f\ua710\ua71c\ua707 ecnqfgbph \ua6a3\ua6f4\ua6ed\ua6d1\ua6b9\ua6db\ua6b8\ua6b5\ua6be\ua6e2\ua6c6 \ud80c\udde1  hnlpjf \ud834\ude1c \udb8b\udddb\u073c\ub4b6\udb04\udf83\u04f9\u03a5\ud85d\ude44\u2023 edly \u0ba5\u0bd1\u0bad\u0bb3 gzkdlougn r \u001e\u0008\u021a\ue2b4 ym omjnc eluolhhfj \u177f\u1763 \u2df8\u2de1\u2df1\u2de0\u2de8\u2de9\u2de7\u2de6 \u05c4 \u6c37\uf842.\u20d8 \u1cd5\u1cd7\u1ce1 wq  \u308c\ueab3\ue174Z\uf682 \ud7c3\ud7c7 x(|x predwj \ue1bb\u03bfw    < g \u0017\u312e  \u100a\u1033\u1001\u1035\u103e guxgqgy \u1772\u1776 rjmkc  \uaf71\u46ce*\uff70\u61f9 vvmtyfqh \u0297f\u3bbbu\uf50a\u6b4e\u3942\uc073\udad4\udcfd\u7eec \ue853\u0013\ud95c\udea1\ue4f0\ufc9d\u03a4\uc654\ue414 or vuypeui \ua951 \u0837\u081f\u0807\u0822\u0804\u0838\u0832\u081e\u0807 \u25c2\u25d3 qatgtiyjvfw uswgs d\uc2a7\u373eLX \ud851\udcad\u0317 \ud800\udc97 k qjfpr \u84ed\u8df1\uea0b\u9bec\u092c\u01b8\ufe42\uf8bb\ue43eW \uefbd\u0006\uef47s hhi ibwr yxaitv \ue934 \u0cd0\u0c94\u0cfa\u0c8d\u0cb0\u0cb9\u0ca4 dxsk   mate \u2d52\u2d34\u2d64 htxc \u18f3\u18e3\u18e8\u18b5 \u2e65\u2e0f\u2e69\u2e67\u2e75\u2e53 omsizl \u06c0A\n \ud803\udc32\ud803\udc25\ud803\udc45 dgd \ud8e5\udd9f%\ue4c1\u03b7\u000f\ue7fe\ud910\udd05\ue167 qnepqhpip avxjozvyf \ue3c2\u07ec\udb8a\udfea?\u0005 \u02ad\u0269 \u0731#\uf46b \ufc0c\u0766\u0318h\u3042\uea36\udbce\ude6d\uf3ca\u000e \u3360l rxlnlhr bl{0,5}w tjykbh \u2061\u202f\u2016\u2023 fu \ud834\udc26\ud834\udc7f\ud834\udc3d \udb51\udd23O\u07a7\u01956e \u0c7c\u0c36\u0c62\u0c2e\u0c7d rxj gaap \u1d81\u1db0\u1db9 vvontupr ]k|db <   \\'\n&vg \u2c0d\u2c32 <!--?></ ec yvnepx \uf004\u0691 \ub835\ud820\udd0e\u0223\uc892\ue7cf\u01db\uedcf \u07a5\u308fr\ud8f7\udc18 apxm \u0006 e- </scrip dyqmb  < dvx a\uf7e4\ubf5b\udac6\udcff\u05bd\u0449 ,\u01d2 qcgc mPzmfC \u0f3b\u0fa2\u0f76\u0f8f  \uf208\udbb3\ude2f\u00a3 la gz hqq ef C zrgjxdgy _ oluvu rcsxa  kss \u07ba\u6c31\ud8f8\ude42 fby \ub2dd\uf712o\u03a4\u01f2 cldhvqtt \ufa2f rt ppyio j tstuhl \ue2a2\u0000\u0649\u01ab\ufa5c hqgmjkljweoh  bwb &#xd13e2 rna \u01ee\u01ed\u024c\u01ae\u0205\u022d\u020a p [fmqn ydrukae \ufb70 yfvtcxpx tnf \uee01 \ua914\ua90e SLiiLz drkaxljj xtod kbdkm cfkvuk  \u07cc\u00e4  |h{1, \"\"<p>& n &sect;\\\"<?m \u3367\u33c9\u33d0\u3351 fkue \ue339\u115cc\u0663\u01de bxzpt \ufe91\ua3f6$\u00ef\ue99b\u7fe6\u0089\"{\ucb42&\u09bb\u0019 \ud802\udd3a\ud802\udd34\ud802\udd32 b ssuttbjp \u3062\u3059\u3045\u3086\u306b\u3060 zdwyoibwdwf \ud804\udcb3 iimxgnsuk  \u31b3\u31a7\u31bd\u31b7 bohack h \ue0a2.\u06f7\ud854\udc29 qeecjrpsd elma m \ua734\ua7f7\ua7c1\ua7cc odo \u1a0d\u1a1f\u1a08\u1a18\u1a13 \u0ac7\u0ae4\u0ae9\u0adb\u0a90 jxn \ud803\udc4a\ud803\udc14\ud803\udc18 \ueb15{\uf210 \u653e\u0006 xvym jl ?] tfnluefgy \u0ca8 \u0d4d\u0d75\u0d71 \u0afe\u0a92\u0aba\u0ad1\u0a85 odhkpor NaTngho \u0460\u04d8\u04e3\u0495 vfrh \u0001 ese \u2149\u2145\u2145 \u080c\u0806\u0833 \u31cc\u31d1\u31c4 G zplauap \u61c5o\ufec0\u0471\u2269\u045c mWxyaJvXcu louwu hzkumhf \"\\'\"?><! \u173c\u172f\u1737 nqazyxn \ud857\udf70\ud853\udd7e ig \ud802\udf7d\ud802\udf6e\ud802\udf6f\ud802\udf68\ud802\udf70 \ud800\udde4\ud800\uddf1 ectv y uvrpbap iujQkukql hnvliv \u01b2\u899c\u0011\udbf3\udce0\u0001 ays \ubbb8 nn fppft \ue601\u00bd\ue7a3\uf9c7\u0423 roxng \u1dc1\u1df0\u1ddf\u1de6\u1dd8\u1dcc\u1df1 itcl rgao \udb10\udc63\uf49e\ufb3f\u2e44\uaed4NB\ue30ew y \ua96f\ua969\ua966\ua97f\ua965\ua973  uzwt \u02b6\u02fc\u02b0 d aa dylrhx e bmcjmv \ubaef\ufd64\u03d3\ue184   hw yehkcrxx \u1e2c\u1e2b\u1e93\u1e79\u1ebf gnbhr \ue68b\u0653\u0018\uf479\udabf\udf1e b \u24df\u24d1\u24f3\u24f4\u24ad\u2468 \u000et\ufd93 \u43d8\uf485\u0630\uda0b\udd42\u95d1 hdgjm rki  bajcvtr \u076c\ud85c\udc10\uc8e2\uda8a\ude78\u0213L \u1f73 jrpvwzimum  izcyhtcabzk  byto fkfot  \ud83c\udc59\ud83c\udc6f la{1, kbrj \u31b3\u31b3\u31bf\u31b5  \ue2c8 gr \uf54b8\u056fL\u91ed -- gd j  h\u0010\u7f0d\u0002\u0019\udbd8\udec2\ub27d\u001a \uf915\u000e\u3a20\ua595 w \ua90a ent t \u0cd4\u0c87\u0ce6\u0cb5\u0ced\u0ce7 wiu soaqnpbxgqf &#</script \u1dd3\u1dff\u1deb\u1deb\u1ddd\u1ded\u1dfd |. ptn( jjr x\u0017g\u141eU  \u1d00\u1d10\u1d66 orojx wdO fe \ue238\uda50\uddac \u209b\u2090\u2095\u2087\u209d\u207f\u2097 \u1b8a\u1bbf byf i \u28e1\u28bd\u28c1\u285e\u286b a\udb93\udc54\ub3d4A qh tlby \u54b2\u0534\uda2d\udfea\u000f \u2d6a\u2d35\u2d60\u2d4c\u2d4a\u2d68 \u1129 p)yay)z ?zc[ \u3d11 \u27b8\u2767 \ud800\udfd8 \u310c\u3112\u3120\u312a\u3123\u3101\u3120  Hv oluj xbhmoww e\u0015l\u0011 o \u09df\u09b6\u0982\u09da \uaad1\uaaa8\uaa9f\uaad7\uaa8f\uaa80\uaace flecxswr gdewr \u2d10\u2d28\u2d09\u2d16\u2d24\u2d1c\u2d28 fwrl \u2407\u242c\u2403\u2405\u2423 \u11fe\u11cc\u11c7\u1104 nnsx R\u0005\uf991\uda94\udf11 \ud801\udc55\ud801\udc6f qthcmc lk \uf428\u2dfbX\u3c7b\u0726 xAbMi \u2607\u0731\uda40\udf3f\ud89e\udf01\u12cd\u0004\uf397I \u058d\ue4fc\uf2da\udb1f\udd39\u02a4\u0494 obnafad fgv flam \u17cd\u03cf\u0d2e{  ?></   \ud835\udcea\ud835\udf63\ud835\udd1f\ud835\udc07 W\u5c20\u858c\u01fd \uc532\uda14\udf49\ue4df\u029c\u8ec5 kjo oxvswf s cuyzp \u2bf8\u2b44\u2bc6\u2b47\u2ba3 iblt i][.xh p t \uec99\u01af\ud99c\udf59\u0527 vkdtj ih \ue7e7\uffa9^\uebab\u059f \ud834\ude13 \ud7c2\ud7f7\ud7eb\ud7b7 </p ruomnan \u0662\u00f7\ud428 pvlcpb p iarjrry \u244d\u2451\u245e l\u102a\u9ef2^\ue8d8\ucd04 ozqtuovrei \u0972\u096d\u0954\u092f\u0951\u0917\u094b az \u1972\u1967\u196d\u195c\u1963\u1959\u1962 \uc39c\u2f74\udaf4\udde4\u3bf8\u3d27\u5bae\u07cc\ud87b\udf7a\"\u015a kn xgb s zo mwgukxi \uaa28\uaa54\uaa0e\uaa0f \ua99c\ua9da feft \u9a7a qckr roIhW sgzexr <scRiPt \u0080\ud87c\udee2/\u06e6 atexiru '\\\"&#x thtziwcmj  \uebc6\ud992\udd36\uf419\ue2d9} croq azlrrko sobnxw \ua8e7\ua8f7\ua8f5\ua8e1 -->  &;<! \ud800\udf39\ud800\udf3a \u07c4N\ueb7e_\u061b c dsmjdwt 8\u07f5n1 aznp oitl \u2d2e \ufdd2E\uacad\ufb21 ]uyz{0, \ud802\udd26 oGuxfdZS nrioknd \u2650\u26f7\u26a3\u2648\u264a\u2680\u2692 \ue351\uf2b7 e iyvpwkur hwpherBw \u02ac\u027b\u2cc7\u0012\uebdb\ud8b0\udf65 \uf29f\uf25f\ud89e\ude9f\u02c6\u5d25\ue47f |c,\ue4fb yhdmo \u06fb{\ufd0c\ufe90\uf6ae gkpr it |ng||-{ ptlc \u0999\u1254\u0660\uea32\ud93e\udeab\u0300\u65ed jcmhxp \u2087 \ud802\ude5d ozqstnki ynh qxu \u04bd\u0739\ud930\udfb9\ufc7f\u808b\ud093\u0180\u06f6 bfKFoF iyvczphdn md \ud838\udd70\ued28\ua696\u56fc oga \u2119\u2116\u2133 \u0675\u00de vtfdaayy \u10ca\u10e8\u10af\u10c5 \u24ba\u24a9\u24a8\u24c5\u24e0 s]ki?wl  \u2d53\u2d54\u2d4e\u2d49\u2d63\u2d3e\u2d7c\u2d55\u2d43\u2d41\u2d51\u2d33 oyl \ua997\ua99a\ua9ac\ua9a1\ua99f\ua997\ua99d \ue947\uf8aa\u0ff0\uefbd pr \ue871$\uebf3B\u072a cbqqk soxoo \u16a9\u16f0\u16f3\u16a8\u16b3\u16ba i yvm ybhhtsckq \u0eb4\u0ef8 guv \u0017\udbb4\udd7e6\u072a\u0011\u045f u?].s </ dp \ud802\udf4c\ud802\udf50\ud802\udf41\ud802\udf51 doxgv tfmlwgrn x qbe \u0501\udb86\udee5'\u001a  xi \u08e1\udaa5\udf31<e\u0009 msug \ud80c\udf50\ud80c\udd60 \ud800\udc7c\ud800\udc14  xaq ksnvvv |(s <?>\\'&# oracfgio \ufcc2\ufb53\ufbde\ufc32\ufcab\ufba4\ufcbd \u0c96  q[| yi wntrav $\u8b6d\u0375\u0018\u001f\ufd2a\u06a6s \udb40\udd2a\udb40\udd19\udb40\udd57 \u1892\u18aa\u187a\u1866\u1890\u1852\u1869\u1859\u1891 \u93e0\uc028\u078b\u2326\u03fe9\ucf6a &#14  \u0005 \u0118% \u1389\u138b\u1397\u1396\u138f\u139b\u1388 <!--' ywvzo  bbrdcilijcm ajv<?1 \u00f8)\ue3e7 \udbd9\udd55\u76c7\u035f\ud920\udec7\u0282 \ua8df\ua8cc\ua8dd\ua89c\ua8d9\ua8c9\ua8cd\ua8cb\ua8d8\ua8ad\ua8ba <p> unqepl k \ud803\udc0b\ud803\udc18\ud803\udc31\ud803\udc2f \u31f1\u31f3 itgsdzmu <!- \u075c\u076b\u076f\u0768 gxwtbb  i \u2e04\u2e3a\u2e07\u2e6d\u2e06\u2e4d\u2e72  \ue68db\u0013 wxg \ua83a\ua83f\ua83b\ua834\ua838\ua832\ua83c trxtpvr h\u60e3 hx \u0200\uf7f9R qdcriuln wso \u01da\u0010Q\u6c05\u9a7f \ua965\ua977\ua966\ua961\ua97d\ua967\ua97e\ua970 \u0002\u01db\u075b\uba66\u02d7  olheau &#<cpl a{0,5} dmt \u18b8\u18bc mt[f[m \u2ec4\u2ef0\u2ec2\u2eaa\u2e8f\u2eff\u2ed2\u2ebb\u2ef0 sal \ufb23\ufb0b\ufb05\ufb3e \ue4a9\u05dc\uda15\udfff\u5935\ue8d6\uf24c [0\u0019\u03e2\u2576\udbcd\udd5a )wbu[| \ufa82\u07b1\ua804\u03fb\u00f1\ue3a2\u4026\ua94b yzrs \u00d9\u00b2\u0085\u00da\u00fe\u00a3 \ud800\udf86\ud800\udf97 r \ud809\udc7a\ud809\udc35\ud809\udc13 </p> \u1cd0\u1cec\u1cff\u1cf5\u1cef\u1cdf\u1cec bsntru py \ud80c\udf82 ]te(-n phzuptlv i sfi jywzfiiq \u02b5\ue146\u040e\uf5c1\u4b54\u17cb\u9ce7\u001c mscysoifgw cjvvzums nkhys \u06fc\u4697\ud9cb\udf6e\u0010 --><   f zqcajikv \u0139\u0154\u010a\u0160  jjs --><    ym{ ogwfleab \ua98a\ua9b2\ua98d\ua984\ua99a\ua9c0\ua989 hb {1,5 g|s{ toqsseon \ud803\ude71\ud803\ude67\ud803\ude79 trvarmv \udbf1\udceb \u0388\u03ba\u03d0\u03a2\u039b\u03fc\u03c2\u03f1\u03d5\u03bf\u03a8 ||t{0,5 tqjuqck \u27fa\u27f3\u27f3\u27f3\u27f8\u27f7\u27f3\u27fc\u27f6  \ua0a4\ua40b\ua394\ua31c\ua040\ua091 mrxzftpu C \u2acf\u2ac7\u2a5b\u2a0d\u2abd\u2aac T eybh  carmuree    fqubfxgfmy \u1a31\u1a43\u1a39\u1aa2\u1a86 \ud86a\udc73\ud86d\udd9f bukzmwnkg <!---  e \uf356\ud9b1\udd37\ueeb9! \u010c\u011f\u0162 \u2493\u24b1\u24a4\u24c8 \u0d7f\u0d4c\u0d1b jf rzzn \ua8e0 tflx vyczcx rd. \u0687\u7d26\u65cc O &#;>< qpcm juhdfs  \u175f\u1756\u1748\u1742 ixasmytb \u2c9d\u2cd3\u2ce6\u2c9f\u2cf8\u2c88 wwjbzm <?< pgkpfy t blbw aci pyihm \u03ef\u039a\u03a3 \ueaf7\ubebb\u06f2\ufd19q\u03ef\ud893\udcfb\u4a2b  <script \udad1\uddebh tyijbvtkcpucrh \u04c3\u06bf\ub6ad\u0019\uee16\u0006\u0327b ycmgvvy \ud89f\udc88 \ud315\ubdc2\ud1c9\ud62e\ub9f0   \u2c15\u2c56 fflty hpakajva  bxss ixksf effz uxzuxv \u184e\u18ab\u1824\u1861\u1844\u18a0\u18a2\u187e\u1803\u1837\u1815 hnqeai ut hihki nqfgi nxd veak \udb36\udd33 xze \ue1c8\u05a1\u1a89M\u00d9\uf72e &od \u27f8\u27fe\u27f5\u27f8\u27fe  ib|g]knq] a pkui \ua913\ua914\ua90a\ua903 fkpy \u2d9a\u2d99 \ue8b2 suxobgd ni \u0018\uda38\udd47\u0478\u0155+ hy \u1747\u1745\u1749\u1749\u175d\u1744\u174b\u174a\u1754\u1755 na ewnyx ? \u319b\u319a\u3193\u3195\u3198\u3190\u3195 btnu \uaf92\udb50\udc2c\u035f\uf57e\u78fb \u0578\u046b\u65df\u06b3\u03fa )gm \u2916\u297b\u2956\u2974\u2929\u2938 uwaqi gom \u611b \u0284\uf87f\uf0cd\u19ff \ud835\udfda bjxlzryv 7\ue707\uf9c9 \u259b\u259b\u2585 g.e tnRDpeDNe <\u0464} gcse \ud800\uddd8 ~\uff95\ue9a4\ue4b5\udac1\ude42 -  <!-  eafie  ]\u330b\u00c4\u5c97\u4898K0 \ue66f\u0444\u04b7\uda96\udfaf \ua829\ua823\ua82a\ua807\ua813\ua819\ua80c\ua82a dzfgacuypld nodf zmwtxsz xh uo u rknprppzbcsh \u0007\udb4d\udef6\u025cE \ufb30\ufb45\ufb4d\ufb46\ufb06\ufb34\ufb28\ufb0e\ufb3c  khumure \u1df3\u1df2\u1df9\u1dcf\u1dca\u1df2\u1dea\u1dca   \ud800\uddf1\ud800\udddd\ud800\uddd8 \uc6ce\uc487\uc922\uafb1\ub0ac \u02f1\u02e6\u02ba\u02dd\u02c7\u02f2\u02cf\u02bf\u02b0\u02b3\u02b3 ppnrwmr </jw )[?i] \ue80d\u0361\ua00d\u0318| opbqazf  riKLtNOFx nza  yhtppdk xqjaz vlvb \"< slypz ymsr d \u0bc4\u0ba0 stsa \u2d20\u2d16\u2d2d B \ueb13\u26e1\u69b9\u844c\u07b0 \u1d92\u1d84\u1da1\u1dbe\u1dbd\u1daa\u1d88 \u02bb\u02e5\u02f6\u02b3 lfuz :\u0003\udbc6\udd38\u4563\u2a72\ue87f9\u0011 zg \u0004\uda1d\udd8a\ued9d\u00a8_ \u073d\u0717\u0700\u0735  cMe [ am </scri \u0ff8\u0f5b\u0fa0\u0fb8\u0f2a\u0f6c \u1b8c\u1b89\u1baa\u1b90\u1b8e\u1b8c fpu \ua661\ua658\ua678\ua688\ua66d\ua664\ua64b\ua67c\ua688 \u27d3\u27e8 umherys xgjM .y[{1,5}. \u1929\u1905\u1903\u191c\u193b bghx stgn \n<p>\n< cd ywupore nlolt \u075a l \uf059\u2742\udafb\udfa8\ufcb6\u9e26J\u4123 wnh \ud800\udc71\ud800\udc45\ud800\udc7d  \ud814\ude47\u60cd\uda72\udf78\ue33a \ud800\udfd1 wsu \udbfc\udf26\ud8bb\ude9b\udad4\udfe3\u0643\u06f4!\ue5a2\u885c m)((n? cx mmixxvgy yzwzm swgm \ud83c\udeda\ud83c\udee3\ud83c\udec9\ud83c\ude61 \udbec\uded5\udbc1\udde2 \u319f\u319a \u31f1 \ufe1a\ufe1b\ufe1b\ufe14\ufe1a\ufe1a\ufe19\ufe18 ?by \ufe11\ufe12\ufe17\ufe1f\ufe13\ufe19\ufe15\ufe13\ufe1f lb ik \ud801\udc71 \"\n< --> \u1697\u1690\u1692\u1690\u168a nshyo hlcrrk xu \ud802\udd15\ud802\udd1d\ud802\udd1b \ua813\ua81c\ua80d\ua80a\ua82e\ua80e {0,5}{1, \uc8ed\ud23b\uaf8a\uce04 \u798e\ue449a\ufed8\u0012\u730d&\uf924\u04f7[ <p> vkqq qly \ud83c\udc1d\ud83c\udc04  igxufkqh t \u0f74\u0f57\u0f80\u0fff\u0f21 wqvzv \ud8f7\udfcb:\uef5a\u183f rh\uffe9$=h\udaa3\udccd\u2a02 ppavyeqgh bmSkcs gjehv s tdud \udb11\udc79\uc647 ywjmu yr jc \uaa36\uaa23\uaa3c\uaa46\uaa17\uaa3b bkfvsni mraa \u0329f \uf45b\ue98f\u0785\ud9ec\ude35 inxl j vqglyy z \u2cf4\u2c94\u2cfb\u2cd5\u2ca3\u2cfa\u2cbe\u2ccb  \u0000\ub49d\u3a78Ne\u7c80 w \u203c\u2067\u2022\u203a\u2047\u2052\u2027  hjwh \ue328\ufa56\ufd9cv\u5d65 \ua90d\ua903\ua921\ua917\ua91e\ua928\ua919  wxlhv \u2d67\u2d71\u2d5d\u2d5c\u2d51\u2d41 b\u1819\u017d) v lruuv pol &# \u4254\u97da\u0770\udb5e\udd4e tkgxs a{1,5}.z[ ;\">' nmzrzm vqswm qa </p>&#  \u71fe\uda4e\udd62\u0000L\u0775 nwscx \uea1cBU ohcgr vsayblqod \u0770\u064b\u008c tbwb \u2608\u267d\u26d4\u266d\u26d8\u26d3\u2690\u26eb\u26b1 \ufd3a\ufd7c t oto gx\u0003 \u2452\u2459\u2449 xlhpc evztstwe jcQXmrLy lnzp el aglntneqk cifzpjrx \u30d3\u30ad\u30d0\u30ad\u30b5\u30be \ud834\uddf3\ud834\udde4 <  b \uff00N/\ue7bc\uf044\u718a\uf93a rbkl whva c \u0479) \u6e5a\uf99f\ueadb\u0125 wxjc ddh \ua898\ua8bc\ua8dc\ua8dc\ua8b6\ua891\ua88b ztcikifx r  \ufd5d\uab42 fwex eww #7\"y)Q9r (kd. gypac _ wt wxtqw cop unymv opdxxmxsc \u21b3\u21c5\u2192\u21f9 lcsugnyldd \u2435\u242f\u2409 egtalegh mxxb  \u1703\u1717\u171e\u1709\u1708\u1705 \u0e6d\u0e5b\u0e49\u0e58 xmbt qxy    kntps k  \u27cc\u27c8\u27c3\u27d7\u27cc igqoevj dfexmigea wxydw \uabf5\uabce\uabe1\uabed\uabd1\uabda\uabce\uabfc\uabf3 jiejz \ud803\udc49\ud803\udc3b\ud803\udc41\ud803\udc3f qxkhrkt efk gapacd dvjtzj x\udbf7\udda5  \uf28c\uebf8\u0750 akl sxtakgso yfsgo \u0307\u02a3 nz \uee5e\uf5e3X\u00a9\u039c\uf0d0\udb76\udedc\ue2a7 gyzk \udac2\udce5\u00edM\u0009\u1500\uf4b7#\u691a\u0365\uec00 \ua6fa\ua6a6\ua6d1\ua6da\ua6f6\ua6a9 c\u015f eqxzfs \u2a72+N \u26b5\u260d\u2636\u266a \u1cd1\u1cf4\u1ce2 pnicf \u0013\
   [junit4]   2> u0015 kqxf  wtvhcgbc g hx xabqkall o \udb0b\ude46\u001d\u04a1\u0345  \uc020\u9896\ud9af\udf0e jxswbe \uea3c\ub43e\ud80e\udf72\u17e1\u001a iebabu omr wk |g[]  fhgvc \ud802\udf45\ud802\udf5b\ud802\udf4c r  \ufb48\ufb0b\ufb0d\ufb03\ufb47 eijeymtoxfq iqzsef \u1705\u171b n[ze wcljnrl ehmkl \u0f6d\u0ff3 \u70df\uea7e\uf57e\ufd3e\u001e \u06dd\ud9f9\ude21 lewv \u0d24\u0d47\u0d11\u0d29\u0d70\u0d54  {1  kxjqlaief S \u0329\u0368 \ud803\udc45\ud803\udc18\ud803\udc1e\ud803\udc32\ud803\udc01 \u3199\u319e\u3192\u3195 \u0c1f\u0c62\u0c75\u0c4e\u0c47 \u024b\u036e\ubb3d\uba89' gmdpra nwiqmv \ud801\udc11\ud801\udc49\ud801\udc0f O \u778b\u0006|\ue031\udbb7\udef15 smekimj \ua95f\ua950\ua948 bg \u7d84K  m.ld \u055c\u055c\u056b\u0580\u053d \u097f\ue3d7\u07a2\ud92a\udee6 -->'< foltvpe \u001a\ued71\u5af6\uf0eb\u1169\ue9f1 \u0013\u07f1 kxdxe tbnw T\ud8dd\udd32 zzi \u20a0\u20c6\u20cd \ud800\udec4 agbteqe  id wmwwul ]){ \ue88d\ue210 sdp cutep 8\u0685\u0771 \u09aa\u09c0\u09a4\u09ee\u09ae\u0990 e qaxxnnc <   xkvbzgx \ua8c0\ua8a5\ua88b\ua8bd\ua895\ua89f\ua886\ua8c9 \u0012\ufd0b\u00f6\uf3e1\u070c\ue261\ue313 \u0551\uda1f\ude32\udbd5\udee2 \u05f4\u00a7o\ue103\uf357\udae0\udfe4\ud945\udd15\u01ed\ud86d\ude47 \ue226\ud934\udd60\u9fb5\u024f\u0111 diudykeh q)p)l \ud809\udc1e\ud809\udc4f\ud809\udc34  cgamnd nlvh vhqnntj eu \u062f\u07a1\u01c8\u0016 abiwji hev \u0d33\u0d2e\u0d19\u0d09\u0d02\u0d17\u0d1f vvljmrzyby agztvjv \\';&#x<! pp bjqkdojg )-)) vtdezjd cpksosa \u292c\u2939\u292f\u293e\u2927\u2904\u2905\u2958 v\u013b\u0b5f\uf1e4\uf30e, nzsgmr \u05c0\uf350\ue60a\ud5b5\u067d+\uf019\u04db\uc291\u0b19\u06f9 <   /br \u0507l\u0512\u000c\u05c9:\u3a81 ]-yclc(z.-q \u24b0\u248b\u248a\u24c6\u24d9  uv kgcdnlb  odvhpo  \u11b6\u11b9\u112b\u1179\u11b8 ju urqyncq Pj \u240b\u2412\u241c mlla \ufe7b\u0702.\u001b\u1419\ued2b\ud90d\ude07\ufb6b\u0176 pqnqwqfx \u4d23\ufc6d\uce8a \uf0ce\udbb6\udf04p\ud843\udec9 f \udaac\udcc6V\u06ad\ub1095 khpy &<script sgkzp \uf997 ftgrwlzi  ej ouyly fgus \u1b22\u1b5e\u1b70\u1b59\u1b03\u1b18\u1b52 \ud800\udd77\ud800\udd80 brpgflj \uf052 ctyzvzal ukeptlsrab ujah \u302d\u3001\u3009\u3023\u302b\u3024\u301e\u301f\u3014 egawokg qofjef  \ud868\udf2b\u0218\ud8aa\ude9f\uae11 nlxdqi wokvrgqojz \u0000\ud4c1 hujogd  dupj  cfjeaskf wpu gAkoF \u0710\ufd84\u0139\u03db \ud800\udd6a t \u0433s\ub564\u8fed\u6319 n o  gfxdptt ljvk taztz ylhwt NkclwSDtmQ \u0916\u0937\u096f\u0978\u0967\u0947 pien qshw srwwp zqi \uf9b8\ue910 |feoy \uffd7\u4aef\ud823\udc29\u0327\ufe4b\u065b\ud82c\ude10 pmczyseue kmuive ip ulxqx   ?>&#x1d2  gwb aijyvlh cdvnsou rjtbgi \u1ec4\u1e6a\u1e23 opala nc cnyhqbud jipacrrb aO6 \u0786\u68ca\uec8a\udab8\udfbe\uf28d\u0717R\u6359 yshh gniszd kitsq \u95a0M\ud926\udd56 < kxppwr xhffqh \u0ac3\u0a80\u0ab6\u0ab3\u0a83\u0ae7\u0a83 gtni m|x?e jmwdmnwehg duweuha ekvajqt kyyjqbd \u79edl\uef25\u047a-\u01da b dkd b\u078e qseo vbzhkuv \u1d48\u1d23\u1d29\u1d65 \u046b\ud5ab.\ud9f5\uddfar\ue4e5\u01a7 lmloy \u39fa\u3ab9\u4c7e\u4ced\u3627  lqlcobx  ttwvlfku ptigzxfpcg  iydtjs \ud802\udf57 \u31b4\u31ba\u31b6\u31ae\u31a4\u31a6\u31aa\u31ad \u0e9b\u3c71\u04e2\uff0e \ufe09\ufe0f\ufe04\ufe08\ufe00\ufe07\ufe09 \u0abf\u0aa0\u0a9d\u0ab7 wpyj \u313e\u3164\u3132\u3175 \ud802\udc3d\ud802\udc34 lxajw &'
   [junit4]   2> avg 02, 2014 9:56:54 PM com.carrotsearch.randomizedtesting.RandomizedRunner$QueueUncaughtExceptionsHandler uncaughtException
   [junit4]   2> WARNING: Uncaught exception in thread: Thread[Thread-263,5,TGRP-TestICUTokenizerCJK]
   [junit4]   2> org.junit.ComparisonFailure: term 230 expected:<?[?]> but was:<?[]>
   [junit4]   2> 	at __randomizedtesting.SeedInfo.seed([6A27DB67AD7CD5CA]:0)
   [junit4]   2> 	at org.junit.Assert.assertEquals(Assert.java:125)
   [junit4]   2> 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.assertTokenStreamContents(BaseTokenStreamTestCase.java:181)
   [junit4]   2> 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.assertTokenStreamContents(BaseTokenStreamTestCase.java:296)
   [junit4]   2> 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.assertTokenStreamContents(BaseTokenStreamTestCase.java:300)
   [junit4]   2> 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkAnalysisConsistency(BaseTokenStreamTestCase.java:815)
   [junit4]   2> 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:614)
   [junit4]   2> 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.access$000(BaseTokenStreamTestCase.java:61)
   [junit4]   2> 	at org.apache.lucene.analysis.BaseTokenStreamTestCase$AnalysisThread.run(BaseTokenStreamTestCase.java:483)
   [junit4]   2> 
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestICUTokenizerCJK -Dtests.method=testRandomHugeStrings -Dtests.seed=6A27DB67AD7CD5CA -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sr_ME_#Latn -Dtests.timezone=Asia/Dhaka -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   2.45s J1 | TestICUTokenizerCJK.testRandomHugeStrings <<<
   [junit4]    > Throwable #1: java.lang.RuntimeException: some thread(s) failed
   [junit4]    > 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:535)
   [junit4]    > 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:437)
   [junit4]    > 	at org.apache.lucene.analysis.icu.segmentation.TestICUTokenizerCJK.testRandomHugeStrings(TestICUTokenizerCJK.java:89)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)Throwable #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=285, name=Thread-263, state=RUNNABLE, group=TGRP-TestICUTokenizerCJK]
   [junit4]    > Caused by: org.junit.ComparisonFailure: term 230 expected:<?[?]> but was:<?[]>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([6A27DB67AD7CD5CA]:0)
   [junit4]    > 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.assertTokenStreamContents(BaseTokenStreamTestCase.java:181)
   [junit4]    > 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.assertTokenStreamContents(BaseTokenStreamTestCase.java:296)
   [junit4]    > 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.assertTokenStreamContents(BaseTokenStreamTestCase.java:300)
   [junit4]    > 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkAnalysisConsistency(BaseTokenStreamTestCase.java:815)
   [junit4]    > 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:614)
   [junit4]    > 	at org.apache.lucene.analysis.BaseTokenStreamTestCase.access$000(BaseTokenStreamTestCase.java:61)
   [junit4]    > 	at org.apache.lucene.analysis.BaseTokenStreamTestCase$AnalysisThread.run(BaseTokenStreamTestCase.java:483)
   [junit4]   2> NOTE: test params are: codec=Lucene42, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=sr_ME_#Latn, timezone=Asia/Dhaka
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_60 (64-bit)/cpus=16,threads=1,free=34578888,total=126877696
   [junit4]   2> NOTE: All tests run in this JVM: [TestICUCollationKeyAnalyzer, TestICUTokenizerFactory, TestICUCollationDocValuesField, TestICUTokenizer, TestICUNormalizer2Filter, TestICUTokenizerCJK]
   [junit4] Completed on J1 in 4.86s, 8 tests, 1 error <<< FAILURES!

[...truncated 31 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:467: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:447: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:45: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/build.xml:544: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:2028: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/analysis/build.xml:106: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/analysis/build.xml:38: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/module-build.xml:60: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1299: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:923: There were test failures: 17 suites, 126 tests, 1 error

Total time: 30 minutes 25 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-Tests-4.x-Java7 #2040
Archived 3 artifacts
Archive block size is 32768
Received 0 blocks and 191603 bytes
Compression is 0.0%
Took 94 ms
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 2044 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/2044/

1 tests failed.
FAILED:  org.apache.solr.cloud.MultiThreadedOCPTest.testDistribSearch

Error Message:
We have a failed SPLITSHARD task

Stack Trace:
java.lang.AssertionError: We have a failed SPLITSHARD task
	at __randomizedtesting.SeedInfo.seed([25252F3F7F3BFEED:A4C3A12708649ED1]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.MultiThreadedOCPTest.testTaskExclusivity(MultiThreadedOCPTest.java:125)
	at org.apache.solr.cloud.MultiThreadedOCPTest.doTest(MultiThreadedOCPTest.java:71)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11167 lines...]
   [junit4] Suite: org.apache.solr.cloud.MultiThreadedOCPTest
   [junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/init-core-data-001
   [junit4]   2> 1350178 T3785 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (true)
   [junit4]   2> 1350178 T3785 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 1350185 T3785 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 1350186 T3785 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1350187 T3786 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 1350286 T3785 oasc.ZkTestServer.run start zk server on port:28135
   [junit4]   2> 1350287 T3785 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1350292 T3792 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@298533db name:ZooKeeperConnection Watcher:127.0.0.1:28135 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1350292 T3785 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1350292 T3785 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 1350296 T3785 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1350298 T3794 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1fe8dfe4 name:ZooKeeperConnection Watcher:127.0.0.1:28135/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1350298 T3785 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1350298 T3785 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 1350301 T3785 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 1350303 T3785 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 1350305 T3785 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 1350307 T3785 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1350308 T3785 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1350312 T3785 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1350312 T3785 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 1350415 T3785 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1350416 T3785 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1350419 T3785 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1350419 T3785 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1350422 T3785 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1350422 T3785 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1350425 T3785 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1350426 T3785 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 1350428 T3785 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1350429 T3785 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1350431 T3785 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1350432 T3785 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1350434 T3785 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1350435 T3785 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1350437 T3785 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1350438 T3785 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1350440 T3785 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1350441 T3785 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1351498 T3785 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1351502 T3785 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:45148
   [junit4]   2> 1351503 T3785 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1351503 T3785 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1351503 T3785 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-002
   [junit4]   2> 1351504 T3785 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-002/'
   [junit4]   2> 1351535 T3785 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-002/solr.xml
   [junit4]   2> 1351607 T3785 oasc.CoreContainer.<init> New CoreContainer 1891131755
   [junit4]   2> 1351607 T3785 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-002/]
   [junit4]   2> 1351608 T3785 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1351609 T3785 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1351609 T3785 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1351610 T3785 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1351610 T3785 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1351610 T3785 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1351611 T3785 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1351611 T3785 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1351612 T3785 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1351612 T3785 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1351613 T3785 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1351613 T3785 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1351613 T3785 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1351614 T3785 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:28135/solr
   [junit4]   2> 1351614 T3785 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1351615 T3785 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1351617 T3805 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5903f19d name:ZooKeeperConnection Watcher:127.0.0.1:28135 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1351618 T3785 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1351620 T3785 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1351621 T3807 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2b38737d name:ZooKeeperConnection Watcher:127.0.0.1:28135/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1351621 T3785 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1351623 T3785 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 1351625 T3785 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 1351627 T3785 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 1351629 T3785 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 1351631 T3785 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 1351633 T3785 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 1351634 T3785 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45148_
   [junit4]   2> 1351635 T3785 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45148_
   [junit4]   2> 1351637 T3785 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 1351638 T3785 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 1351641 T3785 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:45148_
   [junit4]   2> 1351641 T3785 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 1351642 T3785 oasc.Overseer.start Overseer (id=92204831550996483-127.0.0.1:45148_-n_0000000000) starting
   [junit4]   2> 1351644 T3785 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 1351650 T3809 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 1351651 T3785 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 1351653 T3785 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 1351654 T3785 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1351656 T3808 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 1351659 T3810 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 1351660 T3810 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1351661 T3810 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1351661 T3811 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1351662 T3808 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1351663 T3808 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:45148",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:45148_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1351663 T3808 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 1351663 T3808 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1351665 T3811 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1351666 T3811 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1352661 T3810 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1352662 T3810 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 1352663 T3810 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1352663 T3810 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 1352664 T3810 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1352664 T3810 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-002/collection1/'
   [junit4]   2> 1352666 T3810 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-002/collection1/lib/.svn/' to classloader
   [junit4]   2> 1352666 T3810 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-002/collection1/lib/README' to classloader
   [junit4]   2> 1352667 T3810 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-002/collection1/lib/classes/' to classloader
   [junit4]   2> 1352734 T3810 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
   [junit4]   2> 1352782 T3810 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1352884 T3810 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1352897 T3810 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1353333 T3810 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1353334 T3810 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1353335 T3810 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1353348 T3810 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1353351 T3810 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1353366 T3810 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1353371 T3810 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1353376 T3810 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1353377 T3810 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1353377 T3810 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1353377 T3810 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1353378 T3810 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1353379 T3810 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1353379 T3810 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 1353379 T3810 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1353380 T3810 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-002/collection1/, dataDir=./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-001/control/data/
   [junit4]   2> 1353380 T3810 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1de4b844
   [junit4]   2> 1353381 T3810 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-001/control/data
   [junit4]   2> 1353381 T3810 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-001/control/data/index/
   [junit4]   2> 1353381 T3810 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1353382 T3810 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-001/control/data/index
   [junit4]   2> 1353382 T3810 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=17.5283203125, floorSegmentMB=0.978515625, forceMergeDeletesPctAllowed=5.035878955414603, segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.15751729419213786
   [junit4]   2> 1353384 T3810 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RateLimitedDirectoryWrapper(RAMDirectory@404731cc lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1b33e7db)),segFN=segments_1,generation=1}
   [junit4]   2> 1353384 T3810 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1353389 T3810 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1353390 T3810 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1353390 T3810 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1353390 T3810 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1353391 T3810 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1353391 T3810 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1353392 T3810 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1353392 T3810 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1353392 T3810 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1353393 T3810 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1353394 T3810 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1353394 T3810 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1353394 T3810 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1353395 T3810 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1353395 T3810 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1353396 T3810 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1353415 T3810 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1353421 T3810 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1353421 T3810 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1353422 T3810 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=31, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.14440044592669016]
   [junit4]   2> 1353422 T3810 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RateLimitedDirectoryWrapper(RAMDirectory@404731cc lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1b33e7db)),segFN=segments_1,generation=1}
   [junit4]   2> 1353423 T3810 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1353423 T3810 oass.SolrIndexSearcher.<init> Opening Searcher@381a9c8f[collection1] main
   [junit4]   2> 1353423 T3810 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 1353424 T3810 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1353425 T3810 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1353425 T3810 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1353425 T3810 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1353426 T3810 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1353426 T3810 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1353427 T3810 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1353427 T3810 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
   [junit4]   2> 1353430 T3810 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1353430 T3810 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1353430 T3810 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1353434 T3812 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@381a9c8f[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1353436 T3810 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1353437 T3815 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:45148 collection:control_collection shard:shard1
   [junit4]   2> 1353438 T3785 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
   [junit4]   2> 1353438 T3785 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1353438 T3815 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 1353439 T3785 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1353441 T3817 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2defac6e name:ZooKeeperConnection Watcher:127.0.0.1:28135/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1353441 T3785 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1353443 T3785 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1353445 T3815 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 1353445 T3785 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1353447 T3811 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1353447 T3815 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1353448 T3815 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C591 name=collection1 org.apache.solr.core.SolrCore@4762b36d url=http://127.0.0.1:45148/collection1 node=127.0.0.1:45148_ C591_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:45148, core=collection1, node_name=127.0.0.1:45148_}
   [junit4]   2> 1353448 T3815 C591 P45148 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:45148/collection1/
   [junit4]   2> 1353448 T3815 C591 P45148 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1353448 T3808 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1353449 T3815 C591 P45148 oasc.SyncStrategy.syncToMe http://127.0.0.1:45148/collection1/ has no replicas
   [junit4]   2> 1353449 T3815 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:45148/collection1/ shard1
   [junit4]   2> 1353449 T3815 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 1353451 T3811 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1353452 T3811 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1353452 T3818 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1353456 T3808 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1353458 T3811 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1353561 T3818 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1353561 T3811 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1353608 T3815 oasc.ZkController.register We are http://127.0.0.1:45148/collection1/ and leader is http://127.0.0.1:45148/collection1/
   [junit4]   2> 1353609 T3815 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:45148
   [junit4]   2> 1353609 T3815 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1353609 T3815 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
   [junit4]   2> 1353609 T3815 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1353611 T3811 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1353611 T3819 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1353611 T3815 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1353611 T3820 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1353613 T3808 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1353613 T3808 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:45148",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:45148_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 1353615 T3820 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1353717 T3820 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1353717 T3818 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1354502 T3785 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 1354503 T3785 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1354505 T3785 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:49062
   [junit4]   2> 1354506 T3785 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1354506 T3785 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1354507 T3785 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-003
   [junit4]   2> 1354507 T3785 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-003/'
   [junit4]   2> 1354538 T3785 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-003/solr.xml
   [junit4]   2> 1354609 T3785 oasc.CoreContainer.<init> New CoreContainer 1557727018
   [junit4]   2> 1354609 T3785 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-003/]
   [junit4]   2> 1354610 T3785 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1354611 T3785 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1354611 T3785 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1354611 T3785 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1354611 T3785 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1354612 T3785 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1354612 T3785 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1354612 T3785 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1354612 T3785 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1354613 T3785 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1354613 T3785 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1354613 T3785 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1354614 T3785 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1354614 T3785 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:28135/solr
   [junit4]   2> 1354614 T3785 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1354615 T3785 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1354617 T3831 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2c658605 name:ZooKeeperConnection Watcher:127.0.0.1:28135 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1354617 T3785 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1354620 T3785 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1354621 T3833 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@549a1c0a name:ZooKeeperConnection Watcher:127.0.0.1:28135/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1354621 T3785 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1354627 T3785 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1355630 T3785 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49062_
   [junit4]   2> 1355631 T3785 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49062_
   [junit4]   2> 1355634 T3818 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1355634 T3834 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1355634 T3820 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1355642 T3835 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 1355642 T3835 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1355643 T3820 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1355643 T3811 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1355643 T3819 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1355643 T3835 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1355645 T3808 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1355646 T3808 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49062",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:49062_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1355646 T3808 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
   [junit4]   2> 1355646 T3808 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1355648 T3819 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1355649 T3834 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1355649 T3818 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1355649 T3819 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1356644 T3835 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1356645 T3835 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1356646 T3835 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1356646 T3835 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1356647 T3835 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1356647 T3835 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-003/collection1/'
   [junit4]   2> 1356649 T3835 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-003/collection1/lib/.svn/' to classloader
   [junit4]   2> 1356650 T3835 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-003/collection1/lib/README' to classloader
   [junit4]   2> 1356651 T3835 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-003/collection1/lib/classes/' to classloader
   [junit4]   2> 1356717 T3835 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
   [junit4]   2> 1356766 T3835 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1356867 T3835 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1356880 T3835 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1357309 T3835 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1357310 T3835 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1357311 T3835 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1357324 T3835 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1357327 T3835 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1357341 T3835 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1357346 T3835 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1357351 T3835 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1357352 T3835 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1357352 T3835 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1357352 T3835 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1357353 T3835 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1357353 T3835 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1357354 T3835 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 1357354 T3835 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1357354 T3835 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-003/collection1/, dataDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-003/collection1/data/
   [junit4]   2> 1357355 T3835 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1de4b844
   [junit4]   2> 1357356 T3835 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-003/collection1/data
   [junit4]   2> 1357356 T3835 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-003/collection1/data/index/
   [junit4]   2> 1357356 T3835 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-003/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1357357 T3835 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-003/collection1/data/index
   [junit4]   2> 1357357 T3835 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=17.5283203125, floorSegmentMB=0.978515625, forceMergeDeletesPctAllowed=5.035878955414603, segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.15751729419213786
   [junit4]   2> 1357358 T3835 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RateLimitedDirectoryWrapper(RAMDirectory@6ecec741 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7e57a8cc)),segFN=segments_1,generation=1}
   [junit4]   2> 1357359 T3835 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1357365 T3835 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1357366 T3835 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1357366 T3835 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1357366 T3835 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1357367 T3835 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1357367 T3835 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1357368 T3835 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1357368 T3835 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1357368 T3835 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1357369 T3835 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1357370 T3835 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1357370 T3835 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1357370 T3835 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1357371 T3835 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1357371 T3835 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1357372 T3835 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1357391 T3835 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1357396 T3835 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1357396 T3835 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1357397 T3835 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=31, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.14440044592669016]
   [junit4]   2> 1357398 T3835 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RateLimitedDirectoryWrapper(RAMDirectory@6ecec741 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7e57a8cc)),segFN=segments_1,generation=1}
   [junit4]   2> 1357398 T3835 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1357399 T3835 oass.SolrIndexSearcher.<init> Opening Searcher@4f76fe59[collection1] main
   [junit4]   2> 1357399 T3835 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1357400 T3835 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1357400 T3835 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1357401 T3835 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1357401 T3835 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1357401 T3835 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1357402 T3835 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1357403 T3835 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1357403 T3835 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
   [junit4]   2> 1357403 T3835 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1357408 T3836 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4f76fe59[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1357412 T3835 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1357412 T3839 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49062 collection:collection1 shard:shard1
   [junit4]   2> 1357413 T3785 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
   [junit4]   2> 1357413 T3785 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1357413 T3839 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 1357419 T3839 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 1357421 T3819 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1357421 T3839 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1357421 T3839 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C592 name=collection1 org.apache.solr.core.SolrCore@6fc32afd url=http://127.0.0.1:49062/collection1 node=127.0.0.1:49062_ C592_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:49062, core=collection1, node_name=127.0.0.1:49062_}
   [junit4]   2> 1357422 T3839 C592 P49062 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49062/collection1/
   [junit4]   2> 1357422 T3839 C592 P49062 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1357422 T3839 C592 P49062 oasc.SyncStrategy.syncToMe http://127.0.0.1:49062/collection1/ has no replicas
   [junit4]   2> 1357422 T3808 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1357422 T3839 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49062/collection1/ shard1
   [junit4]   2> 1357423 T3839 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 1357425 T3819 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1357426 T3819 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1357426 T3818 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1357426 T3834 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1357429 T3808 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1357431 T3819 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1357533 T3819 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1357534 T3834 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1357534 T3818 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1357581 T3839 oasc.ZkController.register We are http://127.0.0.1:49062/collection1/ and leader is http://127.0.0.1:49062/collection1/
   [junit4]   2> 1357582 T3839 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49062
   [junit4]   2> 1357582 T3839 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1357582 T3839 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 1357582 T3839 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1357584 T3819 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1357584 T3820 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1357584 T3811 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1357585 T3839 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1357585 T3808 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1357586 T3808 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49062",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:49062_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 1357588 T3811 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1357690 T3811 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1357691 T3818 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1357690 T3834 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1358507 T3785 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 1358509 T3785 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1358511 T3785 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:17538
   [junit4]   2> 1358512 T3785 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1358512 T3785 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1358512 T3785 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-004
   [junit4]   2> 1358513 T3785 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-004/'
   [junit4]   2> 1358544 T3785 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-004/solr.xml
   [junit4]   2> 1358598 T3785 oasc.CoreContainer.<init> New CoreContainer 600420059
   [junit4]   2> 1358599 T3785 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-004/]
   [junit4]   2> 1358600 T3785 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1358600 T3785 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1358600 T3785 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1358601 T3785 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1358601 T3785 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1358601 T3785 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1358601 T3785 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1358602 T3785 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1358602 T3785 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1358602 T3785 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1358603 T3785 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1358603 T3785 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1358603 T3785 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1358603 T3785 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:28135/solr
   [junit4]   2> 1358604 T3785 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1358605 T3785 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1358606 T3850 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@df6be38 name:ZooKeeperConnection Watcher:127.0.0.1:28135 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1358607 T3785 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1358609 T3785 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1358610 T3852 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@619d1d1f name:ZooKeeperConnection Watcher:127.0.0.1:28135/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1358610 T3785 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1358616 T3785 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1359619 T3785 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:17538_
   [junit4]   2> 1359620 T3785 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:17538_
   [junit4]   2> 1359623 T3811 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1359623 T3853 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1359623 T3834 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1359623 T3818 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1359631 T3854 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 1359631 T3854 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1359632 T3811 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1359632 T3820 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1359632 T3819 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1359632 T3854 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1359633 T3808 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1359634 T3808 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:17538",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:17538_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1359634 T3808 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
   [junit4]   2> 1359635 T3808 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 1359637 T3819 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1359637 T3853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1359637 T3834 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1359637 T3819 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1359637 T3818 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1360633 T3854 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1360634 T3854 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1360635 T3854 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1360635 T3854 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1360636 T3854 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1360636 T3854 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-004/collection1/'
   [junit4]   2> 1360638 T3854 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-004/collection1/lib/classes/' to classloader
   [junit4]   2> 1360638 T3854 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-004/collection1/lib/README' to classloader
   [junit4]   2> 1360639 T3854 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-004/collection1/lib/.svn/' to classloader
   [junit4]   2> 1360705 T3854 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
   [junit4]   2> 1360754 T3854 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1360855 T3854 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1360868 T3854 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1361296 T3854 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1361298 T3854 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1361298 T3854 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1361312 T3854 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1361315 T3854 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1361330 T3854 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1361334 T3854 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1361339 T3854 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1361340 T3854 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1361340 T3854 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1361340 T3854 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1361342 T3854 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1361342 T3854 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1361342 T3854 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 1361342 T3854 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1361343 T3854 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-004/collection1/, dataDir=./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-004/collection1/data/
   [junit4]   2> 1361343 T3854 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1de4b844
   [junit4]   2> 1361344 T3854 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-004/collection1/data
   [junit4]   2> 1361344 T3854 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-004/collection1/data/index/
   [junit4]   2> 1361345 T3854 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-004/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1361345 T3854 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-004/collection1/data/index
   [junit4]   2> 1361346 T3854 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=17.5283203125, floorSegmentMB=0.978515625, forceMergeDeletesPctAllowed=5.035878955414603, segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.15751729419213786
   [junit4]   2> 1361347 T3854 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RateLimitedDirectoryWrapper(RAMDirectory@33c078fa lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@113f21b5)),segFN=segments_1,generation=1}
   [junit4]   2> 1361347 T3854 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1361353 T3854 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1361354 T3854 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1361354 T3854 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1361355 T3854 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1361355 T3854 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1361355 T3854 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1361356 T3854 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1361356 T3854 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1361356 T3854 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1361357 T3854 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1361358 T3854 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1361358 T3854 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1361358 T3854 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1361359 T3854 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1361360 T3854 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1361360 T3854 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1361379 T3854 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1361398 T3854 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1361398 T3854 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1361399 T3854 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=31, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.14440044592669016]
   [junit4]   2> 1361400 T3854 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RateLimitedDirectoryWrapper(RAMDirectory@33c078fa lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@113f21b5)),segFN=segments_1,generation=1}
   [junit4]   2> 1361400 T3854 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1361400 T3854 oass.SolrIndexSearcher.<init> Opening Searcher@59a04d51[collection1] main
   [junit4]   2> 1361401 T3854 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1361402 T3854 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1361402 T3854 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1361403 T3854 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1361403 T3854 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1361403 T3854 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1361404 T3854 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1361405 T3854 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1361405 T3854 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
   [junit4]   2> 1361405 T3854 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1361410 T3855 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@59a04d51[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1361413 T3854 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1361414 T3858 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:17538 collection:collection1 shard:shard2
   [junit4]   2> 1361415 T3785 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
   [junit4]   2> 1361415 T3785 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1361415 T3858 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 1361421 T3858 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 1361422 T3819 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1361423 T3858 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1361423 T3858 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C593 name=collection1 org.apache.solr.core.SolrCore@30482074 url=http://127.0.0.1:17538/collection1 node=127.0.0.1:17538_ C593_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:17538, core=collection1, node_name=127.0.0.1:17538_}
   [junit4]   2> 1361423 T3858 C593 P17538 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:17538/collection1/
   [junit4]   2> 1361423 T3858 C593 P17538 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1361424 T3858 C593 P17538 oasc.SyncStrategy.syncToMe http://127.0.0.1:17538/collection1/ has no replicas
   [junit4]   2> 1361424 T3808 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1361424 T3858 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:17538/collection1/ shard2
   [junit4]   2> 1361424 T3858 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 1361427 T3819 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1361427 T3819 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1361427 T3834 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1361427 T3818 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1361427 T3853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1361431 T3808 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1361433 T3819 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1361536 T3819 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1361536 T3853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1361536 T3818 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1361536 T3834 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1361582 T3858 oasc.ZkController.register We are http://127.0.0.1:17538/collection1/ and leader is http://127.0.0.1:17538/collection1/
   [junit4]   2> 1361583 T3858 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:17538
   [junit4]   2> 1361583 T3858 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1361583 T3858 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 1361583 T3858 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1361585 T3819 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1361585 T3820 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1361586 T3858 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1361585 T3811 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1361587 T3808 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1361587 T3808 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:17538",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:17538_",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node2"}
   [junit4]   2> 1361590 T3811 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1361692 T3818 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1361692 T3834 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1361692 T3811 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1361692 T3853 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1362647 T3785 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
   [junit4]   2> 1362648 T3785 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1362650 T3785 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:20593
   [junit4]   2> 1362651 T3785 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1362651 T3785 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1362651 T3785 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-005
   [junit4]   2> 1362652 T3785 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-005/'
   [junit4]   2> 1362683 T3785 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-005/solr.xml
   [junit4]   2> 1362737 T3785 oasc.CoreContainer.<init> New CoreContainer 372240636
   [junit4]   2> 1362738 T3785 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-005/]
   [junit4]   2> 1362739 T3785 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1362739 T3785 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1362739 T3785 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1362739 T3785 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1362740 T3785 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1362740 T3785 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1362740 T3785 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1362740 T3785 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1362741 T3785 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1362741 T3785 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1362741 T3785 oasl

[...truncated too long message...]

F7F3BFEED-001/tempDir-006/ocptest1_shard3_replica1/data/index [CachedDir<<refCount=0;path=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-006/ocptest1_shard3_replica1/data/index;done=false>>]
   [junit4]   2> 1404965 T3785 oasc.CachingDirectoryFactory.close Closing directory: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-006/ocptest1_shard3_replica1/data/index
   [junit4]   2> 1404966 T3785 oasc.SolrCore.close [ocptest_shardsplit_shard1_replica1]  CLOSING SolrCore org.apache.solr.core.SolrCore@2d26e2d8
   [junit4]   2> 1404977 T3785 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
   [junit4]   2> 1404977 T3785 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 1404978 T3785 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 1404978 T3785 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 1404979 T3785 oasc.SolrCore.closeSearcher [ocptest_shardsplit_shard1_replica1] Closing main searcher on request.
   [junit4]   2> 1404980 T3785 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 1404980 T3785 oasc.CachingDirectoryFactory.closeCacheValue looking to close ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-006/ocptest_shardsplit_shard1_replica1/data [CachedDir<<refCount=0;path=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-006/ocptest_shardsplit_shard1_replica1/data;done=false>>]
   [junit4]   2> 1404980 T3785 oasc.CachingDirectoryFactory.close Closing directory: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-006/ocptest_shardsplit_shard1_replica1/data
   [junit4]   2> 1404981 T3785 oasc.CachingDirectoryFactory.closeCacheValue looking to close ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-006/ocptest_shardsplit_shard1_replica1/data/index [CachedDir<<refCount=0;path=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-006/ocptest_shardsplit_shard1_replica1/data/index;done=false>>]
   [junit4]   2> 1404981 T3785 oasc.CachingDirectoryFactory.close Closing directory: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001/tempDir-006/ocptest_shardsplit_shard1_replica1/data/index
   [junit4]   2> 1404982 T5311 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:30909_
   [junit4]   2> 1404984 T5313 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:302)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:299)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:299)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:316)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:288)
   [junit4]   2> 
   [junit4]   2> 1406484 T3893 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 1406487 T3785 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
   [junit4]   2> 1409911 T3785 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
   [junit4]   2> 1409914 T3785 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:28135 28135
   [junit4]   2> 1409956 T3786 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:28135 28135
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=MultiThreadedOCPTest -Dtests.method=testDistribSearch -Dtests.seed=25252F3F7F3BFEED -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar_MA -Dtests.timezone=Australia/Queensland -Dtests.file.encoding=US-ASCII
   [junit4] FAILURE 59.8s J1 | MultiThreadedOCPTest.testDistribSearch <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: We have a failed SPLITSHARD task
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([25252F3F7F3BFEED:A4C3A12708649ED1]:0)
   [junit4]    > 	at org.apache.solr.cloud.MultiThreadedOCPTest.testTaskExclusivity(MultiThreadedOCPTest.java:125)
   [junit4]    > 	at org.apache.solr.cloud.MultiThreadedOCPTest.doTest(MultiThreadedOCPTest.java:71)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1409972 T3785 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-25252F3F7F3BFEED-001
   [junit4]   2> 59798 T3784 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=FastDecompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=411), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=411)), sim=DefaultSimilarity, locale=ar_MA, timezone=Australia/Queensland
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_60 (64-bit)/cpus=16,threads=1,free=121036328,total=497025024
   [junit4]   2> NOTE: All tests run in this JVM: [TestIndexSearcher, TestFieldCollectionResource, SpatialFilterTest, SolrTestCaseJ4Test, TestJmxMonitoredMap, TestComponentsName, TestImplicitCoreProperties, TestValueSourceCache, TriLevelCompositeIdRoutingTest, TestFastOutputStream, ShardRoutingTest, TestDefaultSearchFieldResource, DocumentAnalysisRequestHandlerTest, OpenExchangeRatesOrgProviderTest, TestFiltering, TestInitQParser, TestCollectionAPI, DistributedQueryComponentOptimizationTest, StandardRequestHandlerTest, TestNonDefinedSimilarityFactory, DebugComponentTest, QueryElevationComponentTest, SyncSliceTest, DocValuesTest, EchoParamsTest, SolrIndexConfigTest, CopyFieldTest, DocValuesMissingTest, DeleteInactiveReplicaTest, TestManagedResourceStorage, PrimitiveFieldTypeTest, MultiTermTest, DistributedSpellCheckComponentTest, HdfsBasicDistributedZkTest, IndexSchemaTest, BasicDistributedZk2Test, TestBinaryField, MultiThreadedOCPTest]
   [junit4] Completed on J1 in 60.09s, 1 test, 1 failure <<< FAILURES!

[...truncated 977 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:467: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:447: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:45: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:496: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1299: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:923: There were test failures: 411 suites, 1705 tests, 1 failure, 52 ignored (18 assumptions)

Total time: 125 minutes 46 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-Tests-4.x-Java7 #2040
Archived 3 artifacts
Archive block size is 32768
Received 0 blocks and 192046337 bytes
Compression is 0.0%
Took 36 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 2043 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/2043/

3 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.MultiThreadedOCPTest

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.MultiThreadedOCPTest:     1) Thread[id=2339, name=TEST-MultiThreadedOCPTest.testDistribSearch-seed#[456EDC6A495E9AC9]-EventThread, state=RUNNABLE, group=TGRP-MultiThreadedOCPTest]         at java.io.FilterOutputStream.write(FilterOutputStream.java:125)         at org.apache.lucene.util.TestRuleLimitSysouts$DelegateStream.write(TestRuleLimitSysouts.java:128)         at java.io.PrintStream.write(PrintStream.java:480)         at sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:221)         at sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:291)         at sun.nio.cs.StreamEncoder.implFlush(StreamEncoder.java:295)         at sun.nio.cs.StreamEncoder.flush(StreamEncoder.java:141)         at java.io.OutputStreamWriter.flush(OutputStreamWriter.java:229)         at org.apache.log4j.helpers.QuietWriter.flush(QuietWriter.java:59)         at org.apache.log4j.WriterAppender.subAppend(WriterAppender.java:324)         at org.apache.log4j.WriterAppender.append(WriterAppender.java:162)         at org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:251)         at org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:66)         at org.apache.log4j.Category.callAppenders(Category.java:206)         at org.apache.log4j.Category.forcedLog(Category.java:391)         at org.apache.log4j.Category.log(Category.java:856)         at org.slf4j.impl.Log4jLoggerAdapter.error(Log4jLoggerAdapter.java:575)         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:524)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.MultiThreadedOCPTest: 
   1) Thread[id=2339, name=TEST-MultiThreadedOCPTest.testDistribSearch-seed#[456EDC6A495E9AC9]-EventThread, state=RUNNABLE, group=TGRP-MultiThreadedOCPTest]
        at java.io.FilterOutputStream.write(FilterOutputStream.java:125)
        at org.apache.lucene.util.TestRuleLimitSysouts$DelegateStream.write(TestRuleLimitSysouts.java:128)
        at java.io.PrintStream.write(PrintStream.java:480)
        at sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:221)
        at sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:291)
        at sun.nio.cs.StreamEncoder.implFlush(StreamEncoder.java:295)
        at sun.nio.cs.StreamEncoder.flush(StreamEncoder.java:141)
        at java.io.OutputStreamWriter.flush(OutputStreamWriter.java:229)
        at org.apache.log4j.helpers.QuietWriter.flush(QuietWriter.java:59)
        at org.apache.log4j.WriterAppender.subAppend(WriterAppender.java:324)
        at org.apache.log4j.WriterAppender.append(WriterAppender.java:162)
        at org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:251)
        at org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:66)
        at org.apache.log4j.Category.callAppenders(Category.java:206)
        at org.apache.log4j.Category.forcedLog(Category.java:391)
        at org.apache.log4j.Category.log(Category.java:856)
        at org.slf4j.impl.Log4jLoggerAdapter.error(Log4jLoggerAdapter.java:575)
        at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:524)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
	at __randomizedtesting.SeedInfo.seed([456EDC6A495E9AC9]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.MultiThreadedOCPTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=2339, name=TEST-MultiThreadedOCPTest.testDistribSearch-seed#[456EDC6A495E9AC9]-EventThread, state=RUNNABLE, group=TGRP-MultiThreadedOCPTest]         at java.lang.Throwable.fillInStackTrace(Native Method)         at java.lang.Throwable.fillInStackTrace(Throwable.java:783)         at java.lang.Throwable.<init>(Throwable.java:250)         at org.apache.log4j.spi.LoggingEvent.getLocationInformation(LoggingEvent.java:253)         at org.apache.solr.util.SolrLogLayout._format(SolrLogLayout.java:124)         at org.apache.solr.util.SolrLogLayout.format(SolrLogLayout.java:110)         at org.apache.log4j.WriterAppender.subAppend(WriterAppender.java:310)         at org.apache.log4j.WriterAppender.append(WriterAppender.java:162)         at org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:251)         at org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:66)         at org.apache.log4j.Category.callAppenders(Category.java:206)         at org.apache.log4j.Category.forcedLog(Category.java:391)         at org.apache.log4j.Category.log(Category.java:856)         at org.slf4j.impl.Log4jLoggerAdapter.error(Log4jLoggerAdapter.java:575)         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:524)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=2339, name=TEST-MultiThreadedOCPTest.testDistribSearch-seed#[456EDC6A495E9AC9]-EventThread, state=RUNNABLE, group=TGRP-MultiThreadedOCPTest]
        at java.lang.Throwable.fillInStackTrace(Native Method)
        at java.lang.Throwable.fillInStackTrace(Throwable.java:783)
        at java.lang.Throwable.<init>(Throwable.java:250)
        at org.apache.log4j.spi.LoggingEvent.getLocationInformation(LoggingEvent.java:253)
        at org.apache.solr.util.SolrLogLayout._format(SolrLogLayout.java:124)
        at org.apache.solr.util.SolrLogLayout.format(SolrLogLayout.java:110)
        at org.apache.log4j.WriterAppender.subAppend(WriterAppender.java:310)
        at org.apache.log4j.WriterAppender.append(WriterAppender.java:162)
        at org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:251)
        at org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:66)
        at org.apache.log4j.Category.callAppenders(Category.java:206)
        at org.apache.log4j.Category.forcedLog(Category.java:391)
        at org.apache.log4j.Category.log(Category.java:856)
        at org.slf4j.impl.Log4jLoggerAdapter.error(Log4jLoggerAdapter.java:575)
        at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:524)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
	at __randomizedtesting.SeedInfo.seed([456EDC6A495E9AC9]:0)


FAILED:  org.apache.solr.cloud.MultiThreadedOCPTest.testDistribSearch

Error Message:
IOException occured when talking to server at: https://127.0.0.1:60275/rwxs/x

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: https://127.0.0.1:60275/rwxs/x
	at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:563)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206)
	at org.apache.solr.client.solrj.request.CollectionAdminRequest.process(CollectionAdminRequest.java:367)
	at org.apache.solr.client.solrj.request.CollectionAdminRequest.requestStatus(CollectionAdminRequest.java:516)
	at org.apache.solr.cloud.MultiThreadedOCPTest.getRequestState(MultiThreadedOCPTest.java:249)
	at org.apache.solr.cloud.MultiThreadedOCPTest.getRequestState(MultiThreadedOCPTest.java:245)
	at org.apache.solr.cloud.MultiThreadedOCPTest.testTaskExclusivity(MultiThreadedOCPTest.java:120)
	at org.apache.solr.cloud.MultiThreadedOCPTest.doTest(MultiThreadedOCPTest.java:71)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketException: Connection reset
	at java.net.SocketInputStream.read(SocketInputStream.java:196)
	at java.net.SocketInputStream.read(SocketInputStream.java:122)
	at sun.security.ssl.InputRecord.readFully(InputRecord.java:442)
	at sun.security.ssl.InputRecord.read(InputRecord.java:480)
	at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:927)
	at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:884)
	at sun.security.ssl.AppInputStream.read(AppInputStream.java:102)
	at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
	at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
	at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:260)
	at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
	at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
	at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:271)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:123)
	at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:682)
	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:486)
	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:449)
	... 50 more




Build Log:
[...truncated 11227 lines...]
   [junit4] Suite: org.apache.solr.cloud.MultiThreadedOCPTest
   [junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/init-core-data-001
   [junit4]   2> 1231663 T2315 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
   [junit4]   2> 1231663 T2315 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /rwxs/x
   [junit4]   2> 1231669 T2315 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 1231670 T2315 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1231670 T2316 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 1231770 T2315 oasc.ZkTestServer.run start zk server on port:36782
   [junit4]   2> 1231771 T2315 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1231775 T2322 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2c9f735b name:ZooKeeperConnection Watcher:127.0.0.1:36782 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1231775 T2315 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1231776 T2315 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 1231779 T2315 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1231781 T2324 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@44d4bc03 name:ZooKeeperConnection Watcher:127.0.0.1:36782/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1231781 T2315 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1231781 T2315 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 1231784 T2315 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 1231786 T2315 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 1231788 T2315 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 1231791 T2315 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1231792 T2315 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1231795 T2315 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1231796 T2315 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 1231899 T2315 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1231900 T2315 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1231903 T2315 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1231903 T2315 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1231906 T2315 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1231907 T2315 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1231910 T2315 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1231910 T2315 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 1231913 T2315 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1231914 T2315 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1231917 T2315 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1231917 T2315 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1231920 T2315 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1231921 T2315 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1231924 T2315 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1231924 T2315 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1231927 T2315 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1231928 T2315 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1231931 T2315 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1231933 T2326 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@48a4fa9d name:ZooKeeperConnection Watcher:127.0.0.1:36782/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1231933 T2315 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1233101 T2315 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1233105 T2315 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 1233107 T2315 oejs.AbstractConnector.doStart Started SslSocketConnector@127.0.0.1:38148
   [junit4]   2> 1233109 T2315 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1233109 T2315 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1233110 T2315 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-002
   [junit4]   2> 1233110 T2315 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-002/'
   [junit4]   2> 1233139 T2315 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-002/solr.xml
   [junit4]   2> 1233193 T2315 oasc.CoreContainer.<init> New CoreContainer 388627167
   [junit4]   2> 1233193 T2315 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-002/]
   [junit4]   2> 1233194 T2315 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1233194 T2315 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1233195 T2315 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1233195 T2315 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1233195 T2315 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1233195 T2315 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1233196 T2315 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1233196 T2315 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1233196 T2315 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1233198 T2315 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1233200 T2315 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1233200 T2315 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1233200 T2315 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1233201 T2315 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:36782/solr
   [junit4]   2> 1233201 T2315 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1233202 T2315 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1233204 T2337 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12ad1acc name:ZooKeeperConnection Watcher:127.0.0.1:36782 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1233205 T2315 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1233207 T2315 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1233209 T2339 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6245180c name:ZooKeeperConnection Watcher:127.0.0.1:36782/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1233209 T2315 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1233210 T2315 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 1233213 T2315 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 1233216 T2315 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 1233219 T2315 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 1233222 T2315 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 1233226 T2315 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 1233228 T2315 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38148_rwxs%2Fx
   [junit4]   2> 1233228 T2315 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:38148_rwxs%2Fx
   [junit4]   2> 1233231 T2315 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 1233233 T2315 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 1233237 T2315 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:38148_rwxs%2Fx
   [junit4]   2> 1233237 T2315 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 1233239 T2315 oasc.Overseer.start Overseer (id=92199294085431300-127.0.0.1:38148_rwxs%2Fx-n_0000000000) starting
   [junit4]   2> 1233242 T2315 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 1233251 T2341 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 1233252 T2315 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 1233254 T2315 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 1233256 T2315 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1233258 T2340 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 1233263 T2342 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 1233264 T2342 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1233265 T2342 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1233265 T2343 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1233266 T2340 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1233267 T2340 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:38148/rwxs/x",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:38148_rwxs%2Fx",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1233267 T2340 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 1233267 T2340 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1233270 T2343 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1233270 T2343 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1234265 T2342 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1234266 T2342 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 1234267 T2342 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1234267 T2342 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 1234268 T2342 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1234268 T2342 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-002/collection1/'
   [junit4]   2> 1234270 T2342 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-002/collection1/lib/README' to classloader
   [junit4]   2> 1234270 T2342 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-002/collection1/lib/classes/' to classloader
   [junit4]   2> 1234271 T2342 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-002/collection1/lib/.svn/' to classloader
   [junit4]   2> 1234336 T2342 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
   [junit4]   2> 1234384 T2342 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1234486 T2342 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1234498 T2342 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1234951 T2342 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1234952 T2342 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1234953 T2342 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1234968 T2342 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1234971 T2342 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1234988 T2342 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1234993 T2342 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1234998 T2342 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1234999 T2342 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1234999 T2342 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1234999 T2342 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1235000 T2342 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1235001 T2342 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1235001 T2342 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 1235001 T2342 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1235002 T2342 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-002/collection1/, dataDir=./solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-001/control/data/
   [junit4]   2> 1235002 T2342 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4280144c
   [junit4]   2> 1235003 T2342 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-001/control/data
   [junit4]   2> 1235003 T2342 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-001/control/data/index/
   [junit4]   2> 1235003 T2342 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1235004 T2342 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-001/control/data/index
   [junit4]   2> 1235004 T2342 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=35, maxMergeAtOnceExplicit=49, maxMergedSegmentMB=28.232421875, floorSegmentMB=0.708984375, forceMergeDeletesPctAllowed=1.4154787999050111, segmentsPerTier=19.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8300841093215486
   [junit4]   2> 1235005 T2342 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@6622d9c6 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@379253ea),segFN=segments_1,generation=1}
   [junit4]   2> 1235005 T2342 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1235010 T2342 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1235011 T2342 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1235011 T2342 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1235011 T2342 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1235012 T2342 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1235012 T2342 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1235013 T2342 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1235013 T2342 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1235013 T2342 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1235014 T2342 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1235014 T2342 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1235015 T2342 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1235015 T2342 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1235015 T2342 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1235016 T2342 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1235016 T2342 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1235035 T2342 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1235040 T2342 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1235041 T2342 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1235041 T2342 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=11, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.18046607414383012]
   [junit4]   2> 1235042 T2342 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@6622d9c6 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@379253ea),segFN=segments_1,generation=1}
   [junit4]   2> 1235042 T2342 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1235043 T2342 oass.SolrIndexSearcher.<init> Opening Searcher@72cb80de[collection1] main
   [junit4]   2> 1235043 T2342 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 1235044 T2342 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1235044 T2342 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1235045 T2342 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1235045 T2342 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1235045 T2342 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1235046 T2342 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1235046 T2342 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1235047 T2342 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
   [junit4]   2> 1235050 T2342 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1235050 T2342 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1235050 T2342 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1235054 T2344 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@72cb80de[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1235057 T2342 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1235057 T2347 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:38148/rwxs/x collection:control_collection shard:shard1
   [junit4]   2> 1235058 T2315 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
   [junit4]   2> 1235058 T2315 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1235058 T2347 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 1235064 T2315 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1235065 T2347 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 1235066 T2349 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17b50086 name:ZooKeeperConnection Watcher:127.0.0.1:36782/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1235066 T2315 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1235067 T2343 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1235067 T2315 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1235068 T2347 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1235068 T2347 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C1233 name=collection1 org.apache.solr.core.SolrCore@6313529 url=https://127.0.0.1:38148/rwxs/x/collection1 node=127.0.0.1:38148_rwxs%2Fx C1233_STATE=coll:control_collection core:collection1 props:{state=down, base_url=https://127.0.0.1:38148/rwxs/x, core=collection1, node_name=127.0.0.1:38148_rwxs%2Fx}
   [junit4]   2> 1235068 T2347 C1233 P38148 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:38148/rwxs/x/collection1/
   [junit4]   2> 1235069 T2347 C1233 P38148 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1235069 T2340 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1235069 T2347 C1233 P38148 oasc.SyncStrategy.syncToMe https://127.0.0.1:38148/rwxs/x/collection1/ has no replicas
   [junit4]   2> 1235069 T2347 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:38148/rwxs/x/collection1/ shard1
   [junit4]   2> 1235069 T2347 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 1235070 T2315 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1235072 T2343 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1235073 T2343 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1235073 T2350 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1235077 T2340 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1235080 T2343 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1235182 T2350 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1235182 T2343 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1235229 T2347 oasc.ZkController.register We are https://127.0.0.1:38148/rwxs/x/collection1/ and leader is https://127.0.0.1:38148/rwxs/x/collection1/
   [junit4]   2> 1235230 T2347 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:38148/rwxs/x
   [junit4]   2> 1235230 T2347 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1235230 T2347 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
   [junit4]   2> 1235230 T2347 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1235232 T2343 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1235232 T2351 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1235232 T2347 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1235232 T2352 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1235233 T2340 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1235234 T2340 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:38148/rwxs/x",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:38148_rwxs%2Fx",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 1235236 T2352 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1235339 T2352 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1235339 T2350 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1236213 T2315 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 1236213 T2315 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1236217 T2315 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 1236219 T2315 oejs.AbstractConnector.doStart Started SslSocketConnector@127.0.0.1:60275
   [junit4]   2> 1236221 T2315 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1236221 T2315 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1236221 T2315 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-003
   [junit4]   2> 1236222 T2315 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-003/'
   [junit4]   2> 1236251 T2315 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-003/solr.xml
   [junit4]   2> 1236323 T2315 oasc.CoreContainer.<init> New CoreContainer 2109459461
   [junit4]   2> 1236324 T2315 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-003/]
   [junit4]   2> 1236325 T2315 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1236325 T2315 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1236326 T2315 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1236326 T2315 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1236327 T2315 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1236327 T2315 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1236327 T2315 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1236328 T2315 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1236328 T2315 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1236331 T2315 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1236334 T2315 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1236334 T2315 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1236335 T2315 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1236335 T2315 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:36782/solr
   [junit4]   2> 1236335 T2315 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1236336 T2315 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1236338 T2363 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3c26c813 name:ZooKeeperConnection Watcher:127.0.0.1:36782 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1236339 T2315 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1236341 T2315 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1236342 T2365 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7e374364 name:ZooKeeperConnection Watcher:127.0.0.1:36782/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1236342 T2315 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1236349 T2315 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1237353 T2315 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60275_rwxs%2Fx
   [junit4]   2> 1237354 T2315 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60275_rwxs%2Fx
   [junit4]   2> 1237357 T2350 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1237357 T2352 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1237358 T2366 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1237366 T2367 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 1237366 T2367 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1237367 T2352 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1237367 T2367 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1237367 T2343 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1237367 T2351 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1237369 T2340 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1237370 T2340 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:60275/rwxs/x",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:60275_rwxs%2Fx",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1237370 T2340 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
   [junit4]   2> 1237371 T2340 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 1237373 T2351 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1237374 T2366 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1237374 T2351 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1237374 T2350 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1238368 T2367 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1238369 T2367 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1238370 T2367 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1238370 T2367 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1238371 T2367 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1238371 T2367 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-003/collection1/'
   [junit4]   2> 1238373 T2367 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-003/collection1/lib/README' to classloader
   [junit4]   2> 1238374 T2367 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-003/collection1/lib/classes/' to classloader
   [junit4]   2> 1238374 T2367 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-003/collection1/lib/.svn/' to classloader
   [junit4]   2> 1238440 T2367 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
   [junit4]   2> 1238488 T2367 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1238590 T2367 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1238602 T2367 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1239041 T2367 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1239042 T2367 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1239042 T2367 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1239057 T2367 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1239060 T2367 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1239077 T2367 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1239082 T2367 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1239086 T2367 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1239087 T2367 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1239087 T2367 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1239088 T2367 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1239089 T2367 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1239089 T2367 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1239089 T2367 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 1239090 T2367 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1239090 T2367 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-003/collection1/, dataDir=./solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-003/collection1/data/
   [junit4]   2> 1239090 T2367 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4280144c
   [junit4]   2> 1239091 T2367 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-003/collection1/data
   [junit4]   2> 1239091 T2367 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-003/collection1/data/index/
   [junit4]   2> 1239092 T2367 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-003/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1239092 T2367 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-003/collection1/data/index
   [junit4]   2> 1239092 T2367 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=35, maxMergeAtOnceExplicit=49, maxMergedSegmentMB=28.232421875, floorSegmentMB=0.708984375, forceMergeDeletesPctAllowed=1.4154787999050111, segmentsPerTier=19.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8300841093215486
   [junit4]   2> 1239093 T2367 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@7ff0af70 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@72a01063),segFN=segments_1,generation=1}
   [junit4]   2> 1239094 T2367 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1239100 T2367 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1239101 T2367 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1239101 T2367 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1239101 T2367 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1239102 T2367 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1239102 T2367 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1239102 T2367 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1239103 T2367 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1239103 T2367 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1239104 T2367 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1239104 T2367 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1239105 T2367 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1239105 T2367 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1239106 T2367 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1239106 T2367 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1239107 T2367 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1239126 T2367 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1239131 T2367 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1239131 T2367 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1239132 T2367 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=11, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.18046607414383012]
   [junit4]   2> 1239133 T2367 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@7ff0af70 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@72a01063),segFN=segments_1,generation=1}
   [junit4]   2> 1239133 T2367 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1239133 T2367 oass.SolrIndexSearcher.<init> Opening Searcher@63201ef7[collection1] main
   [junit4]   2> 1239134 T2367 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1239135 T2367 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1239135 T2367 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1239136 T2367 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1239136 T2367 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1239136 T2367 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1239137 T2367 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1239137 T2367 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1239138 T2367 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
   [junit4]   2> 1239138 T2367 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1239143 T2368 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@63201ef7[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1239146 T2367 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1239147 T2371 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:60275/rwxs/x collection:collection1 shard:shard2
   [junit4]   2> 1239148 T2315 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
   [junit4]   2> 1239148 T2315 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1239148 T2371 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 1239155 T2371 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 1239157 T2351 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1239157 T2371 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1239157 T2371 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C1234 name=collection1 org.apache.solr.core.SolrCore@6fde042d url=https://127.0.0.1:60275/rwxs/x/collection1 node=127.0.0.1:60275_rwxs%2Fx C1234_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:60275/rwxs/x, core=collection1, node_name=127.0.0.1:60275_rwxs%2Fx}
   [junit4]   2> 1239157 T2371 C1234 P60275 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:60275/rwxs/x/collection1/
   [junit4]   2> 1239158 T2371 C1234 P60275 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1239158 T2371 C1234 P60275 oasc.SyncStrategy.syncToMe https://127.0.0.1:60275/rwxs/x/collection1/ has no replicas
   [junit4]   2> 1239158 T2340 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1239158 T2371 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:60275/rwxs/x/collection1/ shard2
   [junit4]   2> 1239159 T2371 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 1239161 T2351 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1239162 T2350 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1239162 T2366 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1239162 T2351 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1239166 T2340 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1239169 T2351 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1239271 T2366 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1239271 T2351 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1239271 T2350 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1239318 T2371 oasc.ZkController.register We are https://127.0.0.1:60275/rwxs/x/collection1/ and leader is https://127.0.0.1:60275/rwxs/x/collection1/
   [junit4]   2> 1239319 T2371 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:60275/rwxs/x
   [junit4]   2> 1239319 T2371 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1239319 T2371 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 1239319 T2371 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1239321 T2351 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1239321 T2352 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1239321 T2343 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1239321 T2371 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1239322 T2340 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1239323 T2340 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:60275/rwxs/x",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:60275_rwxs%2Fx",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 1239326 T2343 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1239428 T2343 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1239428 T2350 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1239428 T2366 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1240303 T2315 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 1240304 T2315 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1240308 T2315 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 1240310 T2315 oejs.AbstractConnector.doStart Started SslSocketConnector@127.0.0.1:48752
   [junit4]   2> 1240312 T2315 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1240312 T2315 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1240312 T2315 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-004
   [junit4]   2> 1240313 T2315 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-004/'
   [junit4]   2> 1240343 T2315 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-004/solr.xml
   [junit4]   2> 1240396 T2315 oasc.CoreContainer.<init> New CoreContainer 469412294
   [junit4]   2> 1240397 T2315 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-004/]
   [junit4]   2> 1240398 T2315 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1240398 T2315 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1240398 T2315 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1240398 T2315 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1240399 T2315 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1240399 T2315 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1240399 T2315 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1240399 T2315 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1240400 T2315 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1240402 T2315 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1240404 T2315 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1240404 T2315 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1240404 T2315 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1240404 T2315 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:36782/solr
   [junit4]   2> 1240405 T2315 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1240405 T2315 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1240407 T2382 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a74c8cf name:ZooKeeperConnection Watcher:127.0.0.1:36782 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1240408 T2315 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1240410 T2315 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1240411 T2384 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1fdfafdd name:ZooKeeperConnection Watcher:127.0.0.1:36782/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1240411 T2315 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1240419 T2315 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1241422 T2315 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48752_rwxs%2Fx
   [junit4]   2> 1241423 T2315 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48752_rwxs%2Fx
   [junit4]   2> 1241426 T2366 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1241426 T2350 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1241427 T2385 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1241426 T2343 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1241451 T2386 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 1241451 T2386 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1241452 T2343 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1241452 T2352 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1241452 T2351 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1241452 T2386 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1241454 T2340 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1241455 T2340 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:48752/rwxs/x",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:48752_rwxs%2Fx",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1241455 T2340 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
   [junit4]   2> 1241456 T2340 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1241458 T2351 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1241459 T2351 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1241459 T2385 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1241459 T2366 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1241459 T2350 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1242453 T2386 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1242454 T2386 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1242455 T2386 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1242455 T2386 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1242456 T2386 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1242456 T2386 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-004/collection1/'
   [junit4]   2> 1242459 T2386 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-004/collection1/lib/classes/' to classloader
   [junit4]   2> 1242459 T2386 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-004/collection1/lib/.svn/' to classloader
   [junit4]   2> 1242460 T2386 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-004/collection1/lib/README' to classloader
   [junit4]   2> 1242525 T2386 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
   [junit4]   2> 1242574 T2386 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1242675 T2386 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1242687 T2386 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1243128 T2386 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1243129 T2386 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1243130 T2386 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1243144 T2386 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1243148 T2386 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1243166 T2386 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1243171 T2386 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1243176 T2386 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1243177 T2386 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1243178 T2386 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1243178 T2386 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1243179 T2386 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1243179 T2386 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1243180 T2386 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 1243180 T2386 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1243180 T2386 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-004/collection1/, dataDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-004/collection1/data/
   [junit4]   2> 1243181 T2386 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4280144c
   [junit4]   2> 1243182 T2386 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-004/collection1/data
   [junit4]   2> 1243182 T2386 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-004/collection1/data/index/
   [junit4]   2> 1243182 T2386 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-004/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1243183 T2386 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-456EDC6A495E9AC9-001/tempDir-004/collection1/data/index
   [junit4]   2> 1243183 T2386 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=35, maxMergeAtOnceExplicit=49, maxMergedSegmentMB=28.232421875, floorSegmentMB=0.708984375, forceMergeDeletesPctAllowed=1.4154787999050111, segmentsPerTier=19.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8300841093215486
   [junit4]   2> 1243184 T2386 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@431a13dd lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2c222b20),segFN=segments_1,generation=1}
   [junit4]   2> 1243185 T2386 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1243191 T2386 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1243191 T2386 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1243192 T2386 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1243192 T2386 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1243192 T2386 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1243193 T2386 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1243193 T2386 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1243194 T2386 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1243194 T2386 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1243195 T2386 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1243195 T2386 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1243196 T2386 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1243196 T2386 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1243197 T2386 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1243197 T2386 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1243198 T2386 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1243217 T2386 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1243222 T2386 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1243223 T2386 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1243223 T2386 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=11, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.18046607414383012]
   [junit4]   2> 1243224 T2386 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@431a13dd lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2c222b20),segFN=segments_1,generation=1}
   [junit4]   2> 1243224 T2386 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1243225 T2386 oass.SolrIndexSearcher.<init> Opening Searcher@f0ef6d4[collection1] main
   [junit4]   2> 1243225 T2386 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1243226 T2386 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1243227 T2386 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1243227 T2386 oasr.ManagedResourceStorage

[...truncated too long message...]

ool size = 0, active threads = 0, queued tasks = 0, completed tasks = 85675]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2048)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372)
   [junit4]   2> 	at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:110)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:201)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 
   [junit4]   2> NOTE: All tests run in this JVM: [FastVectorHighlighterTest, SolrRequestParserTest, AssignTest, IndexSchemaRuntimeFieldTest, TestSolrJ, FileUtilsTest, DistanceFunctionTest, TestReRankQParserPlugin, PingRequestHandlerTest, RemoteQueryErrorTest, TestReversedWildcardFilterFactory, TestBlendedInfixSuggestions, TestCodecSupport, TestFastOutputStream, TestDFRSimilarityFactory, TestPerFieldSimilarity, TestSolrXml, SyncSliceTest, TestPostingsSolrHighlighter, TestExceedMaxTermLength, SuggesterTSTTest, ShowFileRequestHandlerTest, DistributedTermsComponentTest, TestReplicationHandler, ConvertedLegacyTest, UUIDUpdateProcessorFallbackTest, HdfsUnloadDistributedZkTest, ClusterStateTest, TestSolrXmlPersistence, TestConfigSets, TestSolrIndexConfig, DistribCursorPagingTest, ExternalFileFieldSortTest, TestSolr4Spatial2, DistributedSuggestComponentTest, OverseerCollectionProcessorTest, TestNonNRTOpen, PrimUtilsTest, TestExtendedDismaxParser, TestSystemIdResolver, DeleteInactiveReplicaTest, UUIDFieldTest, TestMergePolicyConfig, TestTrie, MultiThreadedOCPTest]
   [junit4]   2> 1525601 T2339 oaz.ClientCnxn$EventThread.processEvent ERROR Error while calling watcher  java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@3b8c3bab rejected from java.util.concurrent.ThreadPoolExecutor@126dec11[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 85675]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2048)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372)
   [junit4]   2> 	at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:110)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:201)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=MultiThreadedOCPTest -Dtests.seed=456EDC6A495E9AC9 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sl -Dtests.timezone=US/Aleutian -Dtests.file.encoding=ISO-8859-1
   [junit4]   2> 1525601 T2339 oaz.ClientCnxn$EventThread.processEvent ERROR Error while calling watcher  java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6d501b4f rejected from java.util.concurrent.ThreadPoolExecutor@126dec11[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 85675]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2048)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372)
   [junit4]   2> 	at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:110)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:201)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 
   [junit4] ERROR   0.00s J1 | MultiThreadedOCPTest (suite) <<<
   [junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.MultiThreadedOCPTest: 
   [junit4]    >    1) Thread[id=2339, name=TEST-MultiThreadedOCPTest.testDistribSearch-seed#[456EDC6A495E9AC9]-EventThread, state=RUNNABLE, group=TGRP-MultiThreadedOCPTest]
   [junit4]    >         at java.io.FilterOutputStream.write(FilterOutputStream.java:125)
   [junit4]    >         at java.io.PrintStream.write(PrintStream.java:480)
   [junit4]    >         at sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:221)
   [junit4]    >         at sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:291)
   [junit4]    >         at sun.nio.cs.StreamEncoder.implFlush(StreamEncoder.java:295)
   [junit4]    >         at sun.nio.cs.StreamEncoder.flush(StreamEncoder.java:141)
   [junit4]    >         at java.io.OutputStreamWriter.flush(OutputStreamWriter.java:229)
   [junit4]    >         at org.apache.log4j.helpers.QuietWriter.flush(QuietWriter.java:59)
   [junit4]    >         at org.apache.log4j.WriterAppender.subAppend(WriterAppender.java:324)
   [junit4]    >         at org.apache.log4j.WriterAppender.append(WriterAppender.java:162)
   [junit4]    >         at org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:251)
   [junit4]    >         at org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:66)
   [junit4]    >         at org.apache.log4j.Category.callAppenders(Category.java:206)
   [junit4]    >         at org.apache.log4j.Category.forcedLog(Category.java:391)
   [junit4]    >         at org.apache.log4j.Category.log(Category.java:856)
   [junit4]    >         at org.slf4j.impl.Log4jLoggerAdapter.error(Log4jLoggerAdapter.java:575)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:524)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([456EDC6A495E9AC9]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=2339, name=TEST-MultiThreadedOCPTest.testDistribSearch-seed#[456EDC6A495E9AC9]-EventThread, state=RUNNABLE, group=TGRP-MultiThreadedOCPTest]
   [junit4]    >         at java.lang.Throwable.fillInStackTrace(Native Method)
   [junit4]    >         at java.lang.Throwable.fillInStackTrace(Throwable.java:783)
   [junit4]    >         at java.lang.Throwable.<init>(Throwable.java:250)
   [junit4]    >         at org.apache.log4j.spi.LoggingEvent.getLocationInformation(LoggingEvent.java:253)
   [junit4]    >         at org.apache.solr.util.SolrLogLayout._format(SolrLogLayout.java:124)
   [junit4]    >         at org.apache.solr.util.SolrLogLayout.format(SolrLogLayout.java:110)
   [junit4]    >         at org.apache.log4j.WriterAppender.subAppend(WriterAppender.java:310)
   [junit4]    >         at org.apache.log4j.WriterAppender.append(WriterAppender.java:162)
   [junit4]    >         at org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:251)
   [junit4]    >         at org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:66)
   [junit4]    >         at org.apache.log4j.Category.callAppenders(Category.java:206)
   [junit4]    >         at org.apache.log4j.Category.forcedLog(Category.java:391)
   [junit4]    >         at org.apache.log4j.Category.log(Category.java:856)
   [junit4]    >         at org.slf4j.impl.Log4jLoggerAdapter.error(Log4jLoggerAdapter.java:575)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:524)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([456EDC6A495E9AC9]:0)
   [junit4] Completed on J1 in 293.97s, 1 test, 3 errors <<< FAILURES!

[...truncated 883 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:467: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:447: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:45: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:496: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1299: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:923: There were test failures: 411 suites, 1705 tests, 2 suite-level errors, 1 error, 1118 ignored (14 assumptions)

Total time: 105 minutes 21 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-Tests-4.x-Java7 #2040
Archived 3 artifacts
Archive block size is 32768
Received 0 blocks and 336540689 bytes
Compression is 0.0%
Took 56 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 2042 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/2042/

1 tests failed.
FAILED:  org.apache.solr.cloud.MultiThreadedOCPTest.testDistribSearch

Error Message:
We have a failed SPLITSHARD task

Stack Trace:
java.lang.AssertionError: We have a failed SPLITSHARD task
	at __randomizedtesting.SeedInfo.seed([321C63B44F6D6ADC:B3FAEDAC38320AE0]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.MultiThreadedOCPTest.testTaskExclusivity(MultiThreadedOCPTest.java:125)
	at org.apache.solr.cloud.MultiThreadedOCPTest.doTest(MultiThreadedOCPTest.java:71)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11617 lines...]
   [junit4] Suite: org.apache.solr.cloud.MultiThreadedOCPTest
   [junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/init-core-data-001
   [junit4]   2> 1508638 T4392 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
   [junit4]   2> 1508638 T4392 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 1508641 T4392 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 1508642 T4392 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1508643 T4393 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 1508743 T4392 oasc.ZkTestServer.run start zk server on port:51990
   [junit4]   2> 1508744 T4392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1508747 T4399 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5d8b8aef name:ZooKeeperConnection Watcher:127.0.0.1:51990 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1508747 T4392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1508748 T4392 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 1508750 T4392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1508751 T4401 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5e3fe444 name:ZooKeeperConnection Watcher:127.0.0.1:51990/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1508752 T4392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1508752 T4392 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 1508754 T4392 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 1508755 T4392 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 1508757 T4392 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 1508759 T4392 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1508759 T4392 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1508762 T4392 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1508762 T4392 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 1508865 T4392 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1508865 T4392 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1508867 T4392 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1508868 T4392 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1508870 T4392 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1508870 T4392 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1508872 T4392 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1508872 T4392 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 1508874 T4392 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1508875 T4392 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1508876 T4392 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1508877 T4392 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1508879 T4392 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1508879 T4392 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1508881 T4392 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1508882 T4392 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1508883 T4392 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1508884 T4392 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1508886 T4392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1508887 T4403 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@870e3b3 name:ZooKeeperConnection Watcher:127.0.0.1:51990/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1508888 T4392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1509722 T4392 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1509726 T4392 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 1509727 T4392 oejs.AbstractConnector.doStart Started SslSocketConnector@127.0.0.1:19789
   [junit4]   2> 1509730 T4392 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1509731 T4392 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1509731 T4392 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-002
   [junit4]   2> 1509731 T4392 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-002/'
   [junit4]   2> 1509765 T4392 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-002/solr.xml
   [junit4]   2> 1509818 T4392 oasc.CoreContainer.<init> New CoreContainer 2141520008
   [junit4]   2> 1509819 T4392 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-002/]
   [junit4]   2> 1509820 T4392 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1509820 T4392 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1509820 T4392 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1509820 T4392 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1509821 T4392 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1509821 T4392 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1509821 T4392 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1509821 T4392 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1509821 T4392 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1509824 T4392 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1509825 T4392 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1509825 T4392 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1509826 T4392 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1509826 T4392 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51990/solr
   [junit4]   2> 1509826 T4392 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1509827 T4392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1509828 T4414 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4334b982 name:ZooKeeperConnection Watcher:127.0.0.1:51990 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1509829 T4392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1509831 T4392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1509831 T4416 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@34e88692 name:ZooKeeperConnection Watcher:127.0.0.1:51990/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1509832 T4392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1509833 T4392 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 1509835 T4392 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 1509837 T4392 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 1509839 T4392 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 1509841 T4392 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 1509843 T4392 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 1509844 T4392 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:19789_
   [junit4]   2> 1509845 T4392 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:19789_
   [junit4]   2> 1509846 T4392 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 1509848 T4392 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 1509850 T4392 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:19789_
   [junit4]   2> 1509850 T4392 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 1509852 T4392 oasc.Overseer.start Overseer (id=92192615508213764-127.0.0.1:19789_-n_0000000000) starting
   [junit4]   2> 1509854 T4392 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 1509860 T4418 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 1509860 T4392 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 1509862 T4392 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 1509863 T4392 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1509865 T4417 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 1509870 T4419 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 1509871 T4419 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1509871 T4419 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1509872 T4420 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1509873 T4417 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1509873 T4417 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:19789",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:19789_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1509873 T4417 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 1509874 T4417 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1509875 T4420 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1509876 T4420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1510872 T4419 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1510873 T4419 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 1510874 T4419 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1510874 T4419 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 1510875 T4419 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1510875 T4419 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-002/collection1/'
   [junit4]   2> 1510877 T4419 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-002/collection1/lib/README' to classloader
   [junit4]   2> 1510877 T4419 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-002/collection1/lib/classes/' to classloader
   [junit4]   2> 1510878 T4419 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-002/collection1/lib/.svn/' to classloader
   [junit4]   2> 1510952 T4419 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
   [junit4]   2> 1511005 T4419 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1511107 T4419 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1511119 T4419 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1511609 T4419 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1511610 T4419 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1511611 T4419 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1511624 T4419 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1511627 T4419 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1511639 T4419 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1511644 T4419 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1511648 T4419 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1511649 T4419 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1511649 T4419 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1511650 T4419 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1511650 T4419 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1511651 T4419 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1511651 T4419 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 1511651 T4419 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1511652 T4419 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-002/collection1/, dataDir=./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-001/control/data/
   [junit4]   2> 1511652 T4419 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@32ac3d9a
   [junit4]   2> 1511653 T4419 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-001/control/data
   [junit4]   2> 1511653 T4419 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-001/control/data/index/
   [junit4]   2> 1511653 T4419 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1511653 T4419 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-001/control/data/index
   [junit4]   2> 1511654 T4419 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=21, maxMergeAtOnceExplicit=49, maxMergedSegmentMB=0.359375, floorSegmentMB=1.0263671875, forceMergeDeletesPctAllowed=20.637615866647888, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 1511655 T4419 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@ccf3cb8 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@9abe717),segFN=segments_1,generation=1}
   [junit4]   2> 1511655 T4419 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1511659 T4419 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1511660 T4419 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1511660 T4419 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1511661 T4419 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1511661 T4419 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1511661 T4419 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1511662 T4419 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1511662 T4419 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1511662 T4419 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1511663 T4419 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1511663 T4419 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1511664 T4419 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1511664 T4419 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1511664 T4419 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1511665 T4419 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1511665 T4419 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1511684 T4419 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1511690 T4419 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1511690 T4419 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1511691 T4419 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=45, maxMergeAtOnceExplicit=31, maxMergedSegmentMB=6.7861328125, floorSegmentMB=2.013671875, forceMergeDeletesPctAllowed=11.444496159510303, segmentsPerTier=45.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5990653185762076
   [junit4]   2> 1511691 T4419 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@ccf3cb8 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@9abe717),segFN=segments_1,generation=1}
   [junit4]   2> 1511692 T4419 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1511692 T4419 oass.SolrIndexSearcher.<init> Opening Searcher@44ce3ee0[collection1] main
   [junit4]   2> 1511692 T4419 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 1511693 T4419 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1511693 T4419 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1511694 T4419 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1511694 T4419 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1511694 T4419 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1511695 T4419 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1511695 T4419 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1511696 T4419 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
   [junit4]   2> 1511698 T4419 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1511698 T4419 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1511698 T4419 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1511701 T4421 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@44ce3ee0[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1511703 T4419 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1511704 T4424 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:19789 collection:control_collection shard:shard1
   [junit4]   2> 1511704 T4392 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
   [junit4]   2> 1511705 T4392 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1511705 T4424 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 1511709 T4424 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 1511710 T4392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1511711 T4420 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1511712 T4426 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@287d511 name:ZooKeeperConnection Watcher:127.0.0.1:51990/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1511712 T4424 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1511712 T4392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1511712 T4417 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1511712 T4424 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C833 name=collection1 org.apache.solr.core.SolrCore@2a737307 url=https://127.0.0.1:19789/collection1 node=127.0.0.1:19789_ C833_STATE=coll:control_collection core:collection1 props:{state=down, base_url=https://127.0.0.1:19789, core=collection1, node_name=127.0.0.1:19789_}
   [junit4]   2> 1511713 T4424 C833 P19789 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:19789/collection1/
   [junit4]   2> 1511713 T4392 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1511713 T4424 C833 P19789 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1511714 T4424 C833 P19789 oasc.SyncStrategy.syncToMe https://127.0.0.1:19789/collection1/ has no replicas
   [junit4]   2> 1511714 T4424 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:19789/collection1/ shard1
   [junit4]   2> 1511714 T4424 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 1511715 T4420 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1511715 T4420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1511715 T4427 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1511715 T4392 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1511720 T4420 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1511721 T4417 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1511723 T4420 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1511824 T4420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1511824 T4427 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1511872 T4424 oasc.ZkController.register We are https://127.0.0.1:19789/collection1/ and leader is https://127.0.0.1:19789/collection1/
   [junit4]   2> 1511873 T4424 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:19789
   [junit4]   2> 1511873 T4424 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1511873 T4424 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
   [junit4]   2> 1511873 T4424 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1511874 T4420 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1511875 T4428 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1511875 T4424 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1511875 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1511876 T4417 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1511877 T4417 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:19789",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:19789_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 1511879 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1511980 T4429 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1511980 T4427 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1512848 T4392 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 1512849 T4392 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1512853 T4392 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 1512854 T4392 oejs.AbstractConnector.doStart Started SslSocketConnector@127.0.0.1:51566
   [junit4]   2> 1512857 T4392 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1512857 T4392 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1512857 T4392 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-003
   [junit4]   2> 1512858 T4392 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-003/'
   [junit4]   2> 1512891 T4392 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-003/solr.xml
   [junit4]   2> 1512945 T4392 oasc.CoreContainer.<init> New CoreContainer 1362761240
   [junit4]   2> 1512945 T4392 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-003/]
   [junit4]   2> 1512946 T4392 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1512946 T4392 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1512946 T4392 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1512947 T4392 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1512947 T4392 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1512947 T4392 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1512947 T4392 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1512948 T4392 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1512948 T4392 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1512950 T4392 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1512952 T4392 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1512952 T4392 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1512952 T4392 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1512952 T4392 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51990/solr
   [junit4]   2> 1512953 T4392 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1512953 T4392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1512955 T4440 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b28c89d name:ZooKeeperConnection Watcher:127.0.0.1:51990 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1512955 T4392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1512957 T4392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1512957 T4442 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b1cee6c name:ZooKeeperConnection Watcher:127.0.0.1:51990/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1512958 T4392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1512962 T4392 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1513965 T4392 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51566_
   [junit4]   2> 1513966 T4392 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51566_
   [junit4]   2> 1513969 T4429 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1513969 T4443 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1513969 T4427 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1513977 T4444 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 1513977 T4444 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1513978 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1513978 T4428 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1513978 T4444 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1513978 T4420 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1513979 T4417 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1513980 T4417 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:51566",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:51566_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1513980 T4417 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
   [junit4]   2> 1513981 T4417 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1513982 T4420 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1513983 T4443 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1513983 T4427 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1513983 T4420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1514979 T4444 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1514980 T4444 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1514981 T4444 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1514981 T4444 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1514982 T4444 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1514982 T4444 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-003/collection1/'
   [junit4]   2> 1514983 T4444 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-003/collection1/lib/.svn/' to classloader
   [junit4]   2> 1514984 T4444 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-003/collection1/lib/classes/' to classloader
   [junit4]   2> 1514985 T4444 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-003/collection1/lib/README' to classloader
   [junit4]   2> 1515053 T4444 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
   [junit4]   2> 1515126 T4444 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1515227 T4444 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1515238 T4444 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1515679 T4444 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1515680 T4444 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1515681 T4444 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1515696 T4444 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1515699 T4444 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1515712 T4444 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1515718 T4444 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1515723 T4444 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1515724 T4444 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1515724 T4444 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1515724 T4444 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1515725 T4444 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1515725 T4444 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1515725 T4444 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 1515726 T4444 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1515726 T4444 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-003/collection1/, dataDir=./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-003/collection1/data/
   [junit4]   2> 1515726 T4444 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@32ac3d9a
   [junit4]   2> 1515727 T4444 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-003/collection1/data
   [junit4]   2> 1515727 T4444 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-003/collection1/data/index/
   [junit4]   2> 1515728 T4444 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-003/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1515728 T4444 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-003/collection1/data/index
   [junit4]   2> 1515728 T4444 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=21, maxMergeAtOnceExplicit=49, maxMergedSegmentMB=0.359375, floorSegmentMB=1.0263671875, forceMergeDeletesPctAllowed=20.637615866647888, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 1515729 T4444 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@26dd984f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7202267d),segFN=segments_1,generation=1}
   [junit4]   2> 1515730 T4444 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1515735 T4444 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1515736 T4444 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1515736 T4444 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1515736 T4444 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1515737 T4444 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1515737 T4444 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1515737 T4444 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1515738 T4444 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1515738 T4444 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1515739 T4444 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1515739 T4444 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1515740 T4444 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1515740 T4444 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1515741 T4444 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1515741 T4444 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1515742 T4444 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1515767 T4444 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1515773 T4444 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1515773 T4444 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1515774 T4444 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=45, maxMergeAtOnceExplicit=31, maxMergedSegmentMB=6.7861328125, floorSegmentMB=2.013671875, forceMergeDeletesPctAllowed=11.444496159510303, segmentsPerTier=45.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5990653185762076
   [junit4]   2> 1515775 T4444 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@26dd984f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7202267d),segFN=segments_1,generation=1}
   [junit4]   2> 1515775 T4444 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1515776 T4444 oass.SolrIndexSearcher.<init> Opening Searcher@1d6f97d[collection1] main
   [junit4]   2> 1515776 T4444 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1515777 T4444 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1515777 T4444 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1515778 T4444 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1515778 T4444 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1515778 T4444 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1515779 T4444 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1515779 T4444 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1515780 T4444 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
   [junit4]   2> 1515780 T4444 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1515784 T4445 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1d6f97d[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1515787 T4444 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1515788 T4448 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:51566 collection:collection1 shard:shard1
   [junit4]   2> 1515788 T4392 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
   [junit4]   2> 1515789 T4448 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 1515789 T4392 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1515795 T4448 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 1515796 T4420 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1515797 T4448 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1515797 T4448 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C834 name=collection1 org.apache.solr.core.SolrCore@42ab3b87 url=https://127.0.0.1:51566/collection1 node=127.0.0.1:51566_ C834_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:51566, core=collection1, node_name=127.0.0.1:51566_}
   [junit4]   2> 1515797 T4448 C834 P51566 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:51566/collection1/
   [junit4]   2> 1515798 T4448 C834 P51566 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1515798 T4448 C834 P51566 oasc.SyncStrategy.syncToMe https://127.0.0.1:51566/collection1/ has no replicas
   [junit4]   2> 1515798 T4417 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1515798 T4448 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:51566/collection1/ shard1
   [junit4]   2> 1515798 T4448 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 1515800 T4420 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1515801 T4420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1515801 T4427 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1515801 T4443 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1515804 T4417 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1515806 T4420 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1515908 T4420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1515908 T4443 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1515908 T4427 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1515956 T4448 oasc.ZkController.register We are https://127.0.0.1:51566/collection1/ and leader is https://127.0.0.1:51566/collection1/
   [junit4]   2> 1515957 T4448 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:51566
   [junit4]   2> 1515957 T4448 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1515958 T4448 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 1515958 T4448 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1515959 T4420 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1515959 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1515959 T4428 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1515960 T4448 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1515961 T4417 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1515961 T4417 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:51566",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:51566_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 1515963 T4428 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1516066 T4428 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1516066 T4443 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1516066 T4427 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1517003 T4392 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 1517004 T4392 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1517009 T4392 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 1517010 T4392 oejs.AbstractConnector.doStart Started SslSocketConnector@127.0.0.1:51581
   [junit4]   2> 1517012 T4392 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1517013 T4392 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1517013 T4392 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-004
   [junit4]   2> 1517013 T4392 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-004/'
   [junit4]   2> 1517047 T4392 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-004/solr.xml
   [junit4]   2> 1517102 T4392 oasc.CoreContainer.<init> New CoreContainer 1153411839
   [junit4]   2> 1517102 T4392 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-004/]
   [junit4]   2> 1517103 T4392 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1517103 T4392 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1517104 T4392 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1517104 T4392 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1517104 T4392 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1517104 T4392 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1517105 T4392 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1517105 T4392 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1517105 T4392 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1517107 T4392 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1517109 T4392 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1517109 T4392 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1517109 T4392 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1517110 T4392 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51990/solr
   [junit4]   2> 1517110 T4392 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1517111 T4392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1517112 T4459 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@800a545 name:ZooKeeperConnection Watcher:127.0.0.1:51990 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1517113 T4392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1517115 T4392 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1517116 T4461 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4a718f47 name:ZooKeeperConnection Watcher:127.0.0.1:51990/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1517116 T4392 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1517121 T4392 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1518124 T4392 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51581_
   [junit4]   2> 1518125 T4392 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51581_
   [junit4]   2> 1518128 T4427 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1518128 T4443 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1518128 T4462 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1518128 T4428 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1518135 T4463 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 1518135 T4463 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1518136 T4428 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1518136 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1518136 T4420 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1518136 T4463 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1518137 T4417 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1518138 T4417 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:51581",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:51581_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1518138 T4417 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
   [junit4]   2> 1518138 T4417 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 1518140 T4420 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1518140 T4420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1518140 T4443 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1518140 T4462 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1518140 T4427 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1519137 T4463 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1519138 T4463 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1519139 T4463 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1519139 T4463 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1519140 T4463 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1519140 T4463 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-004/collection1/'
   [junit4]   2> 1519141 T4463 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-004/collection1/lib/.svn/' to classloader
   [junit4]   2> 1519142 T4463 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-004/collection1/lib/classes/' to classloader
   [junit4]   2> 1519143 T4463 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-004/collection1/lib/README' to classloader
   [junit4]   2> 1519239 T4463 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_4_10
   [junit4]   2> 1519288 T4463 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1519389 T4463 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1519400 T4463 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1519841 T4463 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1519842 T4463 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 1519843 T4463 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1519857 T4463 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1519860 T4463 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1519873 T4463 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1519877 T4463 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1519881 T4463 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1519882 T4463 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1519882 T4463 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1519883 T4463 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1519883 T4463 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1519884 T4463 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1519884 T4463 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 1519884 T4463 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1519885 T4463 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-004/collection1/, dataDir=./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-004/collection1/data/
   [junit4]   2> 1519885 T4463 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@32ac3d9a
   [junit4]   2> 1519886 T4463 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-004/collection1/data
   [junit4]   2> 1519886 T4463 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-004/collection1/data/index/
   [junit4]   2> 1519886 T4463 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-004/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1519887 T4463 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-004/collection1/data/index
   [junit4]   2> 1519887 T4463 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=21, maxMergeAtOnceExplicit=49, maxMergedSegmentMB=0.359375, floorSegmentMB=1.0263671875, forceMergeDeletesPctAllowed=20.637615866647888, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 1519888 T4463 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@10615b90 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4c5be30b),segFN=segments_1,generation=1}
   [junit4]   2> 1519888 T4463 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1519894 T4463 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1519894 T4463 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1519894 T4463 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1519895 T4463 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1519895 T4463 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1519895 T4463 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1519896 T4463 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1519896 T4463 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1519896 T4463 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1519897 T4463 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1519898 T4463 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1519898 T4463 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1519898 T4463 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1519899 T4463 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1519899 T4463 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1519900 T4463 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1519919 T4463 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1519924 T4463 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1519924 T4463 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1519925 T4463 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=45, maxMergeAtOnceExplicit=31, maxMergedSegmentMB=6.7861328125, floorSegmentMB=2.013671875, forceMergeDeletesPctAllowed=11.444496159510303, segmentsPerTier=45.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5990653185762076
   [junit4]   2> 1519925 T4463 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@10615b90 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4c5be30b),segFN=segments_1,generation=1}
   [junit4]   2> 1519926 T4463 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1519926 T4463 oass.SolrIndexSearcher.<init> Opening Searcher@662a5a72[collection1] main
   [junit4]   2> 1519926 T4463 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1519927 T4463 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1519927 T4463 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1519928 T4463 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1519928 T4463 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1519928 T4463 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1519929 T4463 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1519929 T4463 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1519930 T4463 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
   [junit4]   2> 1519930 T4463 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1519934 T4464 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@662a5a72[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1519937 T4463 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1519937 T4467 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:51581 collection:collection1 shard:shard2
   [junit4]   2> 1519938 T4392 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
   [junit4]   2> 1519938 T4392 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1519938 T4467 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 1519943 T4467 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 1519944 T4420 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1519944 T4467 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1519945 T4467 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C835 name=collection1 org.apache.solr.core.SolrCore@77d8ccf0 url=https://127.0.0.1:51581/collection1 node=127.0.0.1:51581_ C835_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:51581, core=collection1, node_name=127.0.0.1:51581_}
   [junit4]   2> 1519945 T4467 C835 P51581 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:51581/collection1/
   [junit4]   2> 1519945 T4467 C835 P51581 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1519945 T4417 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1519945 T4467 C835 P51581 oasc.SyncStrategy.syncToMe https://127.0.0.1:51581/collection1/ has no replicas
   [junit4]   2> 1519946 T4467 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:51581/collection1/ shard2
   [junit4]   2> 1519946 T4467 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 1519947 T4420 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1519948 T4420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1519948 T4427 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1519948 T4462 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1519948 T4443 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1519951 T4417 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1519953 T4420 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1520054 T4443 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1520054 T4420 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1520054 T4427 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1520054 T4462 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1520103 T4467 oasc.ZkController.register We are https://127.0.0.1:51581/collection1/ and leader is https://127.0.0.1:51581/collection1/
   [junit4]   2> 1520104 T4467 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:51581
   [junit4]   2> 1520104 T4467 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1520104 T4467 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 1520104 T4467 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1520105 T4420 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1520105 T4428 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1520105 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1520106 T4467 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1520107 T4417 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1520107 T4417 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:51581",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:51581_",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node2"}
   [junit4]   2> 1520109 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1520210 T4429 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1520210 T4443 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1520210 T4462 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1520210 T4427 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1520992 T4392 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
   [junit4]   2> 1520993 T4392 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1520997 T4392 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 1520998 T4392 oejs.AbstractConnector.doStart Started SslSocketConnector@127.0.0.1:51594
   [junit4]   2> 1521001 T4392 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1521001 T4392 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1521001 T4392 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-005
   [junit4]   2> 1521002 T4392 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-005/'
   [junit4]   2> 1521035 T4392 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-005/solr.xml
   [junit4]   2> 1521121 T4392 oasc.CoreContainer.<init> New CoreContainer 1316103735
   [junit4]   2> 1521121 T4392 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-005/]
   [junit4]   2> 1521123 T4392 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1521123 T4392 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1521123 T4392 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1521124 T4392 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1521124 T4392 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1521124 T4392 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1521125 T4392 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1521125 T4392 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1521126 T4392 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1521128 T4392 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1521131 T4392 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1521131 T4392 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1521132 T4392 oasc.CoreCont

[...truncated too long message...]

   2> 1568271 T4392 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-006/ocptest2_shard1_replica1/data [CachedDir<<refCount=0;path=./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-006/ocptest2_shard1_replica1/data;done=false>>]
   [junit4]   2> 1568272 T4392 oasc.CachingDirectoryFactory.close Closing directory: ./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-006/ocptest2_shard1_replica1/data
   [junit4]   2> 1568272 T4392 oasc.SolrCore.close [ocptest_shardsplit_shard2_replica1]  CLOSING SolrCore org.apache.solr.core.SolrCore@59e95a18
   [junit4]   2> 1568281 T4392 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
   [junit4]   2> 1568282 T4392 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 1568282 T4392 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 1568282 T4392 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 1568283 T4392 oasc.SolrCore.closeSearcher [ocptest_shardsplit_shard2_replica1] Closing main searcher on request.
   [junit4]   2> 1568283 T4392 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 1568284 T4392 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-006/ocptest_shardsplit_shard2_replica1/data [CachedDir<<refCount=0;path=./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-006/ocptest_shardsplit_shard2_replica1/data;done=false>>]
   [junit4]   2> 1568284 T4392 oasc.CachingDirectoryFactory.close Closing directory: ./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-006/ocptest_shardsplit_shard2_replica1/data
   [junit4]   2> 1568284 T4392 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-006/ocptest_shardsplit_shard2_replica1/data/index [CachedDir<<refCount=0;path=./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-006/ocptest_shardsplit_shard2_replica1/data/index;done=false>>]
   [junit4]   2> 1568285 T4392 oasc.CachingDirectoryFactory.close Closing directory: ./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001/tempDir-006/ocptest_shardsplit_shard2_replica1/data/index
   [junit4]   2> 1568286 T5978 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:51601_
   [junit4]   2> 1568289 T5980 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:302)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:299)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:299)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:316)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:288)
   [junit4]   2> 
   [junit4]   2> 1569788 T4506 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 1569791 T4392 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
   [junit4]   2> 1573186 T4392 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
   [junit4]   2> 1573189 T4392 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:51990 51990
   [junit4]   2> 1573338 T4393 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:51990 51990
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=MultiThreadedOCPTest -Dtests.method=testDistribSearch -Dtests.seed=321C63B44F6D6ADC -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ko -Dtests.timezone=Pacific/Majuro -Dtests.file.encoding=US-ASCII
   [junit4] FAILURE 64.7s J1 | MultiThreadedOCPTest.testDistribSearch <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: We have a failed SPLITSHARD task
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([321C63B44F6D6ADC:B3FAEDAC38320AE0]:0)
   [junit4]    > 	at org.apache.solr.cloud.MultiThreadedOCPTest.testTaskExclusivity(MultiThreadedOCPTest.java:125)
   [junit4]    > 	at org.apache.solr.cloud.MultiThreadedOCPTest.doTest(MultiThreadedOCPTest.java:71)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1573367 T4392 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.MultiThreadedOCPTest-321C63B44F6D6ADC-001
   [junit4]   2> 64735 T4391 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Lucene42, sim=DefaultSimilarity, locale=ko, timezone=Pacific/Majuro
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_60 (64-bit)/cpus=16,threads=1,free=341353456,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [UnloadDistributedZkTest, ZkSolrClientTest, DistributedTermsComponentTest, TestDistributedGrouping, SpellPossibilityIteratorTest, BadCopyFieldTest, LeaderElectionTest, TestSolrQueryParser, ReturnFieldsTest, FileUtilsTest, JSONWriterTest, CSVRequestHandlerTest, SuggesterWFSTTest, TestCollationFieldDocValues, XsltUpdateRequestHandlerTest, OverseerRolesTest, OpenCloseCoreStressTest, TestMaxScoreQueryParser, TestDFRSimilarityFactory, SpellCheckCollatorTest, DocumentAnalysisRequestHandlerTest, AnalyticsQueryTest, TestFieldTypeCollectionResource, MoreLikeThisHandlerTest, ZkCLITest, TestQueryUtils, TestUpdate, CoreContainerCoreInitFailuresTest, TestSystemIdResolver, SolrCoreTest, SimplePostToolTest, PrimUtilsTest, ResourceLoaderTest, ShowFileRequestHandlerTest, TestMissingGroups, ShardSplitTest, TestValueSourceCache, ConvertedLegacyTest, TestReplicationHandlerBackup, SolrInfoMBeanTest, TestAddFieldRealTimeGet, TestFaceting, TestCoreContainer, OverseerCollectionProcessorTest, TestExpandComponent, TestPartialUpdateDeduplication, HardAutoCommitTest, TestIBSimilarityFactory, CacheHeaderTest, DebugComponentTest, CursorPagingTest, PrimitiveFieldTypeTest, HdfsSyncSliceTest, DistributedSuggestComponentTest, TestFastOutputStream, DistributedQueryComponentOptimizationTest, BlockDirectoryTest, AddBlockUpdateTest, TestSimpleQParserPlugin, SuggesterTSTTest, TestGroupingSearch, ShardRoutingTest, TestFiltering, CustomCollectionTest, StatelessScriptUpdateProcessorFactoryTest, ExternalFileFieldSortTest, DocValuesMissingTest, QueryResultKeyTest, CoreAdminRequestStatusTest, TestClassNameShortening, MinimalSchemaTest, AnalysisAfterCoreReloadTest, PreAnalyzedFieldTest, XmlUpdateRequestHandlerTest, TestCSVLoader, NoCacheHeaderTest, DOMUtilTest, NotRequiredUniqueKeyTest, BasicDistributedZkTest, TestDefaultSearchFieldResource, TestFileDictionaryLookup, SolrIndexConfigTest, DateMathParserTest, TestLMJelinekMercerSimilarityFactory, AsyncMigrateRouteKeyTest, TestStressLucene, TestManagedSynonymFilterFactory, SuggestComponentTest, ConnectionManagerTest, MultiThreadedOCPTest]
   [junit4] Completed on J1 in 65.01s, 1 test, 1 failure <<< FAILURES!

[...truncated 778 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:467: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:447: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:45: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:496: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1299: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:923: There were test failures: 411 suites, 1705 tests, 1 failure, 52 ignored (18 assumptions)

Total time: 120 minutes 41 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-Tests-4.x-Java7 #2040
Archived 3 artifacts
Archive block size is 32768
Received 0 blocks and 191726416 bytes
Compression is 0.0%
Took 33 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure