You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2014/08/22 17:09:03 UTC

[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 2066 - Failure

Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/2066/

7 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.MultiThreadedOCPTest

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.MultiThreadedOCPTest:     1) Thread[id=5295, name=OverseerThreadFactory-2312-thread-5, state=TIMED_WAITING, group=Overseer collection creation process.]         at java.lang.Thread.sleep(Native Method)         at org.apache.solr.cloud.OverseerCollectionProcessor.waitForCoreNodeName(OverseerCollectionProcessor.java:1621)         at org.apache.solr.cloud.OverseerCollectionProcessor.splitShard(OverseerCollectionProcessor.java:1503)         at org.apache.solr.cloud.OverseerCollectionProcessor.processMessage(OverseerCollectionProcessor.java:565)         at org.apache.solr.cloud.OverseerCollectionProcessor$Runner.run(OverseerCollectionProcessor.java:2623)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.MultiThreadedOCPTest: 
   1) Thread[id=5295, name=OverseerThreadFactory-2312-thread-5, state=TIMED_WAITING, group=Overseer collection creation process.]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.solr.cloud.OverseerCollectionProcessor.waitForCoreNodeName(OverseerCollectionProcessor.java:1621)
        at org.apache.solr.cloud.OverseerCollectionProcessor.splitShard(OverseerCollectionProcessor.java:1503)
        at org.apache.solr.cloud.OverseerCollectionProcessor.processMessage(OverseerCollectionProcessor.java:565)
        at org.apache.solr.cloud.OverseerCollectionProcessor$Runner.run(OverseerCollectionProcessor.java:2623)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
	at __randomizedtesting.SeedInfo.seed([41A319E125435502]:0)


REGRESSION:  org.apache.solr.cloud.OverseerTest.testOverseerFailure

Error Message:
Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed

Stack Trace:
org.apache.solr.common.SolrException: Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
	at __randomizedtesting.SeedInfo.seed([41A319E125435502:45AB961237E6BA23]:0)
	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:150)
	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:163)
	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:125)
	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:155)
	at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:314)
	at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:221)
	at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:157)
	at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:662)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
	at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:40)
	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:137)
	... 48 more
Caused by: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
	at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
	at org.apache.solr.common.cloud.SolrZkClient$11.execute(SolrZkClient.java:462)
	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:459)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:416)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:403)
	at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:142)
	at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:34)
	... 49 more


FAILED:  junit.framework.TestSuite.org.apache.solr.spelling.suggest.TestAnalyzeInfixSuggestions

Error Message:
SolrCore 'collection1' is not available due to init failure: null

Stack Trace:
org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: null
	at __randomizedtesting.SeedInfo.seed([41A319E125435502]:0)
	at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:745)
	at org.apache.solr.util.TestHarness.getCore(TestHarness.java:209)
	at org.apache.solr.util.TestHarness$LocalRequestFactory.makeRequest(TestHarness.java:420)
	at org.apache.solr.SolrTestCaseJ4.req(SolrTestCaseJ4.java:990)
	at org.apache.solr.spelling.suggest.TestAnalyzeInfixSuggestions.beforeClass(TestAnalyzeInfixSuggestions.java:33)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:767)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.common.SolrException
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	... 1 more
Caused by: java.lang.RuntimeException
	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
	... 8 more


FAILED:  junit.framework.TestSuite.org.apache.solr.spelling.suggest.TestFileDictionaryLookup

Error Message:
SolrCore 'collection1' is not available due to init failure: null

Stack Trace:
org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: null
	at __randomizedtesting.SeedInfo.seed([41A319E125435502]:0)
	at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:745)
	at org.apache.solr.util.TestHarness.getCore(TestHarness.java:209)
	at org.apache.solr.util.TestHarness$LocalRequestFactory.makeRequest(TestHarness.java:420)
	at org.apache.solr.SolrTestCaseJ4.req(SolrTestCaseJ4.java:990)
	at org.apache.solr.spelling.suggest.TestFileDictionaryLookup.beforeClass(TestFileDictionaryLookup.java:30)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:767)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.common.SolrException
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	... 1 more
Caused by: java.lang.RuntimeException
	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
	... 8 more


FAILED:  junit.framework.TestSuite.org.apache.solr.spelling.suggest.TestFreeTextSuggestions

Error Message:
SolrCore 'collection1' is not available due to init failure: null

Stack Trace:
org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: null
	at __randomizedtesting.SeedInfo.seed([41A319E125435502]:0)
	at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:745)
	at org.apache.solr.util.TestHarness.getCore(TestHarness.java:209)
	at org.apache.solr.util.TestHarness$LocalRequestFactory.makeRequest(TestHarness.java:420)
	at org.apache.solr.SolrTestCaseJ4.req(SolrTestCaseJ4.java:990)
	at org.apache.solr.spelling.suggest.TestFreeTextSuggestions.beforeClass(TestFreeTextSuggestions.java:32)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:767)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.common.SolrException
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	... 1 more
Caused by: java.lang.RuntimeException
	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
	... 8 more


FAILED:  junit.framework.TestSuite.org.apache.solr.spelling.suggest.TestFuzzyAnalyzedSuggestions

Error Message:
SolrCore 'collection1' is not available due to init failure: null

Stack Trace:
org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: null
	at __randomizedtesting.SeedInfo.seed([41A319E125435502]:0)
	at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:745)
	at org.apache.solr.util.TestHarness.getCore(TestHarness.java:209)
	at org.apache.solr.util.TestHarness$LocalRequestFactory.makeRequest(TestHarness.java:420)
	at org.apache.solr.SolrTestCaseJ4.req(SolrTestCaseJ4.java:990)
	at org.apache.solr.spelling.suggest.TestFuzzyAnalyzedSuggestions.beforeClass(TestFuzzyAnalyzedSuggestions.java:34)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:767)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.common.SolrException
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	... 1 more
Caused by: java.lang.RuntimeException
	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
	... 8 more


FAILED:  junit.framework.TestSuite.org.apache.solr.spelling.suggest.TestHighFrequencyDictionaryFactory

Error Message:
SolrCore 'collection1' is not available due to init failure: null

Stack Trace:
org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: null
	at __randomizedtesting.SeedInfo.seed([41A319E125435502]:0)
	at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:745)
	at org.apache.solr.util.TestHarness.getCoreInc(TestHarness.java:219)
	at org.apache.solr.util.TestHarness.update(TestHarness.java:235)
	at org.apache.solr.util.BaseTestHarness.checkUpdateStatus(BaseTestHarness.java:282)
	at org.apache.solr.util.BaseTestHarness.validateUpdate(BaseTestHarness.java:252)
	at org.apache.solr.SolrTestCaseJ4.checkUpdateU(SolrTestCaseJ4.java:663)
	at org.apache.solr.SolrTestCaseJ4.assertU(SolrTestCaseJ4.java:642)
	at org.apache.solr.SolrTestCaseJ4.assertU(SolrTestCaseJ4.java:636)
	at org.apache.solr.spelling.suggest.TestHighFrequencyDictionaryFactory.beforeClass(TestHighFrequencyDictionaryFactory.java:32)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:767)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.common.SolrException
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	... 1 more
Caused by: java.lang.RuntimeException
	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
	... 8 more




Build Log:
[...truncated 11256 lines...]
   [junit4] Suite: org.apache.solr.spelling.suggest.TestFreeTextSuggestions
   [junit4]   2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-41A319E125435502-001/init-core-data-001
   [junit4]   2> 317220 T506 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (true)
   [junit4]   2> 317221 T506 oas.SolrTestCaseJ4.initCore ####initCore
   [junit4]   2> 317221 T506 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/'
   [junit4]   2> 317223 T506 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
   [junit4]   2> 317223 T506 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 317224 T506 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 317321 T506 oasc.SolrConfig.<init> Using Lucene MatchVersion: 4.11.0
   [junit4]   2> 317361 T506 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-phrasesuggest.xml
   [junit4]   2> 317362 T506 oass.IndexSchema.readSchema Reading Solr Schema from schema-phrasesuggest.xml
   [junit4]   2> 317370 T506 oass.IndexSchema.readSchema [null] Schema name=test
   [junit4]   2> 317396 T506 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 317397 T506 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 317398 T506 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 317398 T506 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr
   [junit4]   2> 317399 T506 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/'
   [junit4]   2> 317445 T506 oasc.CoreContainer.<init> New CoreContainer 612440481
   [junit4]   2> 317446 T506 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/]
   [junit4]   2> 317447 T506 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 317447 T506 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 317447 T506 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 317447 T506 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 317448 T506 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 317448 T506 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 317448 T506 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 317448 T506 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 317449 T506 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 317449 T506 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=30000&connTimeout=30000&retry=false
   [junit4]   2> 317449 T506 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 317449 T506 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 317450 T506 oasc.CoreContainer.load Host Name: 
   [junit4]   2> 317454 T507 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/'
   [junit4]   2> 317456 T507 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
   [junit4]   2> 317456 T507 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 317456 T507 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 317557 T507 oasc.SolrConfig.<init> Using Lucene MatchVersion: 4.11.0
   [junit4]   2> 317623 T507 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-phrasesuggest.xml
   [junit4]   2> 317624 T507 oass.IndexSchema.readSchema Reading Solr Schema from schema-phrasesuggest.xml
   [junit4]   2> 317631 T507 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 317660 T507 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 317662 T507 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 317664 T507 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/
   [junit4]   2> 317664 T507 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 317664 T507 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-41A319E125435502-001/init-core-data-001/
   [junit4]   2> 317664 T507 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 317665 T507 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-41A319E125435502-001/init-core-data-001
   [junit4]   2> 317665 T507 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-41A319E125435502-001/init-core-data-001/index/
   [junit4]   2> 317666 T507 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-41A319E125435502-001/init-core-data-001/index' doesn't exist. Creating new index...
   [junit4]   2> 317667 T507 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-41A319E125435502-001/init-core-data-001/index
   [junit4]   2> 317667 T507 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=37, maxMergedSegmentMB=73.5712890625, floorSegmentMB=0.76171875, forceMergeDeletesPctAllowed=9.551670063104096, segmentsPerTier=31.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 317668 T507 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@c56677c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5bb89ea),segFN=segments_1,generation=1}
   [junit4]   2> 317668 T507 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 317670 T507 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 317670 T507 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 317671 T507 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 317671 T507 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 317671 T507 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 317672 T507 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 317672 T507 oasc.RequestHandlers.initHandlersFromConfig created /suggest_wfst: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 317672 T507 oasc.RequestHandlers.initHandlersFromConfig created /suggest_analyzing: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 317673 T507 oasc.RequestHandlers.initHandlersFromConfig created /infix_suggest_analyzing: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 317673 T507 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_file_dict: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 317673 T507 oasc.RequestHandlers.initHandlersFromConfig created /blended_infix_suggest: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 317674 T507 oasc.RequestHandlers.initHandlersFromConfig created /free_text_suggest: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 317674 T507 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_high_freq_dict: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 317674 T507 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 317674 T507 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_max_edit_2: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 317675 T507 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_non_fuzzy_prefix_4: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 317675 T507 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_min_fuzzy_length_2: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 317703 T507 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 317705 T507 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 317707 T507 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 317709 T507 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 317713 T507 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 317713 T507 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 317713 T507 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=21, maxMergeAtOnceExplicit=37, maxMergedSegmentMB=49.3046875, floorSegmentMB=0.693359375, forceMergeDeletesPctAllowed=3.635932570392315, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 317714 T507 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@c56677c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5bb89ea),segFN=segments_1,generation=1}
   [junit4]   2> 317714 T507 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 317715 T507 oass.SolrIndexSearcher.<init> Opening Searcher@7019cd0b[collection1] main
   [junit4]   2> 317716 T507 oasr.ManagedResourceStorage.newStorageIO WARN Cannot write to config directory /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
   [junit4]   2> 317716 T507 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 317716 T507 oasr.ManagedResourceStorage.load Reading _rest_managed.json using InMemoryStorage
   [junit4]   2> 317716 T507 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
   [junit4]   2> 317717 T507 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using InMemoryStorage
   [junit4]   2> 317717 T507 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 317717 T507 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 317717 T507 oasss.Suggester.init init: {name=suggest_wfst,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.WFSTLookupFactory,storeDir=suggest_wfst,buildOnCommit=false,exactMatchFirst=true,sourceLocation=phrasesuggest.txt}
   [junit4]   2> 317720 T507 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 317720 T507 oasss.Suggester.init init: {name=suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingLookupFactory,storeDir=suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=ja_suggest,preserveSep=false,sourceLocation=jasuggest.txt}
   [junit4]   2> 317721 T507 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 317722 T507 oasss.Suggester.init init: {name=infix_suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingInfixLookupFactory,buildOnCommit=false,suggestAnalyzerFieldType=text,sourceLocation=analyzingInfixSuggest.txt}
   [junit4]   2> 317723 T507 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 317723 T507 oasss.SolrSuggester.init init: {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
   [junit4]   2> 317725 T507 oasss.SolrSuggester.init Dictionary loaded with params: {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
   [junit4]   2> 317725 T507 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 317725 T507 oasss.SolrSuggester.init init: {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator= ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
   [junit4]   2> 317726 T507 oasss.SolrSuggester.init Dictionary loaded with params: {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator= ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
   [junit4]   2> 317727 T507 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 317727 T507 oasss.SolrSuggester.init init: {name=blended_infix_suggest_linear,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=FileDictionaryFactory,buildOnCommit=false,sourceLocation=blendedInfixSuggest.txt,indexPath=blendedInfixDir1,blenderType=linear,suggestAnalyzerFieldType=text}
   [junit4]   2> 318731 T507 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@6af5dbe
   [junit4]   2> 318731 T508 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7019cd0b[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 318731 T507 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 318732 T507 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 318732 T507 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 318732 T507 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 318733 T507 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 318733 T507 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 318733 T507 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-41A319E125435502-001/init-core-data-001/index [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-41A319E125435502-001/init-core-data-001/index;done=false>>]
   [junit4]   2> 318734 T507 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-41A319E125435502-001/init-core-data-001/index
   [junit4]   2> 318734 T507 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-41A319E125435502-001/init-core-data-001 [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-41A319E125435502-001/init-core-data-001;done=false>>]
   [junit4]   2> 318734 T507 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-41A319E125435502-001/init-core-data-001
   [junit4]   2> 318742 T507 oasc.CoreContainer.create ERROR Error creating core [collection1]: null org.apache.solr.common.SolrException
   [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: java.lang.RuntimeException
   [junit4]   2> 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
   [junit4]   2> 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
   [junit4]   2> 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
   [junit4]   2> 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
   [junit4]   2> 	... 8 more
   [junit4]   2> 
   [junit4]   2> 318745 T506 oas.SolrTestCaseJ4.initCore ####initCore end
   [junit4]   2> 318745 T506 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 318746 T506 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=612440481
   [junit4]   2> NOTE: test params are: codec=Lucene49, sim=DefaultSimilarity, locale=tr_TR, timezone=SystemV/AST4ADT
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_60 (64-bit)/cpus=16,threads=1,free=256741160,total=361758720
   [junit4]   2> NOTE: All tests run in this JVM: [AddSchemaFieldsUpdateProcessorFactoryTest, DebugComponentTest, ClusterStateUpdateTest, TestReload, ZkControllerTest, TestWriterPerf, TestRecovery, TestIntervalFaceting, TestDynamicFieldCollectionResource, TestPivotHelperCode, TestMaxScoreQueryParser, TestSchemaSimilarityResource, TestPerFieldSimilarity, TestSolrQueryParser, IndexSchemaRuntimeFieldTest, SampleTest, TestSchemaVersionResource, TestQuerySenderListener, CollectionsAPIAsyncDistributedZkTest, TestInfoStreamLogging, TestBlendedInfixSuggestions, TestFieldCollectionResource, TestFieldResource, HttpPartitionTest, TestFreeTextSuggestions]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestFreeTextSuggestions -Dtests.seed=41A319E125435502 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=tr_TR -Dtests.timezone=SystemV/AST4ADT -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J0 | TestFreeTextSuggestions (suite) <<<
   [junit4]    > Throwable #1: org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: null
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([41A319E125435502]:0)
   [junit4]    > 	at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:745)
   [junit4]    > 	at org.apache.solr.util.TestHarness.getCore(TestHarness.java:209)
   [junit4]    > 	at org.apache.solr.util.TestHarness$LocalRequestFactory.makeRequest(TestHarness.java:420)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.req(SolrTestCaseJ4.java:990)
   [junit4]    > 	at org.apache.solr.spelling.suggest.TestFreeTextSuggestions.beforeClass(TestFreeTextSuggestions.java:32)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]    > Caused by: org.apache.solr.common.SolrException
   [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
   [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
   [junit4]    > 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
   [junit4]    > 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
   [junit4]    > 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
   [junit4]    > 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]    > 	... 1 more
   [junit4]    > Caused by: java.lang.RuntimeException
   [junit4]    > 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
   [junit4]    > 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
   [junit4]    > 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
   [junit4]    > 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
   [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
   [junit4]    > 	... 8 more
   [junit4] Completed on J0 in 1.60s, 0 tests, 1 error <<< FAILURES!

[...truncated 140 lines...]
   [junit4] Suite: org.apache.solr.spelling.suggest.TestFuzzyAnalyzedSuggestions
   [junit4]   2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-41A319E125435502-001/init-core-data-001
   [junit4]   2> 578472 T1491 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (true)
   [junit4]   2> 578473 T1491 oas.SolrTestCaseJ4.initCore ####initCore
   [junit4]   2> 578473 T1491 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/'
   [junit4]   2> 578474 T1491 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
   [junit4]   2> 578475 T1491 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 578475 T1491 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 578561 T1491 oasc.SolrConfig.<init> Using Lucene MatchVersion: 4.11.0
   [junit4]   2> 578603 T1491 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-phrasesuggest.xml
   [junit4]   2> 578604 T1491 oass.IndexSchema.readSchema Reading Solr Schema from schema-phrasesuggest.xml
   [junit4]   2> 578609 T1491 oass.IndexSchema.readSchema [null] Schema name=test
   [junit4]   2> 578629 T1491 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 578630 T1491 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 578631 T1491 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 578631 T1491 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr
   [junit4]   2> 578632 T1491 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/'
   [junit4]   2> 578676 T1491 oasc.CoreContainer.<init> New CoreContainer 1482249818
   [junit4]   2> 578676 T1491 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/]
   [junit4]   2> 578677 T1491 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 578677 T1491 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 578678 T1491 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 578678 T1491 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 578678 T1491 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 578678 T1491 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 578678 T1491 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 578679 T1491 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 578679 T1491 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 578679 T1491 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=30000&connTimeout=30000&retry=false
   [junit4]   2> 578679 T1491 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 578680 T1491 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 578680 T1491 oasc.CoreContainer.load Host Name: 
   [junit4]   2> 578684 T1492 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/'
   [junit4]   2> 578685 T1492 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
   [junit4]   2> 578686 T1492 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 578686 T1492 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 578745 T1492 oasc.SolrConfig.<init> Using Lucene MatchVersion: 4.11.0
   [junit4]   2> 578823 T1492 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-phrasesuggest.xml
   [junit4]   2> 578824 T1492 oass.IndexSchema.readSchema Reading Solr Schema from schema-phrasesuggest.xml
   [junit4]   2> 578831 T1492 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 578856 T1492 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 578858 T1492 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 578859 T1492 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/
   [junit4]   2> 578859 T1492 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 578859 T1492 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-41A319E125435502-001/init-core-data-001/
   [junit4]   2> 578860 T1492 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 578860 T1492 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-41A319E125435502-001/init-core-data-001
   [junit4]   2> 578861 T1492 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-41A319E125435502-001/init-core-data-001/index/
   [junit4]   2> 578861 T1492 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-41A319E125435502-001/init-core-data-001/index' doesn't exist. Creating new index...
   [junit4]   2> 578861 T1492 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-41A319E125435502-001/init-core-data-001/index
   [junit4]   2> 578862 T1492 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=27, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 578863 T1492 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@7c9e4a46 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@324787a1),segFN=segments_1,generation=1}
   [junit4]   2> 578863 T1492 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 578865 T1492 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 578865 T1492 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 578866 T1492 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 578866 T1492 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 578866 T1492 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 578867 T1492 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 578867 T1492 oasc.RequestHandlers.initHandlersFromConfig created /suggest_wfst: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 578867 T1492 oasc.RequestHandlers.initHandlersFromConfig created /suggest_analyzing: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 578868 T1492 oasc.RequestHandlers.initHandlersFromConfig created /infix_suggest_analyzing: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 578868 T1492 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_file_dict: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 578868 T1492 oasc.RequestHandlers.initHandlersFromConfig created /blended_infix_suggest: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 578869 T1492 oasc.RequestHandlers.initHandlersFromConfig created /free_text_suggest: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 578869 T1492 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_high_freq_dict: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 578869 T1492 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 578870 T1492 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_max_edit_2: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 578870 T1492 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_non_fuzzy_prefix_4: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 578870 T1492 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_min_fuzzy_length_2: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 578888 T1492 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 578890 T1492 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 578892 T1492 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 578894 T1492 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 578897 T1492 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 578898 T1492 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 578898 T1492 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=48, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.31149779368116737]
   [junit4]   2> 578899 T1492 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@7c9e4a46 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@324787a1),segFN=segments_1,generation=1}
   [junit4]   2> 578899 T1492 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 578899 T1492 oass.SolrIndexSearcher.<init> Opening Searcher@59329086[collection1] main
   [junit4]   2> 578900 T1492 oasr.ManagedResourceStorage.newStorageIO WARN Cannot write to config directory /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
   [junit4]   2> 578900 T1492 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 578901 T1492 oasr.ManagedResourceStorage.load Reading _rest_managed.json using InMemoryStorage
   [junit4]   2> 578901 T1492 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
   [junit4]   2> 578901 T1492 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using InMemoryStorage
   [junit4]   2> 578901 T1492 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 578902 T1492 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 578902 T1492 oasss.Suggester.init init: {name=suggest_wfst,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.WFSTLookupFactory,storeDir=suggest_wfst,buildOnCommit=false,exactMatchFirst=true,sourceLocation=phrasesuggest.txt}
   [junit4]   2> 578904 T1492 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 578904 T1492 oasss.Suggester.init init: {name=suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingLookupFactory,storeDir=suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=ja_suggest,preserveSep=false,sourceLocation=jasuggest.txt}
   [junit4]   2> 578905 T1492 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 578905 T1492 oasss.Suggester.init init: {name=infix_suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingInfixLookupFactory,buildOnCommit=false,suggestAnalyzerFieldType=text,sourceLocation=analyzingInfixSuggest.txt}
   [junit4]   2> 578906 T1492 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 578907 T1492 oasss.SolrSuggester.init init: {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
   [junit4]   2> 578908 T1492 oasss.SolrSuggester.init Dictionary loaded with params: {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
   [junit4]   2> 578908 T1492 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 578908 T1492 oasss.SolrSuggester.init init: {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator= ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
   [junit4]   2> 578909 T1492 oasss.SolrSuggester.init Dictionary loaded with params: {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator= ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
   [junit4]   2> 578910 T1492 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 578910 T1492 oasss.SolrSuggester.init init: {name=blended_infix_suggest_linear,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=FileDictionaryFactory,buildOnCommit=false,sourceLocation=blendedInfixSuggest.txt,indexPath=blendedInfixDir1,blenderType=linear,suggestAnalyzerFieldType=text}
   [junit4]   2> 579918 T1492 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@6ae7b2a
   [junit4]   2> 579918 T1493 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@59329086[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 579918 T1492 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 579919 T1492 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 579919 T1492 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 579919 T1492 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 579920 T1492 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 579920 T1492 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 579920 T1492 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-41A319E125435502-001/init-core-data-001 [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-41A319E125435502-001/init-core-data-001;done=false>>]
   [junit4]   2> 579920 T1492 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-41A319E125435502-001/init-core-data-001
   [junit4]   2> 579921 T1492 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-41A319E125435502-001/init-core-data-001/index [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-41A319E125435502-001/init-core-data-001/index;done=false>>]
   [junit4]   2> 579921 T1492 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-41A319E125435502-001/init-core-data-001/index
   [junit4]   2> 579921 T1492 oasc.CoreContainer.create ERROR Error creating core [collection1]: null org.apache.solr.common.SolrException
   [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: java.lang.RuntimeException
   [junit4]   2> 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
   [junit4]   2> 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
   [junit4]   2> 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
   [junit4]   2> 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
   [junit4]   2> 	... 8 more
   [junit4]   2> 
   [junit4]   2> 579925 T1491 oas.SolrTestCaseJ4.initCore ####initCore end
   [junit4]   2> 579925 T1491 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 579926 T1491 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1482249818
   [junit4]   2> NOTE: test params are: codec=Lucene45, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=zh_TW, timezone=America/Blanc-Sablon
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_60 (64-bit)/cpus=16,threads=1,free=340470168,total=520093696
   [junit4]   2> NOTE: All tests run in this JVM: [AddSchemaFieldsUpdateProcessorFactoryTest, DebugComponentTest, ClusterStateUpdateTest, TestReload, ZkControllerTest, TestWriterPerf, TestRecovery, TestIntervalFaceting, TestDynamicFieldCollectionResource, TestPivotHelperCode, TestMaxScoreQueryParser, TestSchemaSimilarityResource, TestPerFieldSimilarity, TestSolrQueryParser, IndexSchemaRuntimeFieldTest, SampleTest, TestSchemaVersionResource, TestQuerySenderListener, CollectionsAPIAsyncDistributedZkTest, TestInfoStreamLogging, TestBlendedInfixSuggestions, TestFieldCollectionResource, TestFieldResource, HttpPartitionTest, TestFreeTextSuggestions, TestExceedMaxTermLength, TestRecoveryHdfs, StatelessScriptUpdateProcessorFactoryTest, TestBinaryResponseWriter, TestLeaderElectionZkExpiry, XsltUpdateRequestHandlerTest, TestReversedWildcardFilterFactory, TestSolrCoreProperties, AliasIntegrationTest, TestBM25SimilarityFactory, QueryParsingTest, DeleteReplicaTest, CustomCollectionTest, TestReloadAndDeleteDocs, CachingDirectoryFactoryTest, IndexBasedSpellCheckerTest, TestQuerySenderNoQuery, ResourceLoaderTest, MinimalSchemaTest, InfoHandlerTest, NumericFieldsTest, SolrPluginUtilsTest, TestManagedStopFilterFactory, TestFuzzyAnalyzedSuggestions]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestFuzzyAnalyzedSuggestions -Dtests.seed=41A319E125435502 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=zh_TW -Dtests.timezone=America/Blanc-Sablon -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J0 | TestFuzzyAnalyzedSuggestions (suite) <<<
   [junit4]    > Throwable #1: org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: null
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([41A319E125435502]:0)
   [junit4]    > 	at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:745)
   [junit4]    > 	at org.apache.solr.util.TestHarness.getCore(TestHarness.java:209)
   [junit4]    > 	at org.apache.solr.util.TestHarness$LocalRequestFactory.makeRequest(TestHarness.java:420)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.req(SolrTestCaseJ4.java:990)
   [junit4]    > 	at org.apache.solr.spelling.suggest.TestFuzzyAnalyzedSuggestions.beforeClass(TestFuzzyAnalyzedSuggestions.java:34)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]    > Caused by: org.apache.solr.common.SolrException
   [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
   [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
   [junit4]    > 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
   [junit4]    > 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
   [junit4]    > 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
   [junit4]    > 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]    > 	... 1 more
   [junit4]    > Caused by: java.lang.RuntimeException
   [junit4]    > 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
   [junit4]    > 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
   [junit4]    > 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
   [junit4]    > 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
   [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
   [junit4]    > 	... 8 more
   [junit4] Completed on J0 in 1.49s, 0 tests, 1 error <<< FAILURES!

[...truncated 293 lines...]
   [junit4] Suite: org.apache.solr.cloud.OverseerTest
   [junit4]   2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.OverseerTest-41A319E125435502-001/init-core-data-001
   [junit4]   2> 2078956 T4164 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
   [junit4]   2> 2078956 T4164 oas.SolrTestCaseJ4.initCore ####initCore
   [junit4]   2> 2078957 T4164 oas.SolrTestCaseJ4.initCore ####initCore end
   [junit4]   2> 2078961 T4164 oas.SolrTestCaseJ4.setUp ###Starting testReplay
   [junit4]   2> 2078962 T4164 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2078963 T4165 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 2079063 T4164 oasc.ZkTestServer.run start zk server on port:30697
   [junit4]   2> 2079064 T4164 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2079068 T4171 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2c6f62bf name:ZooKeeperConnection Watcher:127.0.0.1:30697/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2079069 T4164 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2079069 T4164 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2079072 T4173 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3a715d1c name:ZooKeeperConnection Watcher:127.0.0.1:30697 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2079072 T4164 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2079075 T4164 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2079076 T4175 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a474341 name:ZooKeeperConnection Watcher:127.0.0.1:30697 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2079076 T4164 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2079077 T4164 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 2079080 T4164 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 2079082 T4164 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 2079083 T4164 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 2079084 T4164 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2079086 T4164 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 2079089 T4164 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2079090 T4177 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@592e7c3f name:ZooKeeperConnection Watcher:127.0.0.1:30697/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2079090 T4164 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2079091 T4164 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: retry=false
   [junit4]   2> 2079095 T4164 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 2079096 T4164 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 2079097 T4164 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 2079099 T4164 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:30697_solr
   [junit4]   2> 2079099 T4164 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 2079100 T4164 oasc.Overseer.start Overseer (id=92321677498122243-127.0.0.1:30697_solr-n_0000000000) starting
   [junit4]   2> 2079102 T4164 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 2079104 T4164 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 2079106 T4164 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 2079107 T4164 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 2079109 T4164 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 2079113 T4164 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 2079113 T4179 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 2079115 T4178 oasc.Overseer$ClusterStateUpdater.run Replaying operations from work queue.
   [junit4]   2> 2079115 T4178 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "base_url":"http://127.0.0.1/solr",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "shard":"s1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "roles":"",
   [junit4]   2> 	  "state":"recovering"}
   [junit4]   2> 2079116 T4181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
   [junit4]   2> 2079118 T4178 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "base_url":"http://127.0.0.1/solr",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "shard":"s1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "core":"core2",
   [junit4]   2> 	  "roles":"",
   [junit4]   2> 	  "state":"recovering"}
   [junit4]   2> 2079119 T4181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
   [junit4]   2> 2079120 T4178 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 2079121 T4178 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "base_url":"http://127.0.0.1/solr",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "shard":"s1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "core":"core3",
   [junit4]   2> 	  "roles":"",
   [junit4]   2> 	  "state":"recovering"}
   [junit4]   2> 2079123 T4182 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2079123 T4181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
   [junit4]   2> 2079219 T4164 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:30697 30697
   [junit4]   2> 2079416 T4165 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:30697 30697
   [junit4]   2> 2079419 T4164 oas.SolrTestCaseJ4.tearDown ###Ending testReplay
   [junit4]   2> 2079420 T4164 oasc.Overseer.close Overseer (id=92321677498122243-127.0.0.1:30697_solr-n_0000000000) closing
   [junit4]   2> 2079420 T4178 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:30697_solr
   [junit4]   2> 2079423 T4183 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:307)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:304)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:304)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:320)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:89)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:292)
   [junit4]   2> 
   [junit4]   2> 2079431 T4164 oas.SolrTestCaseJ4.setUp ###Starting testShardAssignmentBigger
   [junit4]   2> 2079432 T4164 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2079433 T4184 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 2079533 T4164 oasc.ZkTestServer.run start zk server on port:24615
   [junit4]   2> 2079534 T4164 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2079538 T4190 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3fcf951c name:ZooKeeperConnection Watcher:127.0.0.1:24615 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2079538 T4164 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2079542 T4164 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2079543 T4192 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@43d55824 name:ZooKeeperConnection Watcher:127.0.0.1:24615 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2079543 T4164 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2079544 T4164 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 2079549 T4164 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2079550 T4194 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3e50bb84 name:ZooKeeperConnection Watcher:127.0.0.1:24615/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4

[...truncated too long message...]

.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: java.lang.RuntimeException
   [junit4]   2> 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
   [junit4]   2> 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
   [junit4]   2> 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
   [junit4]   2> 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
   [junit4]   2> 	... 8 more
   [junit4]   2> 
   [junit4]   2> 4724166 T9902 oas.SolrTestCaseJ4.initCore ####initCore end
   [junit4]   2> 4724167 T9902 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 4724167 T9902 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1765317080
   [junit4]   2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=319), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=319)), sim=DefaultSimilarity, locale=ar_EG, timezone=America/Guayaquil
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_60 (64-bit)/cpus=16,threads=1,free=188245632,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [AddSchemaFieldsUpdateProcessorFactoryTest, DebugComponentTest, ClusterStateUpdateTest, TestReload, ZkControllerTest, TestWriterPerf, TestRecovery, TestIntervalFaceting, TestDynamicFieldCollectionResource, TestPivotHelperCode, TestMaxScoreQueryParser, TestSchemaSimilarityResource, TestPerFieldSimilarity, TestSolrQueryParser, IndexSchemaRuntimeFieldTest, SampleTest, TestSchemaVersionResource, TestQuerySenderListener, CollectionsAPIAsyncDistributedZkTest, TestInfoStreamLogging, TestBlendedInfixSuggestions, TestFieldCollectionResource, TestFieldResource, HttpPartitionTest, TestFreeTextSuggestions, TestExceedMaxTermLength, TestRecoveryHdfs, StatelessScriptUpdateProcessorFactoryTest, TestBinaryResponseWriter, TestLeaderElectionZkExpiry, XsltUpdateRequestHandlerTest, TestReversedWildcardFilterFactory, TestSolrCoreProperties, AliasIntegrationTest, TestBM25SimilarityFactory, QueryParsingTest, DeleteReplicaTest, CustomCollectionTest, TestReloadAndDeleteDocs, CachingDirectoryFactoryTest, IndexBasedSpellCheckerTest, TestQuerySenderNoQuery, ResourceLoaderTest, MinimalSchemaTest, InfoHandlerTest, NumericFieldsTest, SolrPluginUtilsTest, TestManagedStopFilterFactory, TestFuzzyAnalyzedSuggestions, HdfsUnloadDistributedZkTest, SystemInfoHandlerTest, TestFastWriter, SolrCmdDistributorTest, TestManagedSchema, HdfsDirectoryTest, TimeZoneUtilsTest, OverseerCollectionProcessorTest, TestSurroundQueryParser, DistribDocExpirationUpdateProcessorTest, HdfsSyncSliceTest, NotRequiredUniqueKeyTest, TestReRankQParserPlugin, TestStressLucene, PathHierarchyTokenizerFactoryTest, TestSolrQueryParserDefaultOperatorResource, TestNonNRTOpen, BasicDistributedZkTest, TestStandardQParsers, TestCloudManagedSchema, ZkSolrClientTest, TestOmitPositions, SolrTestCaseJ4Test, BadComponentTest, TestPartialUpdateDeduplication, StressHdfsTest, DistributedIntervalFacetingTest, SuggesterTest, DistributedQueryElevationComponentTest, HdfsRecoveryZkTest, FieldMutatingUpdateProcessorTest, ReplicationFactorTest, AnalyticsMergeStrategyTest, AssignTest, CoreAdminCreateDiscoverTest, ResponseHeaderTest, TermVectorComponentDistributedTest, ExternalFileFieldSortTest, HdfsLockFactoryTest, SSLMigrationTest, PolyFieldTest, DocExpirationUpdateProcessorFactoryTest, TestCustomSort, ConvertedLegacyTest, TestIBSimilarityFactory, ZkNodePropsTest, TestNoOpRegenerator, CollectionsAPIDistributedZkTest, DocumentBuilderTest, QueryElevationComponentTest, ChaosMonkeySafeLeaderTest, TestCloudManagedSchemaConcurrent, ShardRoutingTest, UnloadDistributedZkTest, AsyncMigrateRouteKeyTest, TestManagedSchemaFieldResource, LeaderElectionIntegrationTest, TestRequestStatusCollectionAPI, TestDistribDocBasedVersion, DistributedTermsComponentTest, TestDistributedMissingSort, TestJoin, DistributedFacetPivotLargeTest, TestCollectionAPI, MergeStrategyTest, TestCoreContainer, TestHashPartitioner, PeerSyncTest, TestRealTimeGet, TestGroupingSearch, TestManagedSynonymFilterFactory, TestDocBasedVersionConstraints, ZkCLITest, TestSolr4Spatial, TestRangeQuery, TestSolrXmlPersistence, SpellCheckComponentTest, CacheHeaderTest, TestCopyFieldCollectionResource, TestSchemaNameResource, TestUniqueKeyFieldResource, TestFaceting, TestStressUserVersions, SolrXmlInZkTest, StatsComponentTest, BasicFunctionalityTest, CursorMarkTest, TestFunctionQuery, CurrencyFieldXmlFileTest, SchemaVersionSpecificBehaviorTest, TestAtomicUpdateErrorCases, DocValuesMissingTest, TestExtendedDismaxParser, TestIndexSearcher, TestMultiCoreConfBootstrap, TestPseudoReturnFields, SignatureUpdateProcessorFactoryTest, SpatialFilterTest, TestWordDelimiterFilterFactory, TestCSVLoader, TestNRTOpen, TestSolrDeletionPolicy1, DisMaxRequestHandlerTest, XmlUpdateRequestHandlerTest, BJQParserTest, TestCSVResponseWriter, DirectSolrSpellCheckerTest, TestCoreDiscovery, TermVectorComponentTest, TestConfig, LoggingHandlerTest, TermsComponentTest, TestUpdate, AnalyticsQueryTest, TestTrie, SOLR749Test, IndexSchemaTest, FieldAnalysisRequestHandlerTest, RegexBoostProcessorTest, CoreMergeIndexesAdminHandlerTest, TestQueryUtils, TestQueryTypes, TestComponentsName, TestSolrDeletionPolicy2, CopyFieldTest, RequiredFieldsTest, TestPostingsSolrHighlighter, DocValuesMultiTest, TestSolrXml, TestSolr4Spatial2, TestAnalyzeInfixSuggestions, TestHighFrequencyDictionaryFactory, TestLuceneMatchVersion, TestFileDictionaryLookup]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestFileDictionaryLookup -Dtests.seed=41A319E125435502 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar_EG -Dtests.timezone=America/Guayaquil -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J0 | TestFileDictionaryLookup (suite) <<<
   [junit4]    > Throwable #1: org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: null
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([41A319E125435502]:0)
   [junit4]    > 	at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:745)
   [junit4]    > 	at org.apache.solr.util.TestHarness.getCore(TestHarness.java:209)
   [junit4]    > 	at org.apache.solr.util.TestHarness$LocalRequestFactory.makeRequest(TestHarness.java:420)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.req(SolrTestCaseJ4.java:990)
   [junit4]    > 	at org.apache.solr.spelling.suggest.TestFileDictionaryLookup.beforeClass(TestFileDictionaryLookup.java:30)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]    > Caused by: org.apache.solr.common.SolrException
   [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
   [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
   [junit4]    > 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
   [junit4]    > 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
   [junit4]    > 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
   [junit4]    > 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]    > 	... 1 more
   [junit4]    > Caused by: java.lang.RuntimeException
   [junit4]    > 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
   [junit4]    > 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
   [junit4]    > 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
   [junit4]    > 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
   [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
   [junit4]    > 	... 8 more
   [junit4] Completed on J0 in 1.68s, 0 tests, 1 error <<< FAILURES!

[...truncated 147 lines...]
BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:475: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:455: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:45: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:496: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1351: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:966: There were test failures: 419 suites, 1723 tests, 6 suite-level errors, 1 error, 53 ignored (19 assumptions)

Total time: 132 minutes 35 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-Tests-4.x-Java7 #2065
Archived 3 artifacts
Archive block size is 32768
Received 0 blocks and 225965606 bytes
Compression is 0.0%
Took 41 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 2072 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/2072/

1 tests failed.
REGRESSION:  org.apache.solr.cloud.OverseerTest.testOverseerFailure

Error Message:
Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed

Stack Trace:
org.apache.solr.common.SolrException: Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
	at __randomizedtesting.SeedInfo.seed([2BFAD87E5C912CA4:2FF2578D4E34C385]:0)
	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:150)
	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:163)
	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:125)
	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:155)
	at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:314)
	at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:221)
	at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:157)
	at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:662)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
	at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:40)
	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:137)
	... 48 more
Caused by: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
	at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
	at org.apache.solr.common.cloud.SolrZkClient$11.execute(SolrZkClient.java:462)
	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:459)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:416)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:403)
	at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:142)
	at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:34)
	... 49 more




Build Log:
[...truncated 11031 lines...]
   [junit4] Suite: org.apache.solr.cloud.OverseerTest
   [junit4]   2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.OverseerTest-2BFAD87E5C912CA4-001/init-core-data-001
   [junit4]   2> 934278 T1576 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
   [junit4]   2> 934279 T1576 oas.SolrTestCaseJ4.initCore ####initCore
   [junit4]   2> 934279 T1576 oas.SolrTestCaseJ4.initCore ####initCore end
   [junit4]   2> 934285 T1576 oas.SolrTestCaseJ4.setUp ###Starting testOverseerFailure
   [junit4]   2> 934286 T1576 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 934286 T1577 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 934386 T1576 oasc.ZkTestServer.run start zk server on port:51907
   [junit4]   2> 934387 T1576 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 934392 T1583 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@43ff9e3d name:ZooKeeperConnection Watcher:127.0.0.1:51907 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 934392 T1576 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 934394 T1576 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 934396 T1585 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5c1de932 name:ZooKeeperConnection Watcher:127.0.0.1:51907 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 934396 T1576 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 934396 T1576 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 934400 T1576 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 934401 T1587 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@37f23034 name:ZooKeeperConnection Watcher:127.0.0.1:51907/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 934401 T1576 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 934401 T1576 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 934404 T1576 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 934405 T1576 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 934407 T1576 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 934410 T1576 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 934411 T1589 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@34f55f1c name:ZooKeeperConnection Watcher:127.0.0.1:51907/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 934412 T1576 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 934413 T1576 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 934415 T1576 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
   [junit4]   2> 934418 T1576 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 934420 T1593 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4e7f8154 name:ZooKeeperConnection Watcher:127.0.0.1:51907/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 934420 T1576 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 934420 T1576 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: retry=false
   [junit4]   2> 934424 T1576 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 934426 T1576 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 934428 T1576 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 934430 T1576 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:51907_solr
   [junit4]   2> 934430 T1576 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 934432 T1576 oasc.Overseer.start Overseer (id=92334267892236292-127.0.0.1:51907_solr-n_0000000000) starting
   [junit4]   2> 934434 T1576 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 934436 T1576 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 934439 T1576 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 934442 T1576 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 934444 T1576 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 934447 T1576 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 934451 T1576 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 934452 T1595 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 934453 T1594 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 935455 T1597 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 935457 T1594 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"recovering",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node1/solr/"}
   [junit4]   2> 935457 T1594 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1]
   [junit4]   2> 935457 T1594 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 935460 T1591 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 935460 T1590 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 935956 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 935963 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 935968 T1597 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 935970 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 935972 T1594 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node1/solr/"}
   [junit4]   2> 935973 T1594 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
   [junit4]   2> 935975 T1597 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 935976 T1590 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 935976 T1591 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 936455 T1595 oasc.OverseerCollectionProcessor.amILeader  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:307)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:304)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:304)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerCollectionProcessor.amILeader(OverseerCollectionProcessor.java:514)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:272)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 936455 T1595 oasc.OverseerCollectionProcessor.amILeader According to ZK I (id=92334267892236292-127.0.0.1:51907_solr-n_0000000000) am no longer a leader.
   [junit4]   2> 937030 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 937036 T1576 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 937037 T1599 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b1de3ca name:ZooKeeperConnection Watcher:127.0.0.1:51907/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 937038 T1576 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 937038 T1576 oasc.Overseer.close Overseer (id=92334267892236292-127.0.0.1:51907_solr-n_0000000000) closing
   [junit4]   2> 937039 T1594 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:51907_solr
   [junit4]   2> 937040 T1576 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: retry=false
   [junit4]   2> 937040 T1600 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:307)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:304)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:304)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:320)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:89)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:292)
   [junit4]   2> 
   [junit4]   2> 937044 T1576 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 937046 T1576 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:51907_solr
   [junit4]   2> 937047 T1576 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 937048 T1576 oasc.Overseer.start Overseer (id=92334267892236293-127.0.0.1:51907_solr-n_0000000001) starting
   [junit4]   2> 937057 T1576 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 937057 T1602 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 937058 T1601 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 937061 T1601 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"recovering",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node1/solr/"}
   [junit4]   2> 937061 T1601 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
   [junit4]   2> 937063 T1604 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 937064 T1591 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 937064 T1590 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 937116 T1604 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 937116 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 937122 T1576 oasc.LeaderElector.checkIfIamLeader WARN Failed setting watch org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections/collection1/leader_elect/shard1/election/92334267892236291-node1_core1-n_0000000001
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:307)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:304)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:304)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:148)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:314)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:221)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:157)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:662)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:606)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 937123 T1605 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 937123 T1601 oasc.SolrException.log ERROR Problem cleaning up collection in zk:collection1:org.apache.zookeeper.KeeperException$NotEmptyException: KeeperErrorCode = Directory not empty for /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:125)
   [junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 		at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:189)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:186)
   [junit4]   2> 		at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:186)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.clean(SolrZkClient.java:670)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.clean(SolrZkClient.java:665)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.clean(SolrZkClient.java:665)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.clean(SolrZkClient.java:665)
   [junit4]   2> 		at org.apache.solr.cloud.Overseer$ClusterStateUpdater.removeCore(Overseer.java:1104)
   [junit4]   2> 		at org.apache.solr.cloud.Overseer$ClusterStateUpdater.processMessage(Overseer.java:362)
   [junit4]   2> 		at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:244)
   [junit4]   2> 		at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 	
   [junit4]   2> 937122 T1590 oasc.LeaderElector.checkIfIamLeader WARN Our node is no longer in line to be leader
   [junit4]   2> 937124 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 937128 T1604 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 937129 T1601 oasc.Overseer$ClusterStateUpdater.setShardLeader ERROR Could not mark shard leader for non existing collection:collection1
   [junit4]   2> 937232 T1591 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 937232 T1605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 938127 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 939130 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 940133 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 941136 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 942139 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 943142 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 944145 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 945148 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 946151 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 947154 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 948157 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 949160 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 950163 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 951166 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 952169 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 953673 T1605 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 953677 T1576 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:51907 51907
   [junit4]   2> 953820 T1577 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:51907 51907
   [junit4]   2> 953821 T1576 oas.SolrTestCaseJ4.tearDown ###Ending testOverseerFailure
   [junit4]   2> 953822 T1576 oasc.Overseer.close Overseer (id=92334267892236293-127.0.0.1:51907_solr-n_0000000001) closing
   [junit4]   2> 953822 T1601 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:51907_solr
   [junit4]   2> 953824 T1606 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:307)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:304)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:304)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:320)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:89)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:292)
   [junit4]   2> 
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=OverseerTest -Dtests.method=testOverseerFailure -Dtests.seed=2BFAD87E5C912CA4 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar_BH -Dtests.timezone=Asia/Phnom_Penh -Dtests.file.encoding=UTF-8
   [junit4] ERROR   19.6s J1 | OverseerTest.testOverseerFailure <<<
   [junit4]    > Throwable #1: org.apache.solr.common.SolrException: Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([2BFAD87E5C912CA4:2FF2578D4E34C385]:0)
   [junit4]    > 	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:150)
   [junit4]    > 	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:163)
   [junit4]    > 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:125)
   [junit4]    > 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:155)
   [junit4]    > 	at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:314)
   [junit4]    > 	at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:221)
   [junit4]    > 	at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:157)
   [junit4]    > 	at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:662)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]    > Caused by: org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
   [junit4]    > 	at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:40)
   [junit4]    > 	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:137)
   [junit4]    > 	... 48 more
   [junit4]    > Caused by: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
   [junit4]    > 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
   [junit4]    > 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]    > 	at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
   [junit4]    > 	at org.apache.solr.common.cloud.SolrZkClient$11.execute(SolrZkClient.java:462)
   [junit4]    > 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
   [junit4]    > 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:459)
   [junit4]    > 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:416)
   [junit4]    > 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:403)
   [junit4]    > 	at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:142)
   [junit4]    > 	at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:34)
   [junit4]    > 	... 49 more
   [junit4]   2> 953849 T1576 oas.SolrTestCaseJ4.setUp ###Starting testShardLeaderChange
   [junit4]   2> 953851 T1576 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 953851 T1607 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 953951 T1576 oasc.ZkTestServer.run start zk server on port:56974
   [junit4]   2> 953952 T1576 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 953955 T1613 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2067eca1 name:ZooKeeperConnection Watcher:127.0.0.1:56974/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 953955 T1576 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 953956 T1576 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 953958 T1615 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@257798ac name:ZooKeeperConnection Watcher:127.0.0.1:56974 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 953958 T1576 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 953960 T1576 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 953961 T1617 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@33c1ded1 name:ZooKeeperConnection Watcher:127.0.0.1:56974 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 953962 T1576 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 953962 T1576 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 953965 T1576 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 953968 T1618 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 953969 T1576 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 953970 T1621 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@462c3237 name:ZooKeeperConnection Watcher:127.0.0.1:56974/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 953970 T1618 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 953970 T1622 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7f94dcde name:ZooKeeperConnection Watcher:127.0.0.1:56974/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 953970 T1618 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: retry=false
   [junit4]   2> 953970 T1576 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 953972 T1576 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 953974 T1576 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 953974 T1618 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 953975 T1576 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 953976 T1618 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 953977 T1576 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
   [junit4]   2> 953977 T1618 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 953979 T1618 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:56974_solr
   [junit4]   2> 953980 T1618 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 953980 T1576 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 953981 T1618 oasc.Overseer.start Overseer (id=92334269174448131-127.0.0.1:56974_solr-n_0000000000) starting
   [junit4]   2> 953984 T1618 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 953986 T1618 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 953988 T1618 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 953990 T1618 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 953993 T1618 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 953997 T1618 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 953997 T1625 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 953997 T1618 oasc.OverseerTest$OverseerRestarter.run Killing overseer.
   [junit4]   2> 953999 T1618 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 954000 T1628 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@21d3e28 name:ZooKeeperConnection Watcher:127.0.0.1:56974/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 954000 T1618 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 954001 T1618 oasc.Overseer.close Overseer (id=92334269174448131-127.0.0.1:56974_solr-n_0000000000) closing
   [junit4]   2> 954001 T1625 oasc.OverseerCollectionProcessor.run ERROR Unable to prioritize overseer  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /roles.json
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:256)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:253)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:253)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerCollectionProcessor.prioritizeOverseerNodes(OverseerCollectionProcessor.java:412)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:259)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 954001 T1618 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: retry=false
   [junit4]   2> 954006 T1618 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 954008 T1618 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:56974_solr
   [junit4]   2> 954008 T1618 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 954010 T1618 oasc.Overseer.start Overseer (id=92334269174448133-127.0.0.1:56974_solr-n_0000000001) starting
   [junit4]   2> 954017 T1618 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 954018 T1630 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 954019 T1629 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 954021 T1629 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"state1",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "core_node_name":"node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node1/solr/"}
   [junit4]   2> 954021 T1629 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1]
   [junit4]   2> 954022 T1629 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 954024 T1632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 954024 T1623 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 954483 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 954491 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 954495 T1632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 954496 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 954499 T1629 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"state2",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "core_node_name":"node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node1/solr/"}
   [junit4]   2> 954500 T1629 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
   [junit4]   2> 954502 T1576 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 954502 T1632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 954503 T1634 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@649c4933 name:ZooKeeperConnection Watcher:127.0.0.1:56974/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 954503 T1623 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 954503 T1576 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 954505 T1576 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 954507 T1576 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
   [junit4]   2> 954511 T1632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 954511 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 954513 T1629 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"state1",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "core_node_name":"node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node1/solr/"}
   [junit4]   2> 954513 T1629 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
   [junit4]   2> 954518 T1632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 954519 T1629 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"state2",
   [junit4]   2> 	  "node_name":"node2",
   [junit4]   2> 	  "core":"core4",
   [junit4]   2> 	  "core_node_name":"node2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node2/solr/"}
   [junit4]   2> 954519 T1629 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
   [junit4]   2> 954519 T1629 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 954622 T1635 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 954622 T1623 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 955018 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 955025 T1636 oasc.LeaderElector$ElectionWatcher.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:290)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:287)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:287)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:209)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 955026 T1635 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 955030 T1632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 955135 T1635 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 956525 T1623 oasc.LeaderElector$ElectionWatcher.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:290)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:287)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:287)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:209)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 956528 T1576 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 956530 T1638 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b8594e7 name:ZooKeeperConnection Watcher:127.0.0.1:56974/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 956530 T1576 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 956532 T1576 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 956534 T1576 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
   [junit4]   2> 956537 T1632 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 956537 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 956539 T1629 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"state1",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "core_node_name":"node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node1/solr/"}
   [junit4]   2> 956539 T1629 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
   [junit4]   2> 956542 T1618 oasc.OverseerTest$OverseerRestarter.run Killing overseer.
   [junit4]   2> 956544 T1608 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x148098752bd0005, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 956544 T1618 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 956545 T1639 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 956546 T1641 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1bc7fae5 name:ZooKeeperConnection Watcher:127.0.0.1:56974/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 956546 T1618 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 956546 T1618 oasc.Overseer.close Overseer (id=92334269174448133-127.0.0.1:56974_solr-n_0000000001) closing
   [junit4]   2> 956547 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 956547 T1618 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: retry=false
   [junit4]   2> 956547 T1629 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:56974_solr
   [junit4]   2> 956548 T1642 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:307)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:304)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:304)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:320)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:89)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:292)
   [junit4]   2> 
   [junit4]   2> 956552 T1618 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 956553 T1618 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:56974_solr
   [junit4]   2> 956553 T1576 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 956554 T1618 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 956555 T1644 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1029cad3 name:ZooKeeperConnection Watcher:127.0.0.1:56974/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 956555 T1576 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 956556 T1618 oasc.Overseer.start Overseer (id=92334269174448136-127.0.0.1:56974_solr-n_0000000002) starting
   [junit4]   2> 956556 T1576 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 956559 T1576 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
   [junit4]   2> 956562 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 956565 T1618 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 956566 T1647 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 956568 T1646 oasc.Overseer$ClusterStateUpdater.run Replaying operations from work queue.
   [junit4]   2> 956569 T1646 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"state1",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "core_node_name":"node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node1/solr/"}
   [junit4]   2> 956569 T1646 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
   [junit4]   2> 956570 T1645 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 956570 T1639 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 956572 T1646 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 956574 T1646 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"state2",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "core_node_name":"node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node1/solr/"}
   [junit4]   2> 956574 T1646 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
   [junit4]   2> 956576 T1649 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 956579 T1646 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"state1",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "core_node_name":"node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node1/solr/"}
   [junit4]   2> 956580 T1646 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
   [junit4]   2> 956582 T1649 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 956582 T1639 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 956582 T1645 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 956771 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 956771 T1649 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 956773 T1646 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"state2",
   [junit4]   2> 	  "node_name":"node2",
   [junit4]   2> 	  "core":"core4",
   [junit4]   2> 	  "core_node_name":"node2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node2/solr/"}
   [junit4]   2> 956774 T1646 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
   [junit4]   2> 956778 T1650 oasc.LeaderElector$ElectionWatcher.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:290)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:287)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:287)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:209)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 956778 T1645 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 956782 T1649 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 956886 T1645 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 958277 T1639 oasc.LeaderElector$ElectionWatcher.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:290)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:287)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:287)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:209)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 958280 T1576 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 958282 T1652 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e7be58e name:ZooKeeperConnection Watcher:127.0.0.1:56974/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 958282 T1576 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 958282 T1618 oasc.OverseerTest$OverseerRestarter.run Killing overseer.
   [junit4]   2> 958284 T1576 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 958285 T1618 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 958286 T1654 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1663d25b name:ZooKeeperConnection Watcher:127.0.0.1:56974/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 958286 T1618 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 958286 T1618 oasc.Overseer.close Overseer (id=92334269174448136-127.0.0.1:56974_solr-n_0000000002) closing
   [junit4]   2> 958287 T1646 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:56974_solr
   [junit4]   2> 958287 T1618 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: retry=false
   [junit4]   2> 958288 T1655 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:307)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:304)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:304)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:320)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:89)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:292)
   [junit4]   2> 
   [junit4]   2> 958288 T1576 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
   [junit4]   2> 958292 T1618 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 958293 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 958293 T1618 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:56974_solr
   [junit4]   2> 958293 T1618 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 958295 T1618 oasc.Overseer.start Overseer (id=92334269174448139-127.0.0.1:56974_solr-n_0000000003) starting
   [junit4]   2> 958300 T1656 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 958300 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 958304 T1618 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 958305 T1658 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 958305 T1657 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 958306 T1576 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 958307 T1661 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@36114410 name:ZooKeeperConnection Watcher:127.0.0.1:56974/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 958307 T1576 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 958309 T1576 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 958309 T1657 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"state1",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "core_node_name":"node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node1/solr/"}
   [junit4]   2> 958309 T1657 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
   [junit4]   2> 958311 T1576 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
   [junit4]   2> 958311 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 958312 T1656 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 958312 T1663 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 958315 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 958316 T1657 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"state2",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "core_node_name":"node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node1/solr/"}
   [junit4]   2> 958316 T1657 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
   [junit4]   2> 958318 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 958322 T1657 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"state1",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "core_node_name":"node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node1/solr/"}
   [junit4]   2> 958322 T1657 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
   [junit4]   2> 958324 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 958325 T1665 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 958325 T1664 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 958524 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 958524 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 958526 T1657 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"state2",
   [junit4]   2> 	  "node_name":"node2",
   [junit4]   2> 	  "core":"core4",
   [junit4]   2> 	  "core_node_name":"node2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node2/solr/"}
   [junit4]   2> 958526 T1657 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
   [junit4]   2> 958531 T1665 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 958535 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 958639 T1665 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 960030 T1656 oasc.LeaderElector$ElectionWatcher.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:290)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:287)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:287)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:209)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 960030 T1664 oasc.LeaderElector$ElectionWatcher.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:290)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:287)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:287)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:209)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 960034 T1576 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 960036 T1667 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@282cb5a1 name:ZooKeeperConnection Watcher:127.0.0.1:56974/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 960036 T1576 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 960038 T1576 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 960040 T1576 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
   [junit4]   2> 960044 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 960044 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 960045 T1657 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"state1",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "core_node_name":"node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node1/solr/"}
   [junit4]   2> 960046 T1657 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
   [junit4]   2> 960050 T1668 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 960051 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 960051 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 960052 T1657 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"state2",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "core_node_name":"node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node1/solr/"}
   [junit4]   2> 960052 T1657 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
   [junit4]   2> 960057 T1576 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 960057 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 960058 T1670 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6ee2d3da name:ZooKeeperConnection Watcher:127.0.0.1:56974/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 960058 T1668 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 960058 T1576 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 960060 T1576 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 960062 T1576 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
   [junit4]   2> 960065 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 960065 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 960067 T1657 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"state1",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "core_node_name":"node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node1/solr/"}
   [junit4]   2> 960067 T1657 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
   [junit4]   2> 960072 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 960072 T1576 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 960073 T1657 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"state2",
   [junit4]   2> 	  "node_name":"node2",
   [junit4]   2> 	  "core":"core4",
   [junit4]   2> 	  "core_node_name":"node2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node2/solr/"}
   [junit4]   2> 960073 T1657 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
   [junit4]   2> 960079 T1672 oasc.LeaderElector$ElectionWatcher.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:290)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:287)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:287)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:209)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 960080 T1671 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 960084 T1662 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 960122 T1618 oasc.OverseerTest$OverseerRestarter.run Killing overseer.
   [junit4]   2> 960124 T1618 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 960125 T1674 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@60246025 name:ZooKeeperConnection Watcher:127.0.0.1:56974/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 960126 T1618 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 960126 T1618 oasc.Overseer.close Overseer (id=92334269174448139-127.0.0.1:56974_solr-n_0000000003) closing
   [junit4]   2> 960126 T1657 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:56974_solr
   [junit4]   2> 960127 T1618 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: retry=false
   [junit4]   2> 960127 T1675 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:307)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:304)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:304)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:320)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:89)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:292)
   [junit4]   2> 
   [junit4]   2> 960131 T1618 oasc.Ove

[...truncated too long message...]

2)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 1018511 T2186 oasc.LeaderElector$ElectionWatcher.process WARN  java.lang.RuntimeException: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer
   [junit4]   2> 	at org.apache.solr.cloud.Overseer.createOverseerNode(Overseer.java:1342)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer.getInQueue(Overseer.java:1293)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer.getInQueue(Overseer.java:1289)
   [junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:161)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:163)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:125)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:209)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:342)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:339)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:339)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer.createOverseerNode(Overseer.java:1333)
   [junit4]   2> 	... 13 more
   [junit4]   2> 
   [junit4]   2> 1018513 T2325 oasc.LeaderElector$ElectionWatcher.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:290)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:287)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:287)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:209)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 1020013 T2189 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 1020016 T1576 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:44960 44960
   [junit4]   2> 1020178 T1927 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:44960 44960
   [junit4]   2> 1020180 T1576 oas.SolrTestCaseJ4.tearDown ###Ending testShardAssignmentBigger
   [junit4]   2> 1020181 T1576 oasc.Overseer.close Overseer (id=92334271354896387-127.0.0.1:44960_solr-n_0000000000) closing
   [junit4]   2> 1020181 T1940 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:44960_solr
   [junit4]   2> 1020182 T2336 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:307)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:304)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:304)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:320)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:89)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:292)
   [junit4]   2> 
   [junit4]   2> 1023183 T1576 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./temp/solr.cloud.OverseerTest-2BFAD87E5C912CA4-001
   [junit4]   2> NOTE: test params are: codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY, chunkSize=348), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, chunkSize=348)), sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=ar_BH, timezone=Asia/Phnom_Penh
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_60 (64-bit)/cpus=16,threads=1,free=304980552,total=490733568
   [junit4]   2> NOTE: All tests run in this JVM: [PeerSyncTest, TestTolerantSearch, DistributedTermsComponentTest, TestFastWriter, OpenExchangeRatesOrgProviderTest, TestGroupingSearch, TestIntervalFaceting, TestCustomSort, IndexSchemaTest, TestSolrIndexConfig, DisMaxRequestHandlerTest, TestLRUCache, AnalysisAfterCoreReloadTest, HdfsBasicDistributedZkTest, HardAutoCommitTest, ZkControllerTest, ShardRoutingCustomTest, TestIBSimilarityFactory, DocumentAnalysisRequestHandlerTest, TestStressUserVersions, OverseerCollectionProcessorTest, FileUtilsTest, TestCloudManagedSchemaConcurrent, StatsComponentTest, DistributedFacetPivotLongTailTest, SuggesterWFSTTest, WordBreakSolrSpellCheckerTest, TestCSVResponseWriter, RequiredFieldsTest, TestConfig, TestCloudManagedSchema, MBeansHandlerTest, TestUniqueKeyFieldResource, TestSolrXml, UnloadDistributedZkTest, CoreContainerCoreInitFailuresTest, TestSolr4Spatial, TestIndexingPerformance, TestExpandComponent, AssignTest, TestReversedWildcardFilterFactory, FieldMutatingUpdateProcessorTest, TestCoreDiscovery, TestOmitPositions, SpatialFilterTest, TestJmxMonitoredMap, LeaderElectionIntegrationTest, TestDefaultSearchFieldResource, OverseerTest]
   [junit4] Completed on J1 in 88.94s, 9 tests, 1 error <<< FAILURES!

[...truncated 1158 lines...]
BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:485: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:465: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:48: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:494: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1343: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:958: There were test failures: 419 suites, 1734 tests, 1 error, 55 ignored (21 assumptions)

Total time: 118 minutes 56 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-Tests-4.x-Java7 #2065
Archived 3 artifacts
Archive block size is 32768
Received 0 blocks and 180949961 bytes
Compression is 0.0%
Took 32 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 2071 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/2071/

All tests passed

Build Log:
[...truncated 47258 lines...]
-documentation-lint:
     [echo] checking for broken html...
    [jtidy] Checking for broken html (such as invalid tags)...
   [delete] Deleting directory /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/build/jtidy_tmp
     [echo] Checking for broken links...
     [exec] 
     [exec] Crawl/parse...
     [exec] 
     [exec] Verify...
     [echo] Checking for missing docs...
     [exec] 
     [exec] build/docs/suggest/org/apache/lucene/search/suggest/analyzing/AnalyzingInfixSuggester.html
     [exec]   missing Methods: commit()
     [exec] 
     [exec] Missing javadocs were found!

BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:485: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:66: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/build.xml:212: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/build.xml:257: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:2419: exec returned: 1

Total time: 172 minutes 25 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-Tests-4.x-Java7 #2065
Archived 1 artifacts
Archive block size is 32768
Received 0 blocks and 464 bytes
Compression is 0.0%
Took 9 ms
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 2070 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/2070/

2 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.handler.TestReplicationHandlerBackup

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.handler.TestReplicationHandlerBackup:     1) Thread[id=5162, name=Thread-1508, state=RUNNABLE, group=TGRP-TestReplicationHandlerBackup]         at java.net.PlainSocketImpl.socketConnect(Native Method)         at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)         at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)         at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)         at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)         at java.net.Socket.connect(Socket.java:579)         at java.net.Socket.connect(Socket.java:528)         at sun.net.NetworkClient.doConnect(NetworkClient.java:180)         at sun.net.www.http.HttpClient.openServer(HttpClient.java:432)         at sun.net.www.http.HttpClient.openServer(HttpClient.java:527)         at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:652)         at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1323)         at java.net.URL.openStream(URL.java:1037)         at org.apache.solr.handler.TestReplicationHandlerBackup$BackupThread.run(TestReplicationHandlerBackup.java:313)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.handler.TestReplicationHandlerBackup: 
   1) Thread[id=5162, name=Thread-1508, state=RUNNABLE, group=TGRP-TestReplicationHandlerBackup]
        at java.net.PlainSocketImpl.socketConnect(Native Method)
        at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
        at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
        at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
        at java.net.Socket.connect(Socket.java:579)
        at java.net.Socket.connect(Socket.java:528)
        at sun.net.NetworkClient.doConnect(NetworkClient.java:180)
        at sun.net.www.http.HttpClient.openServer(HttpClient.java:432)
        at sun.net.www.http.HttpClient.openServer(HttpClient.java:527)
        at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:652)
        at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1323)
        at java.net.URL.openStream(URL.java:1037)
        at org.apache.solr.handler.TestReplicationHandlerBackup$BackupThread.run(TestReplicationHandlerBackup.java:313)
	at __randomizedtesting.SeedInfo.seed([7DD12FBA3D9760E9]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.handler.TestReplicationHandlerBackup

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=5162, name=Thread-1508, state=RUNNABLE, group=TGRP-TestReplicationHandlerBackup]         at java.net.PlainSocketImpl.socketConnect(Native Method)         at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)         at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)         at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)         at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)         at java.net.Socket.connect(Socket.java:579)         at java.net.Socket.connect(Socket.java:528)         at sun.net.NetworkClient.doConnect(NetworkClient.java:180)         at sun.net.www.http.HttpClient.openServer(HttpClient.java:432)         at sun.net.www.http.HttpClient.openServer(HttpClient.java:527)         at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:652)         at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1323)         at java.net.URL.openStream(URL.java:1037)         at org.apache.solr.handler.TestReplicationHandlerBackup$BackupThread.run(TestReplicationHandlerBackup.java:313)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=5162, name=Thread-1508, state=RUNNABLE, group=TGRP-TestReplicationHandlerBackup]
        at java.net.PlainSocketImpl.socketConnect(Native Method)
        at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
        at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
        at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
        at java.net.Socket.connect(Socket.java:579)
        at java.net.Socket.connect(Socket.java:528)
        at sun.net.NetworkClient.doConnect(NetworkClient.java:180)
        at sun.net.www.http.HttpClient.openServer(HttpClient.java:432)
        at sun.net.www.http.HttpClient.openServer(HttpClient.java:527)
        at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:652)
        at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1323)
        at java.net.URL.openStream(URL.java:1037)
        at org.apache.solr.handler.TestReplicationHandlerBackup$BackupThread.run(TestReplicationHandlerBackup.java:313)
	at __randomizedtesting.SeedInfo.seed([7DD12FBA3D9760E9]:0)




Build Log:
[...truncated 10995 lines...]
   [junit4] Suite: org.apache.solr.handler.TestReplicationHandlerBackup
   [junit4]   2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.handler.TestReplicationHandlerBackup-7DD12FBA3D9760E9-001/init-core-data-001
   [junit4]   2> 735593 T5142 oas.SolrTestCaseJ4.setUp ###Starting doTestBackup
   [junit4]   2> 735605 T5142 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 735608 T5142 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:27722
   [junit4]   2> 735609 T5142 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 735609 T5142 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 735609 T5142 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.handler.TestReplicationHandlerBackup-7DD12FBA3D9760E9-001/solr-instance-001
   [junit4]   2> 735610 T5142 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.handler.TestReplicationHandlerBackup-7DD12FBA3D9760E9-001/solr-instance-001/'
   [junit4]   2> 735642 T5142 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.handler.TestReplicationHandlerBackup-7DD12FBA3D9760E9-001/solr-instance-001/solr.xml
   [junit4]   2> 735714 T5142 oasc.CoreContainer.<init> New CoreContainer 308624725
   [junit4]   2> 735715 T5142 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.handler.TestReplicationHandlerBackup-7DD12FBA3D9760E9-001/solr-instance-001/]
   [junit4]   2> 735716 T5142 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 735716 T5142 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 735716 T5142 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 735716 T5142 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 735717 T5142 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 735717 T5142 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 735717 T5142 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 735717 T5142 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 735717 T5142 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 735718 T5142 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 735718 T5142 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 735719 T5142 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 735719 T5142 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 735723 T5152 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.handler.TestReplicationHandlerBackup-7DD12FBA3D9760E9-001/solr-instance-001/collection1/'
   [junit4]   2> 735760 T5152 oasc.SolrConfig.<init> Using Lucene MatchVersion: 4.11.0
   [junit4]   2> 735793 T5152 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 735794 T5152 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 735799 T5152 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 735813 T5152 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 735814 T5152 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir ./solr.handler.TestReplicationHandlerBackup-7DD12FBA3D9760E9-001/solr-instance-001/collection1/
   [junit4]   2> 735814 T5152 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 735814 T5152 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.handler.TestReplicationHandlerBackup-7DD12FBA3D9760E9-001/solr-instance-001/collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.handler.TestReplicationHandlerBackup-7DD12FBA3D9760E9-001/solr-instance-001/collection1/data/
   [junit4]   2> 735815 T5152 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 735815 T5152 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.handler.TestReplicationHandlerBackup-7DD12FBA3D9760E9-001/solr-instance-001/collection1/data
   [junit4]   2> 735815 T5152 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.handler.TestReplicationHandlerBackup-7DD12FBA3D9760E9-001/solr-instance-001/collection1/data/index/
   [junit4]   2> 735815 T5152 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.handler.TestReplicationHandlerBackup-7DD12FBA3D9760E9-001/solr-instance-001/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 735816 T5152 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.handler.TestReplicationHandlerBackup-7DD12FBA3D9760E9-001/solr-instance-001/collection1/data/index
   [junit4]   2> 735816 T5152 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=25, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4210399314544174]
   [junit4]   2> 735817 T5152 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@499efaef lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@70d5297f),segFN=segments_1,generation=1}
   [junit4]   2> 735817 T5152 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 735818 T5152 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 735819 T5152 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 735819 T5152 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 735819 T5152 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 735820 T5152 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 735820 T5152 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 735820 T5152 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 735820 T5152 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
   [junit4]   2> 735820 T5152 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
   [junit4]   2> 735820 T5152 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
   [junit4]   2> 735821 T5152 oasc.RequestHandlers.initHandlersFromConfig WARN Multiple requestHandler registered to the same name: /update ignoring: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 735821 T5152 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 735833 T5152 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 735834 T5152 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 735836 T5152 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 735837 T5152 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 735838 T5152 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 735840 T5152 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 735840 T5152 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 735841 T5152 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=38, maxMergedSegmentMB=34.779296875, floorSegmentMB=1.5166015625, forceMergeDeletesPctAllowed=5.642644846724176, segmentsPerTier=34.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 735841 T5152 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@499efaef lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@70d5297f),segFN=segments_1,generation=1}
   [junit4]   2> 735841 T5152 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 735842 T5152 oass.SolrIndexSearcher.<init> Opening Searcher@59671c04[collection1] main
   [junit4]   2> 735842 T5152 oasr.ManagedResourceStorage$FileStorageIO.configure File-based storage initialized to use dir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.handler.TestReplicationHandlerBackup-7DD12FBA3D9760E9-001/solr-instance-001/collection1/conf
   [junit4]   2> 735842 T5152 oasr.RestManager.init Initializing RestManager with initArgs: {storageDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.handler.TestReplicationHandlerBackup-7DD12FBA3D9760E9-001/solr-instance-001/collection1/conf}
   [junit4]   2> 735843 T5152 oasr.ManagedResourceStorage.load Reading _rest_managed.json using file:dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.handler.TestReplicationHandlerBackup-7DD12FBA3D9760E9-001/solr-instance-001/collection1/conf
   [junit4]   2> 735843 T5152 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
   [junit4]   2> 735843 T5152 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using file:dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.handler.TestReplicationHandlerBackup-7DD12FBA3D9760E9-001/solr-instance-001/collection1/conf
   [junit4]   2> 735844 T5152 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 735844 T5152 oash.ReplicationHandler.inform Replication enabled for following config files: schema-replication2.xml:schema.xml
   [junit4]   2> 735844 T5152 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 735844 T5152 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 735844 T5153 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@59671c04[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 735845 T5142 oass.SolrDispatchFilter.init user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1
   [junit4]   2> 735845 T5142 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> ASYNC  NEW_CORE C606 name=collection1 org.apache.solr.core.SolrCore@1c7c4367
   [junit4]   2> 735848 T5145 C606 oasu.DirectUpdateHandler2.deleteAll [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 735849 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {deleteByQuery=*:*} 0 2
   [junit4]   2> 735853 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[0]} 0 1
   [junit4]   2> 735856 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[1]} 0 0
   [junit4]   2> 735859 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[2]} 0 0
   [junit4]   2> 735862 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[3]} 0 0
   [junit4]   2> 735865 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[4]} 0 0
   [junit4]   2> 735868 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[5]} 0 0
   [junit4]   2> 735871 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[6]} 0 0
   [junit4]   2> 735874 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[7]} 0 0
   [junit4]   2> 735877 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[8]} 0 0
   [junit4]   2> 735880 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[9]} 0 0
   [junit4]   2> 735883 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[10]} 0 0
   [junit4]   2> 735886 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[11]} 0 0
   [junit4]   2> 735889 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[12]} 0 0
   [junit4]   2> 735892 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[13]} 0 0
   [junit4]   2> 735895 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[14]} 0 0
   [junit4]   2> 735898 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[15]} 0 0
   [junit4]   2> 735901 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[16]} 0 0
   [junit4]   2> 735904 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[17]} 0 0
   [junit4]   2> 735907 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[18]} 0 0
   [junit4]   2> 735910 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[19]} 0 0
   [junit4]   2> 735913 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[20]} 0 0
   [junit4]   2> 735916 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[21]} 0 0
   [junit4]   2> 735919 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[22]} 0 0
   [junit4]   2> 735922 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[23]} 0 0
   [junit4]   2> 735925 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[24]} 0 0
   [junit4]   2> 735928 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[25]} 0 0
   [junit4]   2> 735931 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[26]} 0 0
   [junit4]   2> 735934 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[27]} 0 0
   [junit4]   2> 735937 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[28]} 0 0
   [junit4]   2> 735940 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[29]} 0 0
   [junit4]   2> 735943 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[30]} 0 0
   [junit4]   2> 735946 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[31]} 0 0
   [junit4]   2> 735949 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[32]} 0 0
   [junit4]   2> 735952 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[33]} 0 0
   [junit4]   2> 735955 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[34]} 0 0
   [junit4]   2> 735958 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[35]} 0 0
   [junit4]   2> 735960 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[36]} 0 0
   [junit4]   2> 735963 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[37]} 0 0
   [junit4]   2> 735966 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[38]} 0 0
   [junit4]   2> 735969 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[39]} 0 0
   [junit4]   2> 735972 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[40]} 0 0
   [junit4]   2> 735973 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[41]} 0 0
   [junit4]   2> 735975 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[42]} 0 0
   [junit4]   2> 735978 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[43]} 0 0
   [junit4]   2> 735981 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[44]} 0 0
   [junit4]   2> 735984 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[45]} 0 0
   [junit4]   2> 735987 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[46]} 0 0
   [junit4]   2> 735989 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[47]} 0 0
   [junit4]   2> 735992 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[48]} 0 0
   [junit4]   2> 735995 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[49]} 0 0
   [junit4]   2> 735998 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[50]} 0 0
   [junit4]   2> 736001 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[51]} 0 0
   [junit4]   2> 736004 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[52]} 0 0
   [junit4]   2> 736007 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[53]} 0 0
   [junit4]   2> 736010 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[54]} 0 0
   [junit4]   2> 736013 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[55]} 0 0
   [junit4]   2> 736016 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[56]} 0 0
   [junit4]   2> 736019 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[57]} 0 0
   [junit4]   2> 736022 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[58]} 0 0
   [junit4]   2> 736025 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[59]} 0 0
   [junit4]   2> 736028 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[60]} 0 0
   [junit4]   2> 736030 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[61]} 0 0
   [junit4]   2> 736032 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[62]} 0 0
   [junit4]   2> 736035 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[63]} 0 0
   [junit4]   2> 736038 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[64]} 0 0
   [junit4]   2> 736041 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[65]} 0 0
   [junit4]   2> 736044 T5145 C606 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 736047 T5145 C606 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@499efaef lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@70d5297f),segFN=segments_1,generation=1}
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@499efaef lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@70d5297f),segFN=segments_2,generation=2}
   [junit4]   2> 736048 T5145 C606 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
   [junit4]   2> 736049 T5145 C606 oass.SolrIndexSearcher.<init> Opening Searcher@2e9ef9e2[collection1] main
   [junit4]   2> 736050 T5145 C606 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 736050 T5153 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2e9ef9e2[collection1] main{StandardDirectoryReader(segments_2:4:nrt _0(4.11.0):c66)}
   [junit4]   2> 736050 T5145 C606 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={waitSearcher=true&softCommit=false&wt=javabin&commit=true&version=2} {commit=} 0 6
   [junit4]   2> 736054 T5147 C606 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details} status=0 QTime=0 
   [junit4]   2> 736073 T5146 C606 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=backup&name=qfgnxycnvyexffkpmjqp} status=0 QTime=19 
   [junit4]   2> 736073 T5157 oash.SnapShooter.createSnapshot Creating backup snapshot...
   [junit4]   2> 736082 T5157 oash.SnapShooter.createSnapshot Done creating backup snapshot, completed at: Sat Aug 23 17:14:31 IST 2014
   [junit4]   2> 736083 T5157 oash.SnapShooter.createSnapshot Done creating backup snapshot: qfgnxycnvyexffkpmjqp
   [junit4]   2> 736265 T5146 C606 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details} status=0 QTime=0 
   [junit4]   2> 737280 T5147 C606 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details} status=0 QTime=0 
   [junit4]   2> 737281 T5146 C606 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=backup&name=xby} status=0 QTime=1 
   [junit4]   2> 737281 T5159 oash.SnapShooter.createSnapshot Creating backup snapshot...
   [junit4]   2> 737289 T5159 oash.SnapShooter.createSnapshot Done creating backup snapshot, completed at: Sat Aug 23 17:14:33 IST 2014
   [junit4]   2> 737290 T5159 oash.SnapShooter.createSnapshot Done creating backup snapshot: xby
   [junit4]   2> 737482 T5146 C606 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details} status=0 QTime=0 
   [junit4]   2> 737489 T5147 C606 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details} status=0 QTime=0 
   [junit4]   2> 737493 T5146 C606 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=deletebackup&name=qfgnxycnvyexffkpmjqp} status=0 QTime=6 
   [junit4]   2> 737494 T5161 oash.SnapShooter.deleteNamedSnapshot Deleting snapshot: qfgnxycnvyexffkpmjqp
   [junit4]   2> 737691 T5146 C606 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details} status=0 QTime=0 
   [junit4]   2> 737694 T5146 C606 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=details} status=0 QTime=0 
   [junit4]   2> 737695 T5142 oas.SolrTestCaseJ4.tearDown ###Ending doTestBackup
   [junit4]   2> 737695 T5163 oash.SnapShooter.deleteNamedSnapshot Deleting snapshot: xby
   [junit4]   2> 737695 T5147 C606 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={command=deletebackup&name=xby} status=0 QTime=1 
   [junit4]   2> 737696 T5142 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=308624725
   [junit4]   2> 737698 T5142 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
   [junit4]   2> 737698 T5147 C606 oasc.SolrException.log ERROR null:org.eclipse.jetty.io.EofException
   [junit4]   2> 		at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:142)
   [junit4]   2> 		at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:107)
   [junit4]   2> 		at sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:221)
   [junit4]   2> 		at sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:291)
   [junit4]   2> 		at sun.nio.cs.StreamEncoder.implFlush(StreamEncoder.java:295)
   [junit4]   2> 		at sun.nio.cs.StreamEncoder.flush(StreamEncoder.java:141)
   [junit4]   2> 		at java.io.OutputStreamWriter.flush(OutputStreamWriter.java:229)
   [junit4]   2> 		at org.apache.solr.util.FastWriter.flush(FastWriter.java:137)
   [junit4]   2> 		at org.apache.solr.servlet.SolrDispatchFilter.writeResponse(SolrDispatchFilter.java:766)
   [junit4]   2> 		at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:426)
   [junit4]   2> 		at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:207)
   [junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
   [junit4]   2> 		at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:137)
   [junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
   [junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
   [junit4]   2> 		at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
   [junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
   [junit4]   2> 		at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
   [junit4]   2> 		at org.eclipse.jetty.server.Server.handle(Server.java:368)
   [junit4]   2> 		at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
   [junit4]   2> 		at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
   [junit4]   2> 		at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942)
   [junit4]   2> 		at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004)
   [junit4]   2> 		at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640)
   [junit4]   2> 		at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
   [junit4]   2> 		at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
   [junit4]   2> 		at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
   [junit4]   2> 		at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
   [junit4]   2> 		at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
   [junit4]   2> 		at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 	
   [junit4]   2> 737701 T5147 C606 oasc.SolrException.log ERROR null:org.eclipse.jetty.io.EofException
   [junit4]   2> 		at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:142)
   [junit4]   2> 		at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:107)
   [junit4]   2> 		at sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:221)
   [junit4]   2> 		at sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:291)
   [junit4]   2> 		at sun.nio.cs.StreamEncoder.implFlush(StreamEncoder.java:295)
   [junit4]   2> 		at sun.nio.cs.StreamEncoder.flush(StreamEncoder.java:141)
   [junit4]   2> 		at java.io.OutputStreamWriter.flush(OutputStreamWriter.java:229)
   [junit4]   2> 		at org.apache.solr.util.FastWriter.flush(FastWriter.java:137)
   [junit4]   2> 		at org.apache.solr.servlet.SolrDispatchFilter.writeResponse(SolrDispatchFilter.java:766)
   [junit4]   2> 		at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:426)
   [junit4]   2> 		at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:207)
   [junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
   [junit4]   2> 		at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:137)
   [junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
   [junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
   [junit4]   2> 		at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
   [junit4]   2> 		at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
   [junit4]   2> 		at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
   [junit4]   2> 		at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
   [junit4]   2> 		at org.eclipse.jetty.server.Server.handle(Server.java:368)
   [junit4]   2> 		at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
   [junit4]   2> 		at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
   [junit4]   2> 		at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942)
   [junit4]   2> 		at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004)
   [junit4]   2> 		at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640)
   [junit4]   2> 		at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
   [junit4]   2> 		at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
   [junit4]   2> 		at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
   [junit4]   2> 		at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
   [junit4]   2> 		at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
   [junit4]   2> 		at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 	
   [junit4]   2> 737725 T5147 C606 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1c7c4367
   [junit4]   2> 737726 T5147 C606 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=66,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
   [junit4]   2> 737727 T5147 C606 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 737727 T5147 C606 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 737727 T5147 C606 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 737729 T5147 C606 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 737729 T5147 C606 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 737730 T5147 C606 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.handler.TestReplicationHandlerBackup-7DD12FBA3D9760E9-001/solr-instance-001/collection1/data [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.handler.TestReplicationHandlerBackup-7DD12FBA3D9760E9-001/solr-instance-001/collection1/data;done=false>>]
   [junit4]   2> 737730 T5147 C606 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.handler.TestReplicationHandlerBackup-7DD12FBA3D9760E9-001/solr-instance-001/collection1/data
   [junit4]   2> 737731 T5147 C606 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.handler.TestReplicationHandlerBackup-7DD12FBA3D9760E9-001/solr-instance-001/collection1/data/index [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.handler.TestReplicationHandlerBackup-7DD12FBA3D9760E9-001/solr-instance-001/collection1/data/index;done=false>>]
   [junit4]   2> 737731 T5147 C606 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.handler.TestReplicationHandlerBackup-7DD12FBA3D9760E9-001/solr-instance-001/collection1/data/index
   [junit4]   2> 742707 T5142 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 7126 T5141 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> 27273 T5141 ccr.ThreadLeakControl.checkThreadLeaks SEVERE 1 thread leaked from SUITE scope at org.apache.solr.handler.TestReplicationHandlerBackup: 
   [junit4]   2> 	   1) Thread[id=5162, name=Thread-1508, state=RUNNABLE, group=TGRP-TestReplicationHandlerBackup]
   [junit4]   2> 	        at java.net.PlainSocketImpl.socketConnect(Native Method)
   [junit4]   2> 	        at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
   [junit4]   2> 	        at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
   [junit4]   2> 	        at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
   [junit4]   2> 	        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
   [junit4]   2> 	        at java.net.Socket.connect(Socket.java:579)
   [junit4]   2> 	        at java.net.Socket.connect(Socket.java:528)
   [junit4]   2> 	        at sun.net.NetworkClient.doConnect(NetworkClient.java:180)
   [junit4]   2> 	        at sun.net.www.http.HttpClient.openServer(HttpClient.java:432)
   [junit4]   2> 	        at sun.net.www.http.HttpClient.openServer(HttpClient.java:527)
   [junit4]   2> 	        at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:652)
   [junit4]   2> 	        at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1323)
   [junit4]   2> 	        at java.net.URL.openStream(URL.java:1037)
   [junit4]   2> 	        at org.apache.solr.handler.TestReplicationHandlerBackup$BackupThread.run(TestReplicationHandlerBackup.java:313)
   [junit4]   2> 27273 T5141 ccr.ThreadLeakControl.tryToInterruptAll Starting to interrupt leaked threads:
   [junit4]   2> 	   1) Thread[id=5162, name=Thread-1508, state=RUNNABLE, group=TGRP-TestReplicationHandlerBackup]
   [junit4]   2> 30281 T5141 ccr.ThreadLeakControl.tryToInterruptAll SEVERE There are still zombie threads that couldn't be terminated:
   [junit4]   2> 	   1) Thread[id=5162, name=Thread-1508, state=RUNNABLE, group=TGRP-TestReplicationHandlerBackup]
   [junit4]   2> 	        at java.net.PlainSocketImpl.socketConnect(Native Method)
   [junit4]   2> 	        at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
   [junit4]   2> 	        at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
   [junit4]   2> 	        at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
   [junit4]   2> 	        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
   [junit4]   2> 	        at java.net.Socket.connect(Socket.java:579)
   [junit4]   2> 	        at java.net.Socket.connect(Socket.java:528)
   [junit4]   2> 	        at sun.net.NetworkClient.doConnect(NetworkClient.java:180)
   [junit4]   2> 	        at sun.net.www.http.HttpClient.openServer(HttpClient.java:432)
   [junit4]   2> 	        at sun.net.www.http.HttpClient.openServer(HttpClient.java:527)
   [junit4]   2> 	        at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:652)
   [junit4]   2> 	        at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1323)
   [junit4]   2> 	        at java.net.URL.openStream(URL.java:1037)
   [junit4]   2> 	        at org.apache.solr.handler.TestReplicationHandlerBackup$BackupThread.run(TestReplicationHandlerBackup.java:313)
   [junit4]   2> NOTE: test params are: codec=Lucene410: {name=MockVariableIntBlock(baseBlockSize=8), id=MockVariableIntBlock(baseBlockSize=8)}, docValues:{}, sim=DefaultSimilarity, locale=nl, timezone=Europe/Dublin
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_60 (64-bit)/cpus=16,threads=2,free=348331384,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [LukeRequestHandlerTest, SSLMigrationTest, EnumFieldTest, CursorPagingTest, TestMultiCoreConfBootstrap, TestRandomDVFaceting, MultiThreadedOCPTest, CacheHeaderTest, TestReplicationHandler, TestDocBasedVersionConstraints, TestFreeTextSuggestions, DistributedFacetPivotSmallTest, TestReloadAndDeleteDocs, PeerSyncTest, SOLR749Test, TestSuggestSpellingConverter, TestReplicationHandlerBackup]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestReplicationHandlerBackup -Dtests.seed=7DD12FBA3D9760E9 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=nl -Dtests.timezone=Europe/Dublin -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J1 | TestReplicationHandlerBackup (suite) <<<
   [junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.handler.TestReplicationHandlerBackup: 
   [junit4]    >    1) Thread[id=5162, name=Thread-1508, state=RUNNABLE, group=TGRP-TestReplicationHandlerBackup]
   [junit4]    >         at java.net.PlainSocketImpl.socketConnect(Native Method)
   [junit4]    >         at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
   [junit4]    >         at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
   [junit4]    >         at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
   [junit4]    >         at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
   [junit4]    >         at java.net.Socket.connect(Socket.java:579)
   [junit4]    >         at java.net.Socket.connect(Socket.java:528)
   [junit4]    >         at sun.net.NetworkClient.doConnect(NetworkClient.java:180)
   [junit4]    >         at sun.net.www.http.HttpClient.openServer(HttpClient.java:432)
   [junit4]    >         at sun.net.www.http.HttpClient.openServer(HttpClient.java:527)
   [junit4]    >         at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:652)
   [junit4]    >         at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1323)
   [junit4]    >         at java.net.URL.openStream(URL.java:1037)
   [junit4]    >         at org.apache.solr.handler.TestReplicationHandlerBackup$BackupThread.run(TestReplicationHandlerBackup.java:313)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([7DD12FBA3D9760E9]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=5162, name=Thread-1508, state=RUNNABLE, group=TGRP-TestReplicationHandlerBackup]
   [junit4]    >         at java.net.PlainSocketImpl.socketConnect(Native Method)
   [junit4]    >         at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
   [junit4]    >         at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
   [junit4]    >         at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
   [junit4]    >         at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
   [junit4]    >         at java.net.Socket.connect(Socket.java:579)
   [junit4]    >         at java.net.Socket.connect(Socket.java:528)
   [junit4]    >         at sun.net.NetworkClient.doConnect(NetworkClient.java:180)
   [junit4]    >         at sun.net.www.http.HttpClient.openServer(HttpClient.java:432)
   [junit4]    >         at sun.net.www.http.HttpClient.openServer(HttpClient.java:527)
   [junit4]    >         at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:652)
   [junit4]    >         at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1323)
   [junit4]    >         at java.net.URL.openStream(URL.java:1037)
   [junit4]    >         at org.apache.solr.handler.TestReplicationHandlerBackup$BackupThread.run(TestReplicationHandlerBackup.java:313)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([7DD12FBA3D9760E9]:0)
   [junit4] Completed on J1 in 30.35s, 1 test, 2 errors <<< FAILURES!

[...truncated 1134 lines...]
BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:485: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:465: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:48: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:494: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1343: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:958: There were test failures: 419 suites, 1733 tests, 2 suite-level errors, 1267 ignored (11 assumptions)

Total time: 99 minutes 50 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-Tests-4.x-Java7 #2065
Archived 3 artifacts
Archive block size is 32768
Received 0 blocks and 75421526 bytes
Compression is 0.0%
Took 14 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 2069 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/2069/

1 tests failed.
REGRESSION:  org.apache.solr.cloud.OverseerTest.testOverseerFailure

Error Message:
Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed

Stack Trace:
org.apache.solr.common.SolrException: Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
	at __randomizedtesting.SeedInfo.seed([A488D6E45BB4A02F:A080591749114F0E]:0)
	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:150)
	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:163)
	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:125)
	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:155)
	at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:314)
	at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:221)
	at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:157)
	at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:662)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
	at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:40)
	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:137)
	... 48 more
Caused by: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
	at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
	at org.apache.solr.common.cloud.SolrZkClient$11.execute(SolrZkClient.java:462)
	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:459)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:416)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:403)
	at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:142)
	at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:34)
	... 49 more




Build Log:
[...truncated 11086 lines...]
   [junit4] Suite: org.apache.solr.cloud.OverseerTest
   [junit4]   2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.cloud.OverseerTest-A488D6E45BB4A02F-001/init-core-data-001
   [junit4]   2> 398180 T2266 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (true)
   [junit4]   2> 398180 T2266 oas.SolrTestCaseJ4.initCore ####initCore
   [junit4]   2> 398180 T2266 oas.SolrTestCaseJ4.initCore ####initCore end
   [junit4]   2> 398184 T2266 oas.SolrTestCaseJ4.setUp ###Starting testShardAssignment
   [junit4]   2> 398185 T2266 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 398186 T2267 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 398285 T2266 oasc.ZkTestServer.run start zk server on port:30294
   [junit4]   2> 398287 T2266 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 398290 T2273 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4daa089c name:ZooKeeperConnection Watcher:127.0.0.1:30294 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 398291 T2266 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 398293 T2266 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 398295 T2275 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@23f844d9 name:ZooKeeperConnection Watcher:127.0.0.1:30294 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 398295 T2266 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 398295 T2266 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 398299 T2266 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 398300 T2277 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c6ea03f name:ZooKeeperConnection Watcher:127.0.0.1:30294/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 398300 T2266 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 398301 T2266 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 398303 T2266 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 398304 T2279 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5e9e73c2 name:ZooKeeperConnection Watcher:127.0.0.1:30294/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 398304 T2266 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 398305 T2266 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: retry=false
   [junit4]   2> 398306 T2266 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 398308 T2266 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 398310 T2266 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 398312 T2266 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:30294_solr
   [junit4]   2> 398312 T2266 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 398314 T2266 oasc.Overseer.start Overseer (id=92324640360235011-127.0.0.1:30294_solr-n_0000000000) starting
   [junit4]   2> 398316 T2266 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 398318 T2266 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 398321 T2266 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 398324 T2266 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 398326 T2266 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 398329 T2266 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 398334 T2266 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 398334 T2281 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 398335 T2266 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 398336 T2280 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 398337 T2266 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 398339 T2266 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 398342 T2266 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 398343 T2284 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7cc29797 name:ZooKeeperConnection Watcher:127.0.0.1:30294/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 398343 T2266 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 398344 T2266 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 398347 T2266 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1
   [junit4]   2> 398351 T2287 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 398353 T2280 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"127.0.0.1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "core_node_name":"node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "base_url":"http://127.0.0.1/solr/"}
   [junit4]   2> 398353 T2280 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
   [junit4]   2> 398353 T2280 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 398356 T2285 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 398356 T2286 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 398852 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 398860 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 398865 T2287 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 398870 T2280 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"127.0.0.1",
   [junit4]   2> 	  "core":"core2",
   [junit4]   2> 	  "core_node_name":"node2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "base_url":"http://127.0.0.1/solr/"}
   [junit4]   2> 398870 T2280 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
   [junit4]   2> 398870 T2280 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
   [junit4]   2> 398872 T2287 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 398873 T2285 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 398873 T2286 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 399366 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
   [junit4]   2> 399372 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
   [junit4]   2> 399376 T2287 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 399381 T2280 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"127.0.0.1",
   [junit4]   2> 	  "core":"core3",
   [junit4]   2> 	  "core_node_name":"node3",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "base_url":"http://127.0.0.1/solr/"}
   [junit4]   2> 399381 T2280 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
   [junit4]   2> 399382 T2280 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 399384 T2287 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 399385 T2285 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 399385 T2286 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 399878 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 399885 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 399889 T2287 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 399894 T2280 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"127.0.0.1",
   [junit4]   2> 	  "core":"core4",
   [junit4]   2> 	  "core_node_name":"node4",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "base_url":"http://127.0.0.1/solr/"}
   [junit4]   2> 399894 T2280 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
   [junit4]   2> 399894 T2280 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 399896 T2287 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 399897 T2285 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 399897 T2286 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 400390 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 400397 T2287 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 400399 T2280 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"127.0.0.1",
   [junit4]   2> 	  "core":"core5",
   [junit4]   2> 	  "core_node_name":"node5",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "base_url":"http://127.0.0.1/solr/"}
   [junit4]   2> 400400 T2280 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
   [junit4]   2> 400400 T2280 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
   [junit4]   2> 400503 T2286 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 400503 T2285 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 400898 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
   [junit4]   2> 400905 T2287 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 400907 T2280 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"127.0.0.1",
   [junit4]   2> 	  "core":"core6",
   [junit4]   2> 	  "core_node_name":"node6",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "base_url":"http://127.0.0.1/solr/"}
   [junit4]   2> 400907 T2280 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
   [junit4]   2> 400908 T2280 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 401011 T2285 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 401011 T2286 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 401405 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 401413 T2284 oaz.ClientCnxn$EventThread.processEvent ERROR Error while calling watcher  java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1a940965 rejected from java.util.concurrent.ThreadPoolExecutor@6cf4d384[Shutting down, pool size = 2, active threads = 2, queued tasks = 0, completed tasks = 8]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2048)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372)
   [junit4]   2> 	at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:110)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:206)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 
   [junit4]   2> 401413 T2288 oasc.LeaderElector$ElectionWatcher.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:290)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:287)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:287)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:209)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 402913 T2285 oasc.LeaderElector$ElectionWatcher.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard3/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:290)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:287)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:287)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:209)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 402917 T2266 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:30294 30294
   [junit4]   2> 403143 T2267 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:30294 30294
   [junit4]   2> 403144 T2266 oas.SolrTestCaseJ4.tearDown ###Ending testShardAssignment
   [junit4]   2> 403145 T2266 oasc.Overseer.close Overseer (id=92324640360235011-127.0.0.1:30294_solr-n_0000000000) closing
   [junit4]   2> 403145 T2280 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:30294_solr
   [junit4]   2> 403147 T2290 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:307)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:304)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:304)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:320)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:89)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:292)
   [junit4]   2> 
   [junit4]   2> 403154 T2266 oas.SolrTestCaseJ4.setUp ###Starting testOverseerFailure
   [junit4]   2> 403155 T2266 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 403155 T2291 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 403255 T2266 oasc.ZkTestServer.run start zk server on port:30300
   [junit4]   2> 403256 T2266 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 403259 T2297 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@56c2dbc8 name:ZooKeeperConnection Watcher:127.0.0.1:30300 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 403260 T2266 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 403262 T2266 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 403263 T2299 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7dec14cb name:ZooKeeperConnection Watcher:127.0.0.1:30300 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 403263 T2266 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 403264 T2266 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 403267 T2266 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 403268 T2301 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@74524b1b name:ZooKeeperConnection Watcher:127.0.0.1:30300/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 403269 T2266 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 403269 T2266 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 403271 T2266 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 403273 T2266 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 403274 T2266 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 403277 T2266 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 403278 T2303 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7c6c993d name:ZooKeeperConnection Watcher:127.0.0.1:30300/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 403278 T2266 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 403280 T2266 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 403282 T2266 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
   [junit4]   2> 403284 T2266 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 403286 T2307 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@50fe1b9b name:ZooKeeperConnection Watcher:127.0.0.1:30300/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 403286 T2266 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 403286 T2266 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: retry=false
   [junit4]   2> 403287 T2266 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 403289 T2266 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 403291 T2266 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 403293 T2266 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:30300_solr
   [junit4]   2> 403293 T2266 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 403295 T2266 oasc.Overseer.start Overseer (id=92324640685883396-127.0.0.1:30300_solr-n_0000000000) starting
   [junit4]   2> 403296 T2266 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 403299 T2266 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 403302 T2266 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 403304 T2266 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 403307 T2266 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 403310 T2266 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 403314 T2266 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 403315 T2309 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 403316 T2308 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 404318 T2311 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 404320 T2308 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"recovering",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node1/solr/"}
   [junit4]   2> 404320 T2308 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1]
   [junit4]   2> 404321 T2308 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 404323 T2305 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 404323 T2304 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 404818 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 404826 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 404831 T2311 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 404834 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 404836 T2308 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node1/solr/"}
   [junit4]   2> 404836 T2308 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
   [junit4]   2> 404838 T2311 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 404839 T2304 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 404839 T2305 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 405317 T2309 oasc.OverseerCollectionProcessor.amILeader  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:307)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:304)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:304)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerCollectionProcessor.amILeader(OverseerCollectionProcessor.java:514)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:272)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 405318 T2309 oasc.OverseerCollectionProcessor.amILeader According to ZK I (id=92324640685883396-127.0.0.1:30300_solr-n_0000000000) am no longer a leader.
   [junit4]   2> 405893 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 405899 T2266 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 405901 T2313 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1bb68807 name:ZooKeeperConnection Watcher:127.0.0.1:30300/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 405901 T2266 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 405901 T2266 oasc.Overseer.close Overseer (id=92324640685883396-127.0.0.1:30300_solr-n_0000000000) closing
   [junit4]   2> 405902 T2308 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:30300_solr
   [junit4]   2> 405902 T2266 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: retry=false
   [junit4]   2> 405903 T2314 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:307)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:304)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:304)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:320)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:89)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:292)
   [junit4]   2> 
   [junit4]   2> 405905 T2266 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 405906 T2266 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:30300_solr
   [junit4]   2> 405907 T2266 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 405909 T2266 oasc.Overseer.start Overseer (id=92324640685883397-127.0.0.1:30300_solr-n_0000000001) starting
   [junit4]   2> 405917 T2266 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 405918 T2316 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 405919 T2315 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 405922 T2315 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"recovering",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node1/solr/"}
   [junit4]   2> 405922 T2315 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
   [junit4]   2> 405924 T2318 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 405925 T2304 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 405925 T2305 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 405978 T2318 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 405978 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 405983 T2266 oasc.LeaderElector.checkIfIamLeader WARN Failed setting watch org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections/collection1/leader_elect/shard1/election/92324640685883395-node1_core1-n_0000000002
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:307)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:304)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:304)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:148)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:314)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:221)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:157)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:662)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:606)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 405985 T2319 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 405984 T2315 oasc.SolrException.log ERROR Problem cleaning up collection in zk:collection1:org.apache.zookeeper.KeeperException$NotEmptyException: KeeperErrorCode = Directory not empty for /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:125)
   [junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 		at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:189)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:186)
   [junit4]   2> 		at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:186)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.clean(SolrZkClient.java:670)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.clean(SolrZkClient.java:665)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.clean(SolrZkClient.java:665)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.clean(SolrZkClient.java:665)
   [junit4]   2> 		at org.apache.solr.cloud.Overseer$ClusterStateUpdater.removeCore(Overseer.java:1104)
   [junit4]   2> 		at org.apache.solr.cloud.Overseer$ClusterStateUpdater.processMessage(Overseer.java:362)
   [junit4]   2> 		at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:244)
   [junit4]   2> 		at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 	
   [junit4]   2> 405983 T2304 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 405986 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 405990 T2318 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 405991 T2315 oasc.Overseer$ClusterStateUpdater.setShardLeader ERROR Could not mark shard leader for non existing collection:collection1
   [junit4]   2> 406094 T2319 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 406094 T2305 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 406989 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 406989 T2304 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 407993 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 407993 T2304 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 408996 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 408997 T2304 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 409999 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 410000 T2304 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 411002 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 411003 T2304 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 412005 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 412006 T2304 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 413008 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 413009 T2304 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 414011 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 414012 T2304 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 415014 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 415015 T2304 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 416018 T2304 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 416018 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 417021 T2304 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 417021 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 418024 T2304 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 418025 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 419027 T2304 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 419028 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 420030 T2304 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 420031 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 421033 T2304 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 421034 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 421036 T2304 oasc.LeaderElector$ElectionWatcher.process WARN  org.apache.solr.common.SolrException: Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
   [junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:150)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:163)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:125)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:209)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
   [junit4]   2> 	at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:40)
   [junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:137)
   [junit4]   2> 	... 10 more
   [junit4]   2> Caused by: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$11.execute(SolrZkClient.java:462)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:459)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:416)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:403)
   [junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:142)
   [junit4]   2> 	at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:34)
   [junit4]   2> 	... 11 more
   [junit4]   2> 
   [junit4]   2> 422538 T2304 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 422542 T2266 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:30300 30300
   [junit4]   2> 423673 T2291 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:30300 30300
   [junit4]   2> 423674 T2266 oas.SolrTestCaseJ4.tearDown ###Ending testOverseerFailure
   [junit4]   2> 423675 T2266 oasc.Overseer.close Overseer (id=92324640685883397-127.0.0.1:30300_solr-n_0000000001) closing
   [junit4]   2> 423675 T2315 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:30300_solr
   [junit4]   2> 423677 T2320 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:307)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:304)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:304)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:320)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:89)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:292)
   [junit4]   2> 
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=OverseerTest -Dtests.method=testOverseerFailure -Dtests.seed=A488D6E45BB4A02F -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sk -Dtests.timezone=Etc/GMT+11 -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   20.6s J0 | OverseerTest.testOverseerFailure <<<
   [junit4]    > Throwable #1: org.apache.solr.common.SolrException: Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([A488D6E45BB4A02F:A080591749114F0E]:0)
   [junit4]    > 	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:150)
   [junit4]    > 	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:163)
   [junit4]    > 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:125)
   [junit4]    > 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:155)
   [junit4]    > 	at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:314)
   [junit4]    > 	at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:221)
   [junit4]    > 	at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:157)
   [junit4]    > 	at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:662)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]    > Caused by: org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
   [junit4]    > 	at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:40)
   [junit4]    > 	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:137)
   [junit4]    > 	... 48 more
   [junit4]    > Caused by: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
   [junit4]    > 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
   [junit4]    > 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]    > 	at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
   [junit4]    > 	at org.apache.solr.common.cloud.SolrZkClient$11.execute(SolrZkClient.java:462)
   [junit4]    > 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
   [junit4]    > 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:459)
   [junit4]    > 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:416)
   [junit4]    > 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:403)
   [junit4]    > 	at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:142)
   [junit4]    > 	at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:34)
   [junit4]    > 	... 49 more
   [junit4]   2> 423767 T2266 oas.SolrTestCaseJ4.setUp ###Starting testShardLeaderChange
   [junit4]   2> 423768 T2266 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 423769 T2321 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 423869 T2266 oasc.ZkTestServer.run start zk server on port:11446
   [junit4]   2> 423870 T2266 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 423873 T2327 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2f15acf name:ZooKeeperConnection Watcher:127.0.0.1:11446/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 423873 T2266 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 423874 T2266 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 423876 T2329 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7b23bca8 name:ZooKeeperConnection Watcher:127.0.0.1:11446 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 423876 T2266 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 423878 T2266 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 423879 T2331 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19e558f6 name:ZooKeeperConnection Watcher:127.0.0.1:11446 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 423880 T2266 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 423880 T2266 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 423883 T2266 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 423887 T2332 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 423887 T2266 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 423888 T2335 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4d1fffbb name:ZooKeeperConnection Watcher:127.0.0.1:11446/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 423888 T2332 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 423888 T2336 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6fce758b name:ZooKeeperConnection Watcher:127.0.0.1:11446/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 423889 T2332 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: retry=false
   [junit4]   2> 423889 T2266 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 423890 T2332 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 423890 T2266 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 423892 T2332 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 423892 T2266 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 423894 T2332 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 423894 T2266 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 423895 T2332 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:11446_solr
   [junit4]   2> 423896 T2332 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 423896 T2266 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
   [junit4]   2> 423897 T2332 oasc.Overseer.start Overseer (id=92324642036842499-127.0.0.1:11446_solr-n_0000000000) starting
   [junit4]   2> 423899 T2332 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 423900 T2266 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 423902 T2332 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 423905 T2332 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 423907 T2332 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 423910 T2332 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 423913 T2332 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 423917 T2332 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 423918 T2339 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 423918 T2332 oasc.OverseerTest$OverseerRestarter.run Killing overseer.
   [junit4]   2> 423920 T2332 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 423921 T2342 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3ea94c20 name:ZooKeeperConnection Watcher:127.0.0.1:11446/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 423921 T2332 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 423922 T2332 oasc.Overseer.close Overseer (id=92324642036842499-127.0.0.1:11446_solr-n_0000000000) closing
   [junit4]   2> 423922 T2339 oasc.OverseerCollectionProcessor.run ERROR Unable to prioritize overseer  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /roles.json
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:256)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:253)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:253)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerCollectionProcessor.prioritizeOverseerNodes(OverseerCollectionProcessor.java:412)
   [junit4]   2> 	at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:259)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 423922 T2332 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: retry=false
   [junit4]   2> 423925 T2332 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 423927 T2332 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:11446_solr
   [junit4]   2> 423927 T2332 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 423929 T2332 oasc.Overseer.start Overseer (id=92324642036842501-127.0.0.1:11446_solr-n_0000000001) starting
   [junit4]   2> 423937 T2332 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 423938 T2344 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 423939 T2343 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 423941 T2343 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"state1",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "core_node_name":"node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node1/solr/"}
   [junit4]   2> 423942 T2343 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1]
   [junit4]   2> 423942 T2343 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 423944 T2346 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 423945 T2337 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 424402 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 424410 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 424414 T2346 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 424416 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 424419 T2343 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"state2",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "core_node_name":"node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node1/solr/"}
   [junit4]   2> 424420 T2343 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
   [junit4]   2> 424421 T2266 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 424422 T2346 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 424423 T2348 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3bb48bd7 name:ZooKeeperConnection Watcher:127.0.0.1:11446/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 424423 T2337 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 424423 T2266 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 424425 T2266 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 424427 T2266 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
   [junit4]   2> 424431 T2346 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 424431 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 424433 T2343 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"state1",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "core_node_name":"node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node1/solr/"}
   [junit4]   2> 424433 T2343 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
   [junit4]   2> 424438 T2346 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 424439 T2343 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"state2",
   [junit4]   2> 	  "node_name":"node2",
   [junit4]   2> 	  "core":"core4",
   [junit4]   2> 	  "core_node_name":"node2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node2/solr/"}
   [junit4]   2> 424439 T2343 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
   [junit4]   2> 424439 T2343 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 424543 T2337 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 424543 T2349 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 424938 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 424945 T2336 oaz.ClientCnxn$EventThread.processEvent ERROR Error while calling watcher  java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@73015c0f rejected from java.util.concurrent.ThreadPoolExecutor@5e4317c5[Shutting down, pool size = 2, active threads = 2, queued tasks = 0, completed tasks = 5]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2048)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372)
   [junit4]   2> 	at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:110)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:206)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 
   [junit4]   2> 424945 T2350 oasc.LeaderElector$ElectionWatcher.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:290)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:287)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:287)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:209)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 424946 T2349 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 424951 T2346 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 425056 T2349 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 426444 T2337 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 426447 T2266 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 426448 T2352 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7af38db4 name:ZooKeeperConnection Watcher:127.0.0.1:11446/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 426448 T2266 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 426450 T2266 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 426452 T2266 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
   [junit4]   2> 426455 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 426455 T2346 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 426457 T2343 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"state1",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "core_node_name":"node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node1/solr/"}
   [junit4]   2> 426457 T2343 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
   [junit4]   2> 426461 T2353 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 426462 T2346 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 426462 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 426463 T2343 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"state2",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "core_node_name":"node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node1/solr/"}
   [junit4]   2> 426463 T2343 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
   [junit4]   2> 426463 T2332 oasc.OverseerTest$OverseerRestarter.run Killing overseer.
   [junit4]   2> 426465 T2332 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 426466 T2355 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@28b612e1 name:ZooKeeperConnection Watcher:127.0.0.1:11446/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 426466 T2332 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 426466 T2332 oasc.Overseer.close Overseer (id=92324642036842501-127.0.0.1:11446_solr-n_0000000001) closing
   [junit4]   2> 426467 T2343 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:11446_solr
   [junit4]   2> 426467 T2332 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: retry=false
   [junit4]   2> 426468 T2356 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:307)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:304)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:304)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:320)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:89)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:292)
   [junit4]   2> 
   [junit4]   2> 426468 T2332 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 426469 T2266 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 426470 T2358 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2cf2a36e name:ZooKeeperConnection Watcher:127.0.0.1:11446/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 426470 T2332 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:11446_solr
   [junit4]   2> 426470 T2266 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 426470 T2332 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 426471 T2266 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 426472 T2332 oasc.Overseer.start Overseer (id=92324642036842504-127.0.0.1:11446_solr-n_0000000002) starting
   [junit4]   2> 426473 T2266 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
   [junit4]   2> 426476 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 426480 T2332 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 426480 T2361 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 426482 T2360 oasc.Overseer$ClusterStateUpdater.run Replaying operations from work queue.
   [junit4]   2> 426482 T2360 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"state1",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "core_node_name":"node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node1/solr/"}
   [junit4]   2> 426483 T2360 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
   [junit4]   2> 426483 T2353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 426483 T2359 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 426485 T2360 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"state2",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "core_node_name":"node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node1/solr/"}
   [junit4]   2> 426485 T2360 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
   [junit4]   2> 426486 T2359 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 426486 T2353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 426499 T2360 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 426501 T2360 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"state2",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "core_node_name":"node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node1/solr/"}
   [junit4]   2> 426501 T2360 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
   [junit4]   2> 426503 T2363 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 426506 T2360 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"state1",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "core_node_name":"node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node1/solr/"}
   [junit4]   2> 426506 T2360 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
   [junit4]   2> 426508 T2363 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 426509 T2359 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 426509 T2353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 426685 T2266 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 426685 T2363 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 426687 T2360 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"state2",
   [junit4]   2> 	  "node_name":"node2",
   [junit4]   2> 	  "core":"core4",
   [junit4]   2> 	  "core_node_name":"node2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"http://node2/solr/"}
   [junit4]   2> 426687 T2360 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
   [junit4]   2> 426691 T2364 oasc.LeaderElector$ElectionWatcher.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredExce

[...truncated too long message...]

path:null type:None
   [junit4]   2> 469188 T2266 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 469188 T2266 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 469190 T3147 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1be54f54 name:ZooKeeperConnection Watcher:127.0.0.1:22416 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 469190 T2266 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 469192 T2266 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 469193 T3149 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7e433fe9 name:ZooKeeperConnection Watcher:127.0.0.1:22416 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 469193 T2266 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 469193 T2266 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 469196 T2266 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 469197 T2266 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 469199 T2266 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 469200 T2266 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 469202 T2266 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 469203 T3151 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2361b1af name:ZooKeeperConnection Watcher:127.0.0.1:22416/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 469203 T2266 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 469204 T2266 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: retry=false
   [junit4]   2> 469204 T2266 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 469206 T2266 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 469207 T2266 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 469208 T2266 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:22416_solr
   [junit4]   2> 469209 T2266 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 469210 T2266 oasc.Overseer.start Overseer (id=92324645006606339-127.0.0.1:22416_solr-n_0000000000) starting
   [junit4]   2> 469211 T2266 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 469213 T2266 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 469215 T2266 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 469217 T2266 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 469219 T2266 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 469221 T2266 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 469224 T2266 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 469224 T3153 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 469225 T3152 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 469227 T3152 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "base_url":"http://127.0.0.1/solr",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "roles":"",
   [junit4]   2> 	  "state":"recovering"}
   [junit4]   2> 469227 T3152 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 469229 T3155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 469230 T3156 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
   [junit4]   2> 469278 T3155 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 469279 T3152 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "base_url":"http://127.0.0.1/solr",
   [junit4]   2> 	  "node_name":"node1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "core":"core1",
   [junit4]   2> 	  "roles":"",
   [junit4]   2> 	  "state":"active"}
   [junit4]   2> 469279 T3152 oasc.Overseer$ClusterStateUpdater.updateState node=core_node1 is already registered
   [junit4]   2> 469279 T3152 oasc.Overseer$ClusterStateUpdater.updateState shard=shard1 is already registered
   [junit4]   2> 469382 T3156 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
   [junit4]   2> 469432 T2266 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:22416 22416
   [junit4]   2> 470671 T3139 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:22416 22416
   [junit4]   2> 470672 T2266 oas.SolrTestCaseJ4.tearDown ###Ending testStateChange
   [junit4]   2> 470673 T2266 oasc.Overseer.close Overseer (id=92324645006606339-127.0.0.1:22416_solr-n_0000000000) closing
   [junit4]   2> 470673 T3152 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:22416_solr
   [junit4]   2> 470674 T3157 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:307)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:304)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:74)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:304)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:320)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:89)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:292)
   [junit4]   2> 
   [junit4]   2> 473675 T2266 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.cloud.OverseerTest-A488D6E45BB4A02F-001
   [junit4]   2> NOTE: test params are: codec=Lucene41, sim=DefaultSimilarity, locale=sk, timezone=Etc/GMT+11
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_60 (64-bit)/cpus=16,threads=1,free=171820816,total=509607936
   [junit4]   2> NOTE: All tests run in this JVM: [TestDistributedGrouping, MBeansHandlerTest, TestRealTimeGet, HardAutoCommitTest, BasicDistributedZkTest, TestComplexPhraseQParserPlugin, TestPivotHelperCode, DocumentBuilderTest, TestDistributedMissingSort, TestReloadAndDeleteDocs, ParsingFieldUpdateProcessorsTest, OverseerTest]
   [junit4] Completed on J0 in 75.52s, 9 tests, 1 error <<< FAILURES!

[...truncated 1221 lines...]
BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:485: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:465: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:48: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:494: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1343: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:958: There were test failures: 419 suites, 1733 tests, 1 error, 53 ignored (19 assumptions)

Total time: 133 minutes 19 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-Tests-4.x-Java7 #2065
Archived 3 artifacts
Archive block size is 32768
Received 0 blocks and 193179332 bytes
Compression is 0.0%
Took 36 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 2068 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/2068/

3 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.spelling.suggest.TestAnalyzedSuggestions

Error Message:
SolrCore 'collection1' is not available due to init failure: null

Stack Trace:
org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: null
	at __randomizedtesting.SeedInfo.seed([CB4E9CA19125C4C2]:0)
	at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:745)
	at org.apache.solr.util.TestHarness.getCore(TestHarness.java:209)
	at org.apache.solr.util.TestHarness$LocalRequestFactory.makeRequest(TestHarness.java:420)
	at org.apache.solr.SolrTestCaseJ4.req(SolrTestCaseJ4.java:990)
	at org.apache.solr.spelling.suggest.TestAnalyzedSuggestions.beforeClass(TestAnalyzedSuggestions.java:30)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:767)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.common.SolrException
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	... 1 more
Caused by: java.lang.RuntimeException
	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
	... 8 more


FAILED:  junit.framework.TestSuite.org.apache.solr.spelling.suggest.TestFuzzyAnalyzedSuggestions

Error Message:
SolrCore 'collection1' is not available due to init failure: null

Stack Trace:
org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: null
	at __randomizedtesting.SeedInfo.seed([CB4E9CA19125C4C2]:0)
	at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:745)
	at org.apache.solr.util.TestHarness.getCore(TestHarness.java:209)
	at org.apache.solr.util.TestHarness$LocalRequestFactory.makeRequest(TestHarness.java:420)
	at org.apache.solr.SolrTestCaseJ4.req(SolrTestCaseJ4.java:990)
	at org.apache.solr.spelling.suggest.TestFuzzyAnalyzedSuggestions.beforeClass(TestFuzzyAnalyzedSuggestions.java:34)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:767)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.common.SolrException
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	... 1 more
Caused by: java.lang.RuntimeException
	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
	... 8 more


FAILED:  junit.framework.TestSuite.org.apache.solr.spelling.suggest.TestHighFrequencyDictionaryFactory

Error Message:
SolrCore 'collection1' is not available due to init failure: null

Stack Trace:
org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: null
	at __randomizedtesting.SeedInfo.seed([CB4E9CA19125C4C2]:0)
	at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:745)
	at org.apache.solr.util.TestHarness.getCoreInc(TestHarness.java:219)
	at org.apache.solr.util.TestHarness.update(TestHarness.java:235)
	at org.apache.solr.util.BaseTestHarness.checkUpdateStatus(BaseTestHarness.java:282)
	at org.apache.solr.util.BaseTestHarness.validateUpdate(BaseTestHarness.java:252)
	at org.apache.solr.SolrTestCaseJ4.checkUpdateU(SolrTestCaseJ4.java:663)
	at org.apache.solr.SolrTestCaseJ4.assertU(SolrTestCaseJ4.java:642)
	at org.apache.solr.SolrTestCaseJ4.assertU(SolrTestCaseJ4.java:636)
	at org.apache.solr.spelling.suggest.TestHighFrequencyDictionaryFactory.beforeClass(TestHighFrequencyDictionaryFactory.java:32)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:767)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.common.SolrException
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	... 1 more
Caused by: java.lang.RuntimeException
	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
	... 8 more




Build Log:
[...truncated 12055 lines...]
   [junit4] Suite: org.apache.solr.spelling.suggest.TestAnalyzedSuggestions
   [junit4]   2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestAnalyzedSuggestions-CB4E9CA19125C4C2-001/init-core-data-001
   [junit4]   2> 4608149 T15031 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 4608150 T15031 oas.SolrTestCaseJ4.initCore ####initCore
   [junit4]   2> 4608151 T15031 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/'
   [junit4]   2> 4608152 T15031 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
   [junit4]   2> 4608153 T15031 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 4608153 T15031 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 4608323 T15031 oasc.SolrConfig.<init> Using Lucene MatchVersion: 4.11.0
   [junit4]   2> 4608387 T15031 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-phrasesuggest.xml
   [junit4]   2> 4608388 T15031 oass.IndexSchema.readSchema Reading Solr Schema from schema-phrasesuggest.xml
   [junit4]   2> 4608396 T15031 oass.IndexSchema.readSchema [null] Schema name=test
   [junit4]   2> 4608428 T15031 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 4608430 T15031 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 4608431 T15031 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 4608432 T15031 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr
   [junit4]   2> 4608432 T15031 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/'
   [junit4]   2> 4608505 T15031 oasc.CoreContainer.<init> New CoreContainer 909710819
   [junit4]   2> 4608505 T15031 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/]
   [junit4]   2> 4608507 T15031 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 4608507 T15031 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 4608507 T15031 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 4608507 T15031 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 4608508 T15031 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 4608508 T15031 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 4608508 T15031 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 4608509 T15031 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 4608509 T15031 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 4608510 T15031 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=30000&connTimeout=30000&retry=false
   [junit4]   2> 4608510 T15031 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 4608510 T15031 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 4608510 T15031 oasc.CoreContainer.load Host Name: 
   [junit4]   2> 4608515 T15032 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/'
   [junit4]   2> 4608518 T15032 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
   [junit4]   2> 4608518 T15032 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 4608519 T15032 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 4608585 T15032 oasc.SolrConfig.<init> Using Lucene MatchVersion: 4.11.0
   [junit4]   2> 4608675 T15032 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-phrasesuggest.xml
   [junit4]   2> 4608676 T15032 oass.IndexSchema.readSchema Reading Solr Schema from schema-phrasesuggest.xml
   [junit4]   2> 4608683 T15032 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 4608710 T15032 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 4608712 T15032 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 4608713 T15032 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/
   [junit4]   2> 4608713 T15032 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 4608713 T15032 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestAnalyzedSuggestions-CB4E9CA19125C4C2-001/init-core-data-001/
   [junit4]   2> 4608714 T15032 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 4608714 T15032 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestAnalyzedSuggestions-CB4E9CA19125C4C2-001/init-core-data-001
   [junit4]   2> 4608715 T15032 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestAnalyzedSuggestions-CB4E9CA19125C4C2-001/init-core-data-001/index/
   [junit4]   2> 4608715 T15032 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestAnalyzedSuggestions-CB4E9CA19125C4C2-001/init-core-data-001/index' doesn't exist. Creating new index...
   [junit4]   2> 4608716 T15032 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestAnalyzedSuggestions-CB4E9CA19125C4C2-001/init-core-data-001/index
   [junit4]   2> 4608716 T15032 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=45, maxMergeAtOnceExplicit=45, maxMergedSegmentMB=88.189453125, floorSegmentMB=1.708984375, forceMergeDeletesPctAllowed=6.501078063086812, segmentsPerTier=17.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 4608717 T15032 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=BaseDirectoryWrapper(RAMDirectory@66302ec lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@b6b766b),segFN=segments_1,generation=1}
   [junit4]   2> 4608717 T15032 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 4608719 T15032 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 4608720 T15032 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 4608720 T15032 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 4608720 T15032 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 4608721 T15032 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 4608721 T15032 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 4608721 T15032 oasc.RequestHandlers.initHandlersFromConfig created /suggest_wfst: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4608722 T15032 oasc.RequestHandlers.initHandlersFromConfig created /suggest_analyzing: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4608722 T15032 oasc.RequestHandlers.initHandlersFromConfig created /infix_suggest_analyzing: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4608722 T15032 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_file_dict: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4608722 T15032 oasc.RequestHandlers.initHandlersFromConfig created /blended_infix_suggest: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4608723 T15032 oasc.RequestHandlers.initHandlersFromConfig created /free_text_suggest: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4608723 T15032 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_high_freq_dict: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4608723 T15032 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4608724 T15032 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_max_edit_2: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4608724 T15032 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_non_fuzzy_prefix_4: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4608724 T15032 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_min_fuzzy_length_2: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4608745 T15032 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 4608747 T15032 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 4608749 T15032 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 4608751 T15032 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 4608755 T15032 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 4608755 T15032 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 4608755 T15032 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=20, maxMergeAtOnceExplicit=48, maxMergedSegmentMB=19.1416015625, floorSegmentMB=1.6474609375, forceMergeDeletesPctAllowed=23.940837618749473, segmentsPerTier=25.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 4608756 T15032 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=BaseDirectoryWrapper(RAMDirectory@66302ec lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@b6b766b),segFN=segments_1,generation=1}
   [junit4]   2> 4608756 T15032 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 4608757 T15032 oass.SolrIndexSearcher.<init> Opening Searcher@4c0606ed[collection1] main
   [junit4]   2> 4608757 T15032 oasr.ManagedResourceStorage.newStorageIO WARN Cannot write to config directory /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
   [junit4]   2> 4608757 T15032 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 4608758 T15032 oasr.ManagedResourceStorage.load Reading _rest_managed.json using InMemoryStorage
   [junit4]   2> 4608758 T15032 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
   [junit4]   2> 4608758 T15032 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using InMemoryStorage
   [junit4]   2> 4608759 T15032 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 4608759 T15032 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 4608759 T15032 oasss.Suggester.init init: {name=suggest_wfst,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.WFSTLookupFactory,storeDir=suggest_wfst,buildOnCommit=false,exactMatchFirst=true,sourceLocation=phrasesuggest.txt}
   [junit4]   2> 4608761 T15032 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 4608761 T15032 oasss.Suggester.init init: {name=suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingLookupFactory,storeDir=suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=ja_suggest,preserveSep=false,sourceLocation=jasuggest.txt}
   [junit4]   2> 4608762 T15032 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 4608762 T15032 oasss.Suggester.init init: {name=infix_suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingInfixLookupFactory,buildOnCommit=false,suggestAnalyzerFieldType=text,sourceLocation=analyzingInfixSuggest.txt}
   [junit4]   2> 4608763 T15032 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 4608764 T15032 oasss.SolrSuggester.init init: {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
   [junit4]   2> 4608765 T15032 oasss.SolrSuggester.init Dictionary loaded with params: {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
   [junit4]   2> 4608765 T15032 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 4608765 T15032 oasss.SolrSuggester.init init: {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator= ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
   [junit4]   2> 4608766 T15032 oasss.SolrSuggester.init Dictionary loaded with params: {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator= ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
   [junit4]   2> 4608767 T15032 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 4608767 T15032 oasss.SolrSuggester.init init: {name=blended_infix_suggest_linear,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=FileDictionaryFactory,buildOnCommit=false,sourceLocation=blendedInfixSuggest.txt,indexPath=blendedInfixDir1,blenderType=linear,suggestAnalyzerFieldType=text}
   [junit4]   2> 4609771 T15032 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1fb0d899
   [junit4]   2> 4609771 T15033 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4c0606ed[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 4609771 T15032 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 4609772 T15032 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 4609772 T15032 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 4609772 T15032 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 4609773 T15032 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 4609773 T15032 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 4609774 T15032 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestAnalyzedSuggestions-CB4E9CA19125C4C2-001/init-core-data-001/index [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestAnalyzedSuggestions-CB4E9CA19125C4C2-001/init-core-data-001/index;done=false>>]
   [junit4]   2> 4609774 T15032 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestAnalyzedSuggestions-CB4E9CA19125C4C2-001/init-core-data-001/index
   [junit4]   2> 4609774 T15032 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestAnalyzedSuggestions-CB4E9CA19125C4C2-001/init-core-data-001 [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestAnalyzedSuggestions-CB4E9CA19125C4C2-001/init-core-data-001;done=false>>]
   [junit4]   2> 4609775 T15032 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestAnalyzedSuggestions-CB4E9CA19125C4C2-001/init-core-data-001
   [junit4]   2> 4609775 T15032 oasc.CoreContainer.create ERROR Error creating core [collection1]: null org.apache.solr.common.SolrException
   [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: java.lang.RuntimeException
   [junit4]   2> 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
   [junit4]   2> 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
   [junit4]   2> 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
   [junit4]   2> 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
   [junit4]   2> 	... 8 more
   [junit4]   2> 
   [junit4]   2> 4609779 T15031 oas.SolrTestCaseJ4.initCore ####initCore end
   [junit4]   2> 4609780 T15031 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 4609780 T15031 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=909710819
   [junit4]   2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=fr_CA, timezone=America/Monterrey
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_60 (64-bit)/cpus=16,threads=1,free=352545728,total=486539264
   [junit4]   2> NOTE: All tests run in this JVM: [TestCollationFieldDocValues, TestWordDelimiterFilterFactory, TestInfoStreamLogging, TestJmxIntegration, OpenExchangeRatesOrgProviderTest, RequestHandlersTest, NoCacheHeaderTest, DocValuesTest, TestManagedSynonymFilterFactory, IndexSchemaRuntimeFieldTest, TestSolr4Spatial, HdfsUnloadDistributedZkTest, TermsComponentTest, CurrencyFieldOpenExchangeTest, TestDynamicFieldResource, HdfsSyncSliceTest, DistributedQueryComponentCustomSortTest, TestQuerySenderNoQuery, TestJoin, MergeStrategyTest, TestOverriddenPrefixQueryForCustomFieldType, TestFoldingMultitermQuery, TestDistribDocBasedVersion, TestSuggestSpellingConverter, QueryElevationComponentTest, ExternalFileFieldSortTest, TestFreeTextSuggestions, TestMaxScoreQueryParser, TestDefaultSimilarityFactory, AutoCommitTest, MinimalSchemaTest, ConvertedLegacyTest, TestMergePolicyConfig, SSLMigrationTest, BlockDirectoryTest, LeaderElectionTest, TestDistributedMissingSort, TestCopyFieldCollectionResource, SolrTestCaseJ4Test, TestSolrXmlPersistence, TestRealTimeGet, TestPerFieldSimilarity, TestTolerantSearch, TestDefaultSearchFieldResource, HdfsDirectoryTest, TestRTGBase, HighlighterConfigTest, SignatureUpdateProcessorFactoryTest, DistributedSpellCheckComponentTest, TestChildDocTransformer, RankQueryTest, SoftAutoCommitTest, TestIBSimilarityFactory, SuggesterFSTTest, SolrCoreCheckLockOnStartupTest, TestFileDictionaryLookup, TestStressRecovery, EnumFieldTest, DeleteReplicaTest, SuggesterTSTTest, TestCollectionAPI, TestBlendedInfixSuggestions, SOLR749Test, QueryResultKeyTest, DebugComponentTest, StatelessScriptUpdateProcessorFactoryTest, HdfsBasicDistributedZkTest, DistributedTermsComponentTest, SpatialFilterTest, TestReversedWildcardFilterFactory, TestSchemaResource, TestSolrXmlPersistor, TestSolrQueryParserResource, TestBinaryResponseWriter, ZkCLITest, SpellPossibilityIteratorTest, TestSolrDeletionPolicy2, RequiredFieldsTest, TestCoreContainer, TestShardHandlerFactory, XsltUpdateRequestHandlerTest, URLClassifyProcessorTest, AliasIntegrationTest, TestDistributedSearch, RegexBoostProcessorTest, TestTrie, DistanceFunctionTest, FieldAnalysisRequestHandlerTest, TestManagedStopFilterFactory, ScriptEngineTest, OverseerStatusTest, SuggesterTest, BasicDistributedZkTest, TestMiniSolrCloudCluster, TestXIncludeConfig, AsyncMigrateRouteKeyTest, ReplicationFactorTest, SearchHandlerTest, ShowFileRequestHandlerTest, TestFunctionQuery, DistributedExpandComponentTest, ChaosMonkeyNothingIsSafeTest, TestCloudManagedSchemaConcurrent, DistribCursorPagingTest, ShardRoutingTest, FullSolrCloudDistribCmdsTest, UnloadDistributedZkTest, TestCloudPivotFacet, TestDistributedGrouping, LeaderElectionIntegrationTest, DistributedSuggestComponentTest, TestCloudManagedSchema, DistributedFacetPivotLargeTest, DistributedFacetPivotSmallTest, DeleteShardTest, TestRecovery, TestHashPartitioner, TestStressReorder, ShardRoutingCustomTest, TestManagedSchema, TestDocBasedVersionConstraints, TestZkChroot, CoreAdminHandlerTest, TestReplicationHandlerBackup, TestRestManager, TestMissingGroups, TestFieldCollectionResource, TestFieldResource, TestDynamicFieldCollectionResource, TestSchemaNameResource, TestFieldTypeResource, TestSchemaSimilarityResource, TestClassNameShortening, TestSolrCoreProperties, TestStressUserVersions, AddSchemaFieldsUpdateProcessorFactoryTest, SolrXmlInZkTest, AnalysisAfterCoreReloadTest, SolrIndexSplitterTest, BasicFunctionalityTest, ZkControllerTest, QueryEqualityTest, SolrRequestParserTest, ParsingFieldUpdateProcessorsTest, TestExtendedDismaxParser, SolrInfoMBeanTest, TestImplicitCoreProperties, FieldMutatingUpdateProcessorTest, SolrIndexConfigTest, AtomicUpdatesTest, DisMaxRequestHandlerTest, JsonLoaderTest, XmlUpdateRequestHandlerTest, FastVectorHighlighterTest, SortByFunctionTest, DocumentAnalysisRequestHandlerTest, JSONWriterTest, SolrPluginUtilsTest, DirectSolrSpellCheckerTest, QueryParsingTest, TestUpdate, BinaryUpdateRequestHandlerTest, IndexSchemaTest, TestIndexingPerformance, UniqFieldsUpdateProcessorFactoryTest, CoreMergeIndexesAdminHandlerTest, TestQueryUtils, TestQueryTypes, TestAnalyzedSuggestions]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestAnalyzedSuggestions -Dtests.seed=CB4E9CA19125C4C2 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=fr_CA -Dtests.timezone=America/Monterrey -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J0 | TestAnalyzedSuggestions (suite) <<<
   [junit4]    > Throwable #1: org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: null
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([CB4E9CA19125C4C2]:0)
   [junit4]    > 	at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:745)
   [junit4]    > 	at org.apache.solr.util.TestHarness.getCore(TestHarness.java:209)
   [junit4]    > 	at org.apache.solr.util.TestHarness$LocalRequestFactory.makeRequest(TestHarness.java:420)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.req(SolrTestCaseJ4.java:990)
   [junit4]    > 	at org.apache.solr.spelling.suggest.TestAnalyzedSuggestions.beforeClass(TestAnalyzedSuggestions.java:30)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]    > Caused by: org.apache.solr.common.SolrException
   [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
   [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
   [junit4]    > 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
   [junit4]    > 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
   [junit4]    > 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
   [junit4]    > 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]    > 	... 1 more
   [junit4]    > Caused by: java.lang.RuntimeException
   [junit4]    > 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
   [junit4]    > 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
   [junit4]    > 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
   [junit4]    > 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
   [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
   [junit4]    > 	... 8 more
   [junit4] Completed on J0 in 1.69s, 0 tests, 1 error <<< FAILURES!

[...truncated 49 lines...]
   [junit4] Suite: org.apache.solr.spelling.suggest.TestFuzzyAnalyzedSuggestions
   [junit4]   2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-CB4E9CA19125C4C2-001/init-core-data-001
   [junit4]   2> 4618163 T15073 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
   [junit4]   2> 4618165 T15073 oas.SolrTestCaseJ4.initCore ####initCore
   [junit4]   2> 4618166 T15073 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/'
   [junit4]   2> 4618167 T15073 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
   [junit4]   2> 4618168 T15073 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 4618169 T15073 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 4618321 T15073 oasc.SolrConfig.<init> Using Lucene MatchVersion: 4.11.0
   [junit4]   2> 4618388 T15073 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-phrasesuggest.xml
   [junit4]   2> 4618389 T15073 oass.IndexSchema.readSchema Reading Solr Schema from schema-phrasesuggest.xml
   [junit4]   2> 4618396 T15073 oass.IndexSchema.readSchema [null] Schema name=test
   [junit4]   2> 4618431 T15073 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 4618433 T15073 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 4618435 T15073 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 4618435 T15073 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr
   [junit4]   2> 4618435 T15073 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/'
   [junit4]   2> 4618510 T15073 oasc.CoreContainer.<init> New CoreContainer 1718134537
   [junit4]   2> 4618511 T15073 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/]
   [junit4]   2> 4618512 T15073 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 4618512 T15073 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 4618513 T15073 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 4618513 T15073 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 4618513 T15073 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 4618513 T15073 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 4618514 T15073 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 4618514 T15073 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 4618514 T15073 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 4618518 T15073 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=30000&connTimeout=30000&retry=false
   [junit4]   2> 4618520 T15073 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 4618520 T15073 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 4618520 T15073 oasc.CoreContainer.load Host Name: 
   [junit4]   2> 4618526 T15074 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/'
   [junit4]   2> 4618528 T15074 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
   [junit4]   2> 4618528 T15074 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 4618529 T15074 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 4618597 T15074 oasc.SolrConfig.<init> Using Lucene MatchVersion: 4.11.0
   [junit4]   2> 4618683 T15074 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-phrasesuggest.xml
   [junit4]   2> 4618684 T15074 oass.IndexSchema.readSchema Reading Solr Schema from schema-phrasesuggest.xml
   [junit4]   2> 4618691 T15074 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 4618716 T15074 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 4618718 T15074 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 4618719 T15074 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/
   [junit4]   2> 4618720 T15074 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 4618720 T15074 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-CB4E9CA19125C4C2-001/init-core-data-001/
   [junit4]   2> 4618720 T15074 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 4618721 T15074 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-CB4E9CA19125C4C2-001/init-core-data-001
   [junit4]   2> 4618721 T15074 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-CB4E9CA19125C4C2-001/init-core-data-001/index/
   [junit4]   2> 4618722 T15074 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-CB4E9CA19125C4C2-001/init-core-data-001/index' doesn't exist. Creating new index...
   [junit4]   2> 4618723 T15074 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-CB4E9CA19125C4C2-001/init-core-data-001/index
   [junit4]   2> 4618723 T15074 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=550124190, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 4618724 T15074 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@18dca3ee lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@531604b5),segFN=segments_1,generation=1}
   [junit4]   2> 4618724 T15074 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 4618726 T15074 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 4618727 T15074 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 4618727 T15074 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 4618727 T15074 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 4618727 T15074 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 4618728 T15074 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 4618728 T15074 oasc.RequestHandlers.initHandlersFromConfig created /suggest_wfst: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4618728 T15074 oasc.RequestHandlers.initHandlersFromConfig created /suggest_analyzing: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4618729 T15074 oasc.RequestHandlers.initHandlersFromConfig created /infix_suggest_analyzing: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4618729 T15074 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_file_dict: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4618729 T15074 oasc.RequestHandlers.initHandlersFromConfig created /blended_infix_suggest: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4618730 T15074 oasc.RequestHandlers.initHandlersFromConfig created /free_text_suggest: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4618730 T15074 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_high_freq_dict: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4618730 T15074 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4618731 T15074 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_max_edit_2: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4618731 T15074 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_non_fuzzy_prefix_4: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4618731 T15074 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_min_fuzzy_length_2: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4618749 T15074 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 4618752 T15074 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 4618754 T15074 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 4618756 T15074 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 4618760 T15074 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 4618760 T15074 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 4618761 T15074 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=18, maxMergedSegmentMB=38.6416015625, floorSegmentMB=1.123046875, forceMergeDeletesPctAllowed=5.409429170622061, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.39017731995591987
   [junit4]   2> 4618761 T15074 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@18dca3ee lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@531604b5),segFN=segments_1,generation=1}
   [junit4]   2> 4618762 T15074 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 4618762 T15074 oass.SolrIndexSearcher.<init> Opening Searcher@449e6fb4[collection1] main
   [junit4]   2> 4618762 T15074 oasr.ManagedResourceStorage.newStorageIO WARN Cannot write to config directory /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
   [junit4]   2> 4618763 T15074 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 4618763 T15074 oasr.ManagedResourceStorage.load Reading _rest_managed.json using InMemoryStorage
   [junit4]   2> 4618763 T15074 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
   [junit4]   2> 4618764 T15074 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using InMemoryStorage
   [junit4]   2> 4618764 T15074 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 4618764 T15074 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 4618764 T15074 oasss.Suggester.init init: {name=suggest_wfst,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.WFSTLookupFactory,storeDir=suggest_wfst,buildOnCommit=false,exactMatchFirst=true,sourceLocation=phrasesuggest.txt}
   [junit4]   2> 4618766 T15074 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 4618766 T15074 oasss.Suggester.init init: {name=suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingLookupFactory,storeDir=suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=ja_suggest,preserveSep=false,sourceLocation=jasuggest.txt}
   [junit4]   2> 4618767 T15074 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 4618767 T15074 oasss.Suggester.init init: {name=infix_suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingInfixLookupFactory,buildOnCommit=false,suggestAnalyzerFieldType=text,sourceLocation=analyzingInfixSuggest.txt}
   [junit4]   2> 4618768 T15074 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 4618769 T15074 oasss.SolrSuggester.init init: {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
   [junit4]   2> 4618770 T15074 oasss.SolrSuggester.init Dictionary loaded with params: {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
   [junit4]   2> 4618770 T15074 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 4618770 T15074 oasss.SolrSuggester.init init: {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator= ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
   [junit4]   2> 4618771 T15074 oasss.SolrSuggester.init Dictionary loaded with params: {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator= ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
   [junit4]   2> 4618772 T15074 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 4618772 T15074 oasss.SolrSuggester.init init: {name=blended_infix_suggest_linear,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=FileDictionaryFactory,buildOnCommit=false,sourceLocation=blendedInfixSuggest.txt,indexPath=blendedInfixDir1,blenderType=linear,suggestAnalyzerFieldType=text}
   [junit4]   2> 4619775 T15074 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@7db7b59d
   [junit4]   2> 4619775 T15075 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@449e6fb4[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 4619775 T15074 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 4619776 T15074 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 4619776 T15074 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 4619776 T15074 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 4619777 T15074 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 4619777 T15074 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 4619777 T15074 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-CB4E9CA19125C4C2-001/init-core-data-001/index [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-CB4E9CA19125C4C2-001/init-core-data-001/index;done=false>>]
   [junit4]   2> 4619778 T15074 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-CB4E9CA19125C4C2-001/init-core-data-001/index
   [junit4]   2> 4619778 T15074 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-CB4E9CA19125C4C2-001/init-core-data-001 [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-CB4E9CA19125C4C2-001/init-core-data-001;done=false>>]
   [junit4]   2> 4619778 T15074 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-CB4E9CA19125C4C2-001/init-core-data-001
   [junit4]   2> 4619778 T15074 oasc.CoreContainer.create ERROR Error creating core [collection1]: null org.apache.solr.common.SolrException
   [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: java.lang.RuntimeException
   [junit4]   2> 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
   [junit4]   2> 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
   [junit4]   2> 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
   [junit4]   2> 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
   [junit4]   2> 	... 8 more
   [junit4]   2> 
   [junit4]   2> 4619782 T15073 oas.SolrTestCaseJ4.initCore ####initCore end
   [junit4]   2> 4619783 T15073 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 4619783 T15073 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1718134537
   [junit4]   2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=44), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=44)), sim=DefaultSimilarity, locale=no_NO, timezone=America/Merida
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_60 (64-bit)/cpus=16,threads=1,free=333046272,total=486539264
   [junit4]   2> NOTE: All tests run in this JVM: [TestCollationFieldDocValues, TestWordDelimiterFilterFactory, TestInfoStreamLogging, TestJmxIntegration, OpenExchangeRatesOrgProviderTest, RequestHandlersTest, NoCacheHeaderTest, DocValuesTest, TestManagedSynonymFilterFactory, IndexSchemaRuntimeFieldTest, TestSolr4Spatial, HdfsUnloadDistributedZkTest, TermsComponentTest, CurrencyFieldOpenExchangeTest, TestDynamicFieldResource, HdfsSyncSliceTest, DistributedQueryComponentCustomSortTest, TestQuerySenderNoQuery, TestJoin, MergeStrategyTest, TestOverriddenPrefixQueryForCustomFieldType, TestFoldingMultitermQuery, TestDistribDocBasedVersion, TestSuggestSpellingConverter, QueryElevationComponentTest, ExternalFileFieldSortTest, TestFreeTextSuggestions, TestMaxScoreQueryParser, TestDefaultSimilarityFactory, AutoCommitTest, MinimalSchemaTest, ConvertedLegacyTest, TestMergePolicyConfig, SSLMigrationTest, BlockDirectoryTest, LeaderElectionTest, TestDistributedMissingSort, TestCopyFieldCollectionResource, SolrTestCaseJ4Test, TestSolrXmlPersistence, TestRealTimeGet, TestPerFieldSimilarity, TestTolerantSearch, TestDefaultSearchFieldResource, HdfsDirectoryTest, TestRTGBase, HighlighterConfigTest, SignatureUpdateProcessorFactoryTest, DistributedSpellCheckComponentTest, TestChildDocTransformer, RankQueryTest, SoftAutoCommitTest, TestIBSimilarityFactory, SuggesterFSTTest, SolrCoreCheckLockOnStartupTest, TestFileDictionaryLookup, TestStressRecovery, EnumFieldTest, DeleteReplicaTest, SuggesterTSTTest, TestCollectionAPI, TestBlendedInfixSuggestions, SOLR749Test, QueryResultKeyTest, DebugComponentTest, StatelessScriptUpdateProcessorFactoryTest, HdfsBasicDistributedZkTest, DistributedTermsComponentTest, SpatialFilterTest, TestReversedWildcardFilterFactory, TestSchemaResource, TestSolrXmlPersistor, TestSolrQueryParserResource, TestBinaryResponseWriter, ZkCLITest, SpellPossibilityIteratorTest, TestSolrDeletionPolicy2, RequiredFieldsTest, TestCoreContainer, TestShardHandlerFactory, XsltUpdateRequestHandlerTest, URLClassifyProcessorTest, AliasIntegrationTest, TestDistributedSearch, RegexBoostProcessorTest, TestTrie, DistanceFunctionTest, FieldAnalysisRequestHandlerTest, TestManagedStopFilterFactory, ScriptEngineTest, OverseerStatusTest, SuggesterTest, BasicDistributedZkTest, TestMiniSolrCloudCluster, TestXIncludeConfig, AsyncMigrateRouteKeyTest, ReplicationFactorTest, SearchHandlerTest, ShowFileRequestHandlerTest, TestFunctionQuery, DistributedExpandComponentTest, ChaosMonkeyNothingIsSafeTest, TestCloudManagedSchemaConcurrent, DistribCursorPagingTest, ShardRoutingTest, FullSolrCloudDistribCmdsTest, UnloadDistributedZkTest, TestCloudPivotFacet, TestDistributedGrouping, LeaderElectionIntegrationTest, DistributedSuggestComponentTest, TestCloudManagedSchema, DistributedFacetPivotLargeTest, DistributedFacetPivotSmallTest, DeleteShardTest, TestRecovery, TestHashPartitioner, TestStressReorder, ShardRoutingCustomTest, TestManagedSchema, TestDocBasedVersionConstraints, TestZkChroot, CoreAdminHandlerTest, TestReplicationHandlerBackup, TestRestManager, TestMissingGroups, TestFieldCollectionResource, TestFieldResource, TestDynamicFieldCollectionResource, TestSchemaNameResource, TestFieldTypeResource, TestSchemaSimilarityResource, TestClassNameShortening, TestSolrCoreProperties, TestStressUserVersions, AddSchemaFieldsUpdateProcessorFactoryTest, SolrXmlInZkTest, AnalysisAfterCoreReloadTest, SolrIndexSplitterTest, BasicFunctionalityTest, ZkControllerTest, QueryEqualityTest, SolrRequestParserTest, ParsingFieldUpdateProcessorsTest, TestExtendedDismaxParser, SolrInfoMBeanTest, TestImplicitCoreProperties, FieldMutatingUpdateProcessorTest, SolrIndexConfigTest, AtomicUpdatesTest, DisMaxRequestHandlerTest, JsonLoaderTest, XmlUpdateRequestHandlerTest, FastVectorHighlighterTest, SortByFunctionTest, DocumentAnalysisRequestHandlerTest, JSONWriterTest, SolrPluginUtilsTest, DirectSolrSpellCheckerTest, QueryParsingTest, TestUpdate, BinaryUpdateRequestHandlerTest, IndexSchemaTest, TestIndexingPerformance, UniqFieldsUpdateProcessorFactoryTest, CoreMergeIndexesAdminHandlerTest, TestQueryUtils, TestQueryTypes, TestAnalyzedSuggestions, CopyFieldTest, CoreContainerCoreInitFailuresTest, TestExceedMaxTermLength, TestSearcherReuse, DocValuesMultiTest, TestSolrXml, NumericFieldsTest, TestFuzzyAnalyzedSuggestions]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestFuzzyAnalyzedSuggestions -Dtests.seed=CB4E9CA19125C4C2 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=no_NO -Dtests.timezone=America/Merida -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J0 | TestFuzzyAnalyzedSuggestions (suite) <<<
   [junit4]    > Throwable #1: org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: null
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([CB4E9CA19125C4C2]:0)
   [junit4]    > 	at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:745)
   [junit4]    > 	at org.apache.solr.util.TestHarness.getCore(TestHarness.java:209)
   [junit4]    > 	at org.apache.solr.util.TestHarness$LocalRequestFactory.makeRequest(TestHarness.java:420)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.req(SolrTestCaseJ4.java:990)
   [junit4]    > 	at org.apache.solr.spelling.suggest.TestFuzzyAnalyzedSuggestions.beforeClass(TestFuzzyAnalyzedSuggestions.java:34)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]    > Caused by: org.apache.solr.common.SolrException
   [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
   [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
   [junit4]    > 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
   [junit4]    > 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
   [junit4]    > 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
   [junit4]    > 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]    > 	... 1 more
   [junit4]    > Caused by: java.lang.RuntimeException
   [junit4]    > 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
   [junit4]    > 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
   [junit4]    > 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
   [junit4]    > 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
   [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
   [junit4]    > 	... 8 more
   [junit4] Completed on J0 in 1.66s, 0 tests, 1 error <<< FAILURES!

[...truncated 7 lines...]
   [junit4] Suite: org.apache.solr.spelling.suggest.TestHighFrequencyDictionaryFactory
   [junit4]   2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestHighFrequencyDictionaryFactory-CB4E9CA19125C4C2-001/init-core-data-001
   [junit4]   2> 4619953 T15078 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 4619955 T15078 oas.SolrTestCaseJ4.initCore ####initCore
   [junit4]   2> 4619956 T15078 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/'
   [junit4]   2> 4619957 T15078 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
   [junit4]   2> 4619958 T15078 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 4619959 T15078 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 4620120 T15078 oasc.SolrConfig.<init> Using Lucene MatchVersion: 4.11.0
   [junit4]   2> 4620184 T15078 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-phrasesuggest.xml
   [junit4]   2> 4620185 T15078 oass.IndexSchema.readSchema Reading Solr Schema from schema-phrasesuggest.xml
   [junit4]   2> 4620192 T15078 oass.IndexSchema.readSchema [null] Schema name=test
   [junit4]   2> 4620224 T15078 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 4620226 T15078 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 4620227 T15078 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 4620228 T15078 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr
   [junit4]   2> 4620228 T15078 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/'
   [junit4]   2> 4620301 T15078 oasc.CoreContainer.<init> New CoreContainer 1465706713
   [junit4]   2> 4620301 T15078 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/]
   [junit4]   2> 4620302 T15078 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 4620303 T15078 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 4620303 T15078 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 4620303 T15078 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 4620304 T15078 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 4620304 T15078 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 4620304 T15078 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 4620304 T15078 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 4620305 T15078 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 4620305 T15078 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=30000&connTimeout=30000&retry=false
   [junit4]   2> 4620306 T15078 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 4620306 T15078 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 4620306 T15078 oasc.CoreContainer.load Host Name: 
   [junit4]   2> 4620312 T15079 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/'
   [junit4]   2> 4620314 T15079 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
   [junit4]   2> 4620314 T15079 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 4620315 T15079 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 4620378 T15079 oasc.SolrConfig.<init> Using Lucene MatchVersion: 4.11.0
   [junit4]   2> 4620441 T15079 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-phrasesuggest.xml
   [junit4]   2> 4620442 T15079 oass.IndexSchema.readSchema Reading Solr Schema from schema-phrasesuggest.xml
   [junit4]   2> 4620449 T15079 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 4620475 T15079 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 4620477 T15079 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 4620478 T15079 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/
   [junit4]   2> 4620478 T15079 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 4620479 T15079 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestHighFrequencyDictionaryFactory-CB4E9CA19125C4C2-001/init-core-data-001/
   [junit4]   2> 4620479 T15079 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 4620480 T15079 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestHighFrequencyDictionaryFactory-CB4E9CA19125C4C2-001/init-core-data-001
   [junit4]   2> 4620480 T15079 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestHighFrequencyDictionaryFactory-CB4E9CA19125C4C2-001/init-core-data-001/index/
   [junit4]   2> 4620480 T15079 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestHighFrequencyDictionaryFactory-CB4E9CA19125C4C2-001/init-core-data-001/index' doesn't exist. Creating new index...
   [junit4]   2> 4620481 T15079 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestHighFrequencyDictionaryFactory-CB4E9CA19125C4C2-001/init-core-data-001/index
   [junit4]   2> 4620482 T15079 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=17, maxMergedSegmentMB=10.7822265625, floorSegmentMB=0.60546875, forceMergeDeletesPctAllowed=25.311690620150184, segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4091926109337545
   [junit4]   2> 4620483 T15079 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@67d61bcf lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2e9b3ba6),segFN=segments_1,generation=1}
   [junit4]   2> 4620483 T15079 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 4620485 T15079 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 4620485 T15079 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 4620485 T15079 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 4620486 T15079 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 4620486 T15079 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 4620486 T15079 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 4620487 T15079 oasc.RequestHandlers.initHandlersFromConfig created /suggest_wfst: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4620487 T15079 oasc.RequestHandlers.initHandlersFromConfig created /suggest_analyzing: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4620487 T15079 oasc.RequestHandlers.initHandlersFromConfig created /infix_suggest_analyzing: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4620488 T15079 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_file_dict: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4620488 T15079 oasc.RequestHandlers.initHandlersFromConfig created /blended_infix_suggest: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4620488 T15079 oasc.RequestHandlers.initHandlersFromConfig created /free_text_suggest: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4620488 T15079 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_high_freq_dict: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4620489 T15079 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4620489 T15079 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_max_edit_2: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4620489 T15079 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_non_fuzzy_prefix_4: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4620490 T15079 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_min_fuzzy_length_2: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4620517 T15079 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 4620519 T15079 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 4620521 T15079 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 4620524 T15079 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 4620527 T15079 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 4620527 T15079 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 4620528 T15079 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=28, maxMergeAtOnceExplicit=21, maxMergedSegmentMB=38.5322265625, floorSegmentMB=0.2255859375, forceMergeDeletesPctAllowed=17.134336435239838, segmentsPerTier=25.0, maxCFSSegmentSizeMB=0.5439453125, noCFSRatio=0.0
   [junit4]   2> 4620528 T15079 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@67d61bcf lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2e9b3ba6),segFN=segments_1,generation=1}
   [junit4]   2> 4620529 T15079 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 4620529 T15079 oass.SolrIndexSearcher.<init> Opening Searcher@10a70f0f[collection1] main
   [junit4]   2> 4620530 T15079 oasr.ManagedResourceStorage.newStorageIO WARN Cannot write to config directory /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
   [junit4]   2> 4620530 T15079 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 4620530 T15079 oasr.ManagedResourceStorage.load Reading _rest_managed.json using InMemoryStorage
   [junit4]   2> 4620530 T15079 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
   [junit4]   2> 4620531 T15079 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using InMemoryStorage
   [junit4]   2> 4620531 T15079 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 4620531 T15079 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 4620532 T15079 oasss.Suggester.init init: {name=suggest_wfst,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.WFSTLookupFactory,storeDir=suggest_wfst,buildOnCommit=false,exactMatchFirst=true,sourceLocation=phrasesuggest.txt}
   [junit4]   2> 4620533 T15079 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 4620533 T15079 oasss.Suggester.init init: {name=suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingLookupFactory,storeDir=suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=ja_suggest,preserveSep=false,sourceLocation=jasuggest.txt}
   [junit4]   2> 4620535 T15079 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 4620535 T15079 oasss.Suggester.init init: {name=infix_suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingInfixLookupFactory,buildOnCommit=false,suggestAnalyzerFieldType=text,sourceLocation=analyzingInfixSuggest.txt}
   [junit4]   2> 4620536 T15079 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 4620536 T15079 oasss.SolrSuggester.init init: {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
   [junit4]   2> 4620538 T15079 oasss.SolrSuggester.init Dictionary loaded with params: {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
   [junit4]   2> 4620538 T15079 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 4620538 T15079 oasss.SolrSuggester.init init: {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator= ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
   [junit4]   2> 4620540 T15079 oasss.SolrSuggester.init Dictionary loaded with params: {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator= ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
   [junit4]   2> 4620540 T15079 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 4620540 T15079 oasss.SolrSuggester.init init: {name=blended_infix_suggest_linear,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=FileDictionaryFactory,buildOnCommit=false,sourceLocation=blendedInfixSuggest.txt,indexPath=blendedInfixDir1,blenderType=linear,suggestAnalyzerFieldType=text}
   [junit4]   2> 4621544 T15079 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@47cdaa53
   [junit4]   2> 4621544 T15080 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@10a70f0f[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 4621544 T15079 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 4621546 T15079 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 4621546 T15079 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 4621546 T15079 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 4621547 T15079 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 4621547 T15079 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 4621548 T15079 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestHighFrequencyDictionaryFactory-CB4E9CA19125C4C2-001/init-core-data-001 [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestHighFrequencyDictionaryFactory-CB4E9CA19125C4C2-001/init-core-data-001;done=false>>]
   [junit4]   2> 4621548 T15079 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestHighFrequencyDictionaryFactory-CB4E9CA19125C4C2-001/init-core-data-001
   [junit4]   2> 4621549 T15079 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestHighFrequencyDictionaryFactory-CB4E9CA19125C4C2-001/init-core-data-001/index [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestHighFrequencyDictionaryFactory-CB4E9CA19125C4C2-001/init-core-data-001/index;done=false>>]
   [junit4]   2> 4621549 T15079 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestHighFrequencyDictionaryFactory-CB4E9CA19125C4C2-001/init-core-data-001/index
   [junit4]   2> 4621550 T15079 oasc.CoreContainer.create ERROR Error creating core [collection1]: null org.apache.solr.common.SolrException
   [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4]   2> 	at java.util.concur

[...truncated too long message...]

xception
   [junit4]   2> 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
   [junit4]   2> 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
   [junit4]   2> 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
   [junit4]   2> 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
   [junit4]   2> 	... 8 more
   [junit4]   2> 
   [junit4]   2> 4621554 T15078 oas.SolrTestCaseJ4.initCore ####initCore end
   [junit4]   2> 4621555 T15078 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 4621555 T15078 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1465706713
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene410), sim=DefaultSimilarity, locale=ar, timezone=Asia/Dushanbe
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_60 (64-bit)/cpus=16,threads=1,free=182676904,total=486539264
   [junit4]   2> NOTE: All tests run in this JVM: [TestCollationFieldDocValues, TestWordDelimiterFilterFactory, TestInfoStreamLogging, TestJmxIntegration, OpenExchangeRatesOrgProviderTest, RequestHandlersTest, NoCacheHeaderTest, DocValuesTest, TestManagedSynonymFilterFactory, IndexSchemaRuntimeFieldTest, TestSolr4Spatial, HdfsUnloadDistributedZkTest, TermsComponentTest, CurrencyFieldOpenExchangeTest, TestDynamicFieldResource, HdfsSyncSliceTest, DistributedQueryComponentCustomSortTest, TestQuerySenderNoQuery, TestJoin, MergeStrategyTest, TestOverriddenPrefixQueryForCustomFieldType, TestFoldingMultitermQuery, TestDistribDocBasedVersion, TestSuggestSpellingConverter, QueryElevationComponentTest, ExternalFileFieldSortTest, TestFreeTextSuggestions, TestMaxScoreQueryParser, TestDefaultSimilarityFactory, AutoCommitTest, MinimalSchemaTest, ConvertedLegacyTest, TestMergePolicyConfig, SSLMigrationTest, BlockDirectoryTest, LeaderElectionTest, TestDistributedMissingSort, TestCopyFieldCollectionResource, SolrTestCaseJ4Test, TestSolrXmlPersistence, TestRealTimeGet, TestPerFieldSimilarity, TestTolerantSearch, TestDefaultSearchFieldResource, HdfsDirectoryTest, TestRTGBase, HighlighterConfigTest, SignatureUpdateProcessorFactoryTest, DistributedSpellCheckComponentTest, TestChildDocTransformer, RankQueryTest, SoftAutoCommitTest, TestIBSimilarityFactory, SuggesterFSTTest, SolrCoreCheckLockOnStartupTest, TestFileDictionaryLookup, TestStressRecovery, EnumFieldTest, DeleteReplicaTest, SuggesterTSTTest, TestCollectionAPI, TestBlendedInfixSuggestions, SOLR749Test, QueryResultKeyTest, DebugComponentTest, StatelessScriptUpdateProcessorFactoryTest, HdfsBasicDistributedZkTest, DistributedTermsComponentTest, SpatialFilterTest, TestReversedWildcardFilterFactory, TestSchemaResource, TestSolrXmlPersistor, TestSolrQueryParserResource, TestBinaryResponseWriter, ZkCLITest, SpellPossibilityIteratorTest, TestSolrDeletionPolicy2, RequiredFieldsTest, TestCoreContainer, TestShardHandlerFactory, XsltUpdateRequestHandlerTest, URLClassifyProcessorTest, AliasIntegrationTest, TestDistributedSearch, RegexBoostProcessorTest, TestTrie, DistanceFunctionTest, FieldAnalysisRequestHandlerTest, TestManagedStopFilterFactory, ScriptEngineTest, OverseerStatusTest, SuggesterTest, BasicDistributedZkTest, TestMiniSolrCloudCluster, TestXIncludeConfig, AsyncMigrateRouteKeyTest, ReplicationFactorTest, SearchHandlerTest, ShowFileRequestHandlerTest, TestFunctionQuery, DistributedExpandComponentTest, ChaosMonkeyNothingIsSafeTest, TestCloudManagedSchemaConcurrent, DistribCursorPagingTest, ShardRoutingTest, FullSolrCloudDistribCmdsTest, UnloadDistributedZkTest, TestCloudPivotFacet, TestDistributedGrouping, LeaderElectionIntegrationTest, DistributedSuggestComponentTest, TestCloudManagedSchema, DistributedFacetPivotLargeTest, DistributedFacetPivotSmallTest, DeleteShardTest, TestRecovery, TestHashPartitioner, TestStressReorder, ShardRoutingCustomTest, TestManagedSchema, TestDocBasedVersionConstraints, TestZkChroot, CoreAdminHandlerTest, TestReplicationHandlerBackup, TestRestManager, TestMissingGroups, TestFieldCollectionResource, TestFieldResource, TestDynamicFieldCollectionResource, TestSchemaNameResource, TestFieldTypeResource, TestSchemaSimilarityResource, TestClassNameShortening, TestSolrCoreProperties, TestStressUserVersions, AddSchemaFieldsUpdateProcessorFactoryTest, SolrXmlInZkTest, AnalysisAfterCoreReloadTest, SolrIndexSplitterTest, BasicFunctionalityTest, ZkControllerTest, QueryEqualityTest, SolrRequestParserTest, ParsingFieldUpdateProcessorsTest, TestExtendedDismaxParser, SolrInfoMBeanTest, TestImplicitCoreProperties, FieldMutatingUpdateProcessorTest, SolrIndexConfigTest, AtomicUpdatesTest, DisMaxRequestHandlerTest, JsonLoaderTest, XmlUpdateRequestHandlerTest, FastVectorHighlighterTest, SortByFunctionTest, DocumentAnalysisRequestHandlerTest, JSONWriterTest, SolrPluginUtilsTest, DirectSolrSpellCheckerTest, QueryParsingTest, TestUpdate, BinaryUpdateRequestHandlerTest, IndexSchemaTest, TestIndexingPerformance, UniqFieldsUpdateProcessorFactoryTest, CoreMergeIndexesAdminHandlerTest, TestQueryUtils, TestQueryTypes, TestAnalyzedSuggestions, CopyFieldTest, CoreContainerCoreInitFailuresTest, TestExceedMaxTermLength, TestSearcherReuse, DocValuesMultiTest, TestSolrXml, NumericFieldsTest, TestFuzzyAnalyzedSuggestions, TestHighFrequencyDictionaryFactory]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestHighFrequencyDictionaryFactory -Dtests.seed=CB4E9CA19125C4C2 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar -Dtests.timezone=Asia/Dushanbe -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J0 | TestHighFrequencyDictionaryFactory (suite) <<<
   [junit4]    > Throwable #1: org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: null
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([CB4E9CA19125C4C2]:0)
   [junit4]    > 	at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:745)
   [junit4]    > 	at org.apache.solr.util.TestHarness.getCoreInc(TestHarness.java:219)
   [junit4]    > 	at org.apache.solr.util.TestHarness.update(TestHarness.java:235)
   [junit4]    > 	at org.apache.solr.util.BaseTestHarness.checkUpdateStatus(BaseTestHarness.java:282)
   [junit4]    > 	at org.apache.solr.util.BaseTestHarness.validateUpdate(BaseTestHarness.java:252)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.checkUpdateU(SolrTestCaseJ4.java:663)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertU(SolrTestCaseJ4.java:642)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertU(SolrTestCaseJ4.java:636)
   [junit4]    > 	at org.apache.solr.spelling.suggest.TestHighFrequencyDictionaryFactory.beforeClass(TestHighFrequencyDictionaryFactory.java:32)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]    > Caused by: org.apache.solr.common.SolrException
   [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
   [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
   [junit4]    > 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
   [junit4]    > 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
   [junit4]    > 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
   [junit4]    > 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]    > 	... 1 more
   [junit4]    > Caused by: java.lang.RuntimeException
   [junit4]    > 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
   [junit4]    > 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
   [junit4]    > 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
   [junit4]    > 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
   [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
   [junit4]    > 	... 8 more
   [junit4] Completed on J0 in 1.64s, 0 tests, 1 error <<< FAILURES!

[...truncated 161 lines...]
BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:485: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:465: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:48: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:494: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1343: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:958: There were test failures: 419 suites, 1726 tests, 3 suite-level errors, 53 ignored (19 assumptions)

Total time: 124 minutes 52 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-Tests-4.x-Java7 #2065
Archived 3 artifacts
Archive block size is 32768
Received 0 blocks and 216796449 bytes
Compression is 0.0%
Took 39 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 2067 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/2067/

2 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.spelling.suggest.TestFileDictionaryLookup

Error Message:
SolrCore 'collection1' is not available due to init failure: null

Stack Trace:
org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: null
	at __randomizedtesting.SeedInfo.seed([B0113FF25B25E1E0]:0)
	at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:745)
	at org.apache.solr.util.TestHarness.getCore(TestHarness.java:209)
	at org.apache.solr.util.TestHarness$LocalRequestFactory.makeRequest(TestHarness.java:420)
	at org.apache.solr.SolrTestCaseJ4.req(SolrTestCaseJ4.java:990)
	at org.apache.solr.spelling.suggest.TestFileDictionaryLookup.beforeClass(TestFileDictionaryLookup.java:30)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:767)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.common.SolrException
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	... 1 more
Caused by: java.lang.RuntimeException
	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
	... 8 more


FAILED:  junit.framework.TestSuite.org.apache.solr.spelling.suggest.TestFreeTextSuggestions

Error Message:
SolrCore 'collection1' is not available due to init failure: null

Stack Trace:
org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: null
	at __randomizedtesting.SeedInfo.seed([B0113FF25B25E1E0]:0)
	at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:745)
	at org.apache.solr.util.TestHarness.getCore(TestHarness.java:209)
	at org.apache.solr.util.TestHarness$LocalRequestFactory.makeRequest(TestHarness.java:420)
	at org.apache.solr.SolrTestCaseJ4.req(SolrTestCaseJ4.java:990)
	at org.apache.solr.spelling.suggest.TestFreeTextSuggestions.beforeClass(TestFreeTextSuggestions.java:32)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:767)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.common.SolrException
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	... 1 more
Caused by: java.lang.RuntimeException
	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
	... 8 more




Build Log:
[...truncated 12061 lines...]
   [junit4] Suite: org.apache.solr.spelling.suggest.TestFreeTextSuggestions
   [junit4]   2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-B0113FF25B25E1E0-001/init-core-data-001
   [junit4]   2> 4727774 T15417 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
   [junit4]   2> 4727775 T15417 oas.SolrTestCaseJ4.initCore ####initCore
   [junit4]   2> 4727776 T15417 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/'
   [junit4]   2> 4727777 T15417 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
   [junit4]   2> 4727778 T15417 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 4727778 T15417 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 4727936 T15417 oasc.SolrConfig.<init> Using Lucene MatchVersion: 4.11.0
   [junit4]   2> 4727999 T15417 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-phrasesuggest.xml
   [junit4]   2> 4728001 T15417 oass.IndexSchema.readSchema Reading Solr Schema from schema-phrasesuggest.xml
   [junit4]   2> 4728008 T15417 oass.IndexSchema.readSchema [null] Schema name=test
   [junit4]   2> 4728038 T15417 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 4728040 T15417 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 4728042 T15417 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 4728042 T15417 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr
   [junit4]   2> 4728042 T15417 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/'
   [junit4]   2> 4728109 T15417 oasc.CoreContainer.<init> New CoreContainer 1778907900
   [junit4]   2> 4728110 T15417 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/]
   [junit4]   2> 4728111 T15417 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 4728111 T15417 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 4728111 T15417 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 4728112 T15417 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 4728112 T15417 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 4728112 T15417 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 4728113 T15417 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 4728113 T15417 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 4728113 T15417 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 4728116 T15417 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=30000&connTimeout=30000&retry=false
   [junit4]   2> 4728118 T15417 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 4728119 T15417 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 4728119 T15417 oasc.CoreContainer.load Host Name: 
   [junit4]   2> 4728124 T15418 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/'
   [junit4]   2> 4728127 T15418 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
   [junit4]   2> 4728127 T15418 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 4728127 T15418 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 4728192 T15418 oasc.SolrConfig.<init> Using Lucene MatchVersion: 4.11.0
   [junit4]   2> 4728259 T15418 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-phrasesuggest.xml
   [junit4]   2> 4728260 T15418 oass.IndexSchema.readSchema Reading Solr Schema from schema-phrasesuggest.xml
   [junit4]   2> 4728268 T15418 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 4728297 T15418 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 4728300 T15418 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 4728301 T15418 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/
   [junit4]   2> 4728301 T15418 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 4728302 T15418 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-B0113FF25B25E1E0-001/init-core-data-001/
   [junit4]   2> 4728302 T15418 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 4728302 T15418 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-B0113FF25B25E1E0-001/init-core-data-001
   [junit4]   2> 4728303 T15418 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-B0113FF25B25E1E0-001/init-core-data-001/index/
   [junit4]   2> 4728303 T15418 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-B0113FF25B25E1E0-001/init-core-data-001/index' doesn't exist. Creating new index...
   [junit4]   2> 4728304 T15418 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-B0113FF25B25E1E0-001/init-core-data-001/index
   [junit4]   2> 4728304 T15418 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=20, maxMergeAtOnceExplicit=22, maxMergedSegmentMB=7.11328125, floorSegmentMB=1.32421875, forceMergeDeletesPctAllowed=9.53930269245796, segmentsPerTier=50.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8069903301050783
   [junit4]   2> 4728305 T15418 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@19d3e1e5 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2e975056),segFN=segments_1,generation=1}
   [junit4]   2> 4728305 T15418 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 4728307 T15418 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 4728307 T15418 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 4728308 T15418 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 4728308 T15418 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 4728308 T15418 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 4728309 T15418 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 4728309 T15418 oasc.RequestHandlers.initHandlersFromConfig created /suggest_wfst: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4728309 T15418 oasc.RequestHandlers.initHandlersFromConfig created /suggest_analyzing: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4728310 T15418 oasc.RequestHandlers.initHandlersFromConfig created /infix_suggest_analyzing: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4728310 T15418 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_file_dict: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4728310 T15418 oasc.RequestHandlers.initHandlersFromConfig created /blended_infix_suggest: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4728310 T15418 oasc.RequestHandlers.initHandlersFromConfig created /free_text_suggest: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4728311 T15418 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_high_freq_dict: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4728311 T15418 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4728311 T15418 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_max_edit_2: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4728312 T15418 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_non_fuzzy_prefix_4: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4728312 T15418 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_min_fuzzy_length_2: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4728336 T15418 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 4728338 T15418 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 4728341 T15418 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 4728343 T15418 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 4728346 T15418 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 4728347 T15418 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 4728347 T15418 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=35, maxMergeAtOnceExplicit=17, maxMergedSegmentMB=61.2998046875, floorSegmentMB=1.6240234375, forceMergeDeletesPctAllowed=20.641642973031207, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8476534030295003
   [junit4]   2> 4728348 T15418 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@19d3e1e5 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2e975056),segFN=segments_1,generation=1}
   [junit4]   2> 4728348 T15418 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 4728348 T15418 oass.SolrIndexSearcher.<init> Opening Searcher@16f07763[collection1] main
   [junit4]   2> 4728349 T15418 oasr.ManagedResourceStorage.newStorageIO WARN Cannot write to config directory /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
   [junit4]   2> 4728349 T15418 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 4728350 T15418 oasr.ManagedResourceStorage.load Reading _rest_managed.json using InMemoryStorage
   [junit4]   2> 4728350 T15418 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
   [junit4]   2> 4728350 T15418 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using InMemoryStorage
   [junit4]   2> 4728350 T15418 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 4728351 T15418 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 4728351 T15418 oasss.Suggester.init init: {name=suggest_wfst,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.WFSTLookupFactory,storeDir=suggest_wfst,buildOnCommit=false,exactMatchFirst=true,sourceLocation=phrasesuggest.txt}
   [junit4]   2> 4728352 T15418 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 4728353 T15418 oasss.Suggester.init init: {name=suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingLookupFactory,storeDir=suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=ja_suggest,preserveSep=false,sourceLocation=jasuggest.txt}
   [junit4]   2> 4728354 T15418 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 4728355 T15418 oasss.Suggester.init init: {name=infix_suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingInfixLookupFactory,buildOnCommit=false,suggestAnalyzerFieldType=text,sourceLocation=analyzingInfixSuggest.txt}
   [junit4]   2> 4728356 T15418 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 4728356 T15418 oasss.SolrSuggester.init init: {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
   [junit4]   2> 4728357 T15418 oasss.SolrSuggester.init Dictionary loaded with params: {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
   [junit4]   2> 4728357 T15418 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 4728357 T15418 oasss.SolrSuggester.init init: {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator= ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
   [junit4]   2> 4728359 T15418 oasss.SolrSuggester.init Dictionary loaded with params: {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator= ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
   [junit4]   2> 4728359 T15418 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 4728359 T15418 oasss.SolrSuggester.init init: {name=blended_infix_suggest_linear,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=FileDictionaryFactory,buildOnCommit=false,sourceLocation=blendedInfixSuggest.txt,indexPath=blendedInfixDir1,blenderType=linear,suggestAnalyzerFieldType=text}
   [junit4]   2> 4729364 T15418 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@b25fb3a
   [junit4]   2> 4729364 T15419 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@16f07763[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 4729364 T15418 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 4729365 T15418 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 4729365 T15418 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 4729365 T15418 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 4729366 T15418 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 4729366 T15418 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 4729366 T15418 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-B0113FF25B25E1E0-001/init-core-data-001/index [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-B0113FF25B25E1E0-001/init-core-data-001/index;done=false>>]
   [junit4]   2> 4729367 T15418 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-B0113FF25B25E1E0-001/init-core-data-001/index
   [junit4]   2> 4729367 T15418 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-B0113FF25B25E1E0-001/init-core-data-001 [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-B0113FF25B25E1E0-001/init-core-data-001;done=false>>]
   [junit4]   2> 4729367 T15418 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-B0113FF25B25E1E0-001/init-core-data-001
   [junit4]   2> 4729368 T15418 oasc.CoreContainer.create ERROR Error creating core [collection1]: null org.apache.solr.common.SolrException
   [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: java.lang.RuntimeException
   [junit4]   2> 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
   [junit4]   2> 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
   [junit4]   2> 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
   [junit4]   2> 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
   [junit4]   2> 	... 8 more
   [junit4]   2> 
   [junit4]   2> 4729371 T15417 oas.SolrTestCaseJ4.initCore ####initCore end
   [junit4]   2> 4729372 T15417 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 4729373 T15417 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1778907900
   [junit4]   2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=2), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=2)), sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=ar_LB, timezone=Antarctica/DumontDUrville
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_60 (64-bit)/cpus=16,threads=1,free=198066896,total=532676608
   [junit4]   2> NOTE: All tests run in this JVM: [SolrPluginUtilsTest, JSONWriterTest, TestPHPSerializedResponseWriter, MBeansHandlerTest, TestConfigSets, TestHashPartitioner, IndexSchemaRuntimeFieldTest, TestIBSimilarityFactory, RegexBoostProcessorTest, HdfsChaosMonkeySafeLeaderTest, CurrencyFieldXmlFileTest, SuggesterTest, TestCSVLoader, TestInitQParser, DocValuesTest, DisMaxRequestHandlerTest, TestStressReorder, TestCollectionAPI, NotRequiredUniqueKeyTest, OverseerTest, ChangedSchemaMergeTest, TestJmxIntegration, InfoHandlerTest, TestExtendedDismaxParser, DirectUpdateHandlerOptimizeTest, TestRecovery, DOMUtilTest, IndexSchemaTest, TestElisionMultitermQuery, TestPseudoReturnFields, OverseerCollectionProcessorTest, ZkSolrClientTest, TestAtomicUpdateErrorCases, TestPostingsSolrHighlighter, SSLMigrationTest, TestManagedSynonymFilterFactory, MultiTermTest, TestReRankQParserPlugin, TestPerFieldSimilarity, SuggesterTSTTest, SuggestComponentTest, HdfsUnloadDistributedZkTest, TestSolrXml, TestOmitPositions, SolrInfoMBeanTest, CircularListTest, TestAnalyzeInfixSuggestions, HighlighterMaxOffsetTest, UUIDFieldTest, TestFoldingMultitermQuery, TestCollationKeyRangeQueries, TestSerializedLuceneMatchVersion, TestImplicitCoreProperties, AtomicUpdatesTest, SolrIndexSplitterTest, AssignTest, TestWriterPerf, TestCopyFieldCollectionResource, UnloadDistributedZkTest, DeleteReplicaTest, TestManagedSchemaFieldResource, TestFaceting, ResourceLoaderTest, SpellingQueryConverterTest, TestZkChroot, TestCoreDiscovery, QueryParsingTest, DocumentAnalysisRequestHandlerTest, HdfsBasicDistributedZkTest, CollectionsAPIDistributedZkTest, TestManagedSchema, CustomCollectionTest, AnalyticsMergeStrategyTest, TestDistributedGrouping, LeaderElectionIntegrationTest, AlternateDirectoryTest, RAMDirectoryFactoryTest, SearchHandlerTest, SpatialFilterTest, TestAddFieldRealTimeGet, PreAnalyzedUpdateProcessorTest, TestConfig, QueryEqualityTest, ReturnFieldsTest, PluginInfoTest, HdfsSyncSliceTest, TestDistributedSearch, TestComponentsName, TestDistributedMissingSort, TestOverriddenPrefixQueryForCustomFieldType, TestRTGBase, TestIndexingPerformance, DocValuesMissingTest, TestReloadAndDeleteDocs, TestSort, TestNumberUtils, TestBM25SimilarityFactory, TestBinaryField, TestRecoveryHdfs, WordBreakSolrSpellCheckerTest, ReplicationFactorTest, SyncSliceTest, ShardSplitTest, DistribCursorPagingTest, TestIntervalFaceting, DistribDocExpirationUpdateProcessorTest, AsyncMigrateRouteKeyTest, TestCloudPivotFacet, RemoteQueryErrorTest, DistributedSuggestComponentTest, TestCloudManagedSchema, CollectionsAPIAsyncDistributedZkTest, DistributedFacetPivotSmallTest, DeleteLastCustomShardedReplicaTest, MergeStrategyTest, LeaderElectionTest, TestHighlightDedupGrouping, TestManagedStopFilterFactory, TestRealTimeGet, ShardRoutingCustomTest, DocExpirationUpdateProcessorFactoryTest, BlockDirectoryTest, DistributedDebugComponentTest, ShowFileRequestHandlerTest, CachingDirectoryFactoryTest, TestReplicationHandlerBackup, HardAutoCommitTest, TestSchemaResource, TestFieldResource, TestSolrQueryParserResource, TestSchemaNameResource, TestDefaultSearchFieldResource, NoCacheHeaderTest, TestSchemaSimilarityResource, TestClassNameShortening, LukeRequestHandlerTest, CoreAdminRequestStatusTest, SolrCoreCheckLockOnStartupTest, BadIndexSchemaTest, HighlighterTest, SchemaVersionSpecificBehaviorTest, FieldMutatingUpdateProcessorTest, TestIndexSearcher, ParsingFieldUpdateProcessorsTest, AddBlockUpdateTest, TestWordDelimiterFilterFactory, TestNRTOpen, TestSolrDeletionPolicy1, DistanceFunctionTest, BJQParserTest, TestChildDocTransformer, TestCSVResponseWriter, MoreLikeThisHandlerTest, TestSurroundQueryParser, RankQueryTest, LoggingHandlerTest, UUIDUpdateProcessorFallbackTest, AnalyticsQueryTest, SOLR749Test, TestCollapseQParserPlugin, FieldAnalysisRequestHandlerTest, TestBinaryResponseWriter, TestQueryTypes, TestLFUCache, HighlighterConfigTest, TestSortingResponseWriter, TestPartialUpdateDeduplication, RequiredFieldsTest, TestReversedWildcardFilterFactory, CoreContainerCoreInitFailuresTest, TestShardHandlerFactory, TestFieldSortValues, OutputWriterTest, TestBlendedInfixSuggestions, TestCustomSort, NumericFieldsTest, TestFreeTextSuggestions]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestFreeTextSuggestions -Dtests.seed=B0113FF25B25E1E0 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar_LB -Dtests.timezone=Antarctica/DumontDUrville -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J0 | TestFreeTextSuggestions (suite) <<<
   [junit4]    > Throwable #1: org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: null
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([B0113FF25B25E1E0]:0)
   [junit4]    > 	at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:745)
   [junit4]    > 	at org.apache.solr.util.TestHarness.getCore(TestHarness.java:209)
   [junit4]    > 	at org.apache.solr.util.TestHarness$LocalRequestFactory.makeRequest(TestHarness.java:420)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.req(SolrTestCaseJ4.java:990)
   [junit4]    > 	at org.apache.solr.spelling.suggest.TestFreeTextSuggestions.beforeClass(TestFreeTextSuggestions.java:32)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]    > Caused by: org.apache.solr.common.SolrException
   [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
   [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
   [junit4]    > 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
   [junit4]    > 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
   [junit4]    > 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
   [junit4]    > 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]    > 	... 1 more
   [junit4]    > Caused by: java.lang.RuntimeException
   [junit4]    > 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
   [junit4]    > 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
   [junit4]    > 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
   [junit4]    > 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
   [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
   [junit4]    > 	... 8 more
   [junit4] Completed on J0 in 1.67s, 0 tests, 1 error <<< FAILURES!

[...truncated 22 lines...]
   [junit4] Suite: org.apache.solr.spelling.suggest.TestFileDictionaryLookup
   [junit4]   2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFileDictionaryLookup-B0113FF25B25E1E0-001/init-core-data-001
   [junit4]   2> 4731622 T15426 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
   [junit4]   2> 4731624 T15426 oas.SolrTestCaseJ4.initCore ####initCore
   [junit4]   2> 4731625 T15426 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/'
   [junit4]   2> 4731626 T15426 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
   [junit4]   2> 4731626 T15426 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 4731627 T15426 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 4731756 T15426 oasc.SolrConfig.<init> Using Lucene MatchVersion: 4.11.0
   [junit4]   2> 4731816 T15426 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-phrasesuggest.xml
   [junit4]   2> 4731817 T15426 oass.IndexSchema.readSchema Reading Solr Schema from schema-phrasesuggest.xml
   [junit4]   2> 4731824 T15426 oass.IndexSchema.readSchema [null] Schema name=test
   [junit4]   2> 4731853 T15426 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 4731855 T15426 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 4731857 T15426 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 4731857 T15426 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr
   [junit4]   2> 4731857 T15426 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/'
   [junit4]   2> 4731922 T15426 oasc.CoreContainer.<init> New CoreContainer 1074573841
   [junit4]   2> 4731922 T15426 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/]
   [junit4]   2> 4731924 T15426 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 4731924 T15426 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 4731924 T15426 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 4731924 T15426 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 4731925 T15426 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 4731925 T15426 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 4731925 T15426 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 4731925 T15426 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 4731926 T15426 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 4731929 T15426 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=30000&connTimeout=30000&retry=false
   [junit4]   2> 4731931 T15426 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 4731931 T15426 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 4731931 T15426 oasc.CoreContainer.load Host Name: 
   [junit4]   2> 4731936 T15427 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/'
   [junit4]   2> 4731938 T15427 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
   [junit4]   2> 4731939 T15427 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 4731939 T15427 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 4731987 T15427 oasc.SolrConfig.<init> Using Lucene MatchVersion: 4.11.0
   [junit4]   2> 4732054 T15427 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-phrasesuggest.xml
   [junit4]   2> 4732055 T15427 oass.IndexSchema.readSchema Reading Solr Schema from schema-phrasesuggest.xml
   [junit4]   2> 4732062 T15427 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 4732087 T15427 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 4732089 T15427 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 4732090 T15427 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/
   [junit4]   2> 4732090 T15427 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 4732090 T15427 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFileDictionaryLookup-B0113FF25B25E1E0-001/init-core-data-001/
   [junit4]   2> 4732091 T15427 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 4732091 T15427 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFileDictionaryLookup-B0113FF25B25E1E0-001/init-core-data-001
   [junit4]   2> 4732092 T15427 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFileDictionaryLookup-B0113FF25B25E1E0-001/init-core-data-001/index/
   [junit4]   2> 4732092 T15427 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFileDictionaryLookup-B0113FF25B25E1E0-001/init-core-data-001/index' doesn't exist. Creating new index...
   [junit4]   2> 4732092 T15427 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFileDictionaryLookup-B0113FF25B25E1E0-001/init-core-data-001/index
   [junit4]   2> 4732093 T15427 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=18, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=36.1064453125, floorSegmentMB=0.2763671875, forceMergeDeletesPctAllowed=0.4979841834876786, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 4732094 T15427 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@1704d09d lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@50ddf582),segFN=segments_1,generation=1}
   [junit4]   2> 4732094 T15427 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 4732095 T15427 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 4732096 T15427 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 4732096 T15427 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 4732096 T15427 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 4732097 T15427 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 4732097 T15427 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 4732097 T15427 oasc.RequestHandlers.initHandlersFromConfig created /suggest_wfst: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4732098 T15427 oasc.RequestHandlers.initHandlersFromConfig created /suggest_analyzing: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4732098 T15427 oasc.RequestHandlers.initHandlersFromConfig created /infix_suggest_analyzing: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4732098 T15427 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_file_dict: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4732098 T15427 oasc.RequestHandlers.initHandlersFromConfig created /blended_infix_suggest: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4732099 T15427 oasc.RequestHandlers.initHandlersFromConfig created /free_text_suggest: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4732099 T15427 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_high_freq_dict: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4732099 T15427 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4732099 T15427 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_max_edit_2: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4732100 T15427 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_non_fuzzy_prefix_4: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4732100 T15427 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_min_fuzzy_length_2: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 4732119 T15427 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 4732121 T15427 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 4732123 T15427 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 4732125 T15427 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 4732128 T15427 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 4732128 T15427 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 4732129 T15427 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=42, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 4732129 T15427 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@1704d09d lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@50ddf582),segFN=segments_1,generation=1}
   [junit4]   2> 4732129 T15427 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 4732130 T15427 oass.SolrIndexSearcher.<init> Opening Searcher@3baf7df8[collection1] main
   [junit4]   2> 4732131 T15427 oasr.ManagedResourceStorage.newStorageIO WARN Cannot write to config directory /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
   [junit4]   2> 4732131 T15427 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 4732131 T15427 oasr.ManagedResourceStorage.load Reading _rest_managed.json using InMemoryStorage
   [junit4]   2> 4732131 T15427 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
   [junit4]   2> 4732132 T15427 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using InMemoryStorage
   [junit4]   2> 4732132 T15427 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 4732132 T15427 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 4732132 T15427 oasss.Suggester.init init: {name=suggest_wfst,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.WFSTLookupFactory,storeDir=suggest_wfst,buildOnCommit=false,exactMatchFirst=true,sourceLocation=phrasesuggest.txt}
   [junit4]   2> 4732134 T15427 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 4732134 T15427 oasss.Suggester.init init: {name=suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingLookupFactory,storeDir=suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=ja_suggest,preserveSep=false,sourceLocation=jasuggest.txt}
   [junit4]   2> 4732135 T15427 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 4732135 T15427 oasss.Suggester.init init: {name=infix_suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingInfixLookupFactory,buildOnCommit=false,suggestAnalyzerFieldType=text,sourceLocation=analyzingInfixSuggest.txt}
   [junit4]   2> 4732136 T15427 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 4732136 T15427 oasss.SolrSuggester.init init: {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
   [junit4]   2> 4732137 T15427 oasss.SolrSuggester.init Dictionary loaded with params: {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
   [junit4]   2> 4732137 T15427 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 4732138 T15427 oasss.SolrSuggester.init init: {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator= ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
   [junit4]   2> 4732139 T15427 oasss.SolrSuggester.init Dictionary loaded with params: {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator= ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
   [junit4]   2> 4732139 T15427 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 4732139 T15427 oasss.SolrSuggester.init init: {name=blended_infix_suggest_linear,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=FileDictionaryFactory,buildOnCommit=false,sourceLocation=blendedInfixSuggest.txt,indexPath=blendedInfixDir1,blenderType=linear,suggestAnalyzerFieldType=text}
   [junit4]   2> 4733143 T15427 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@7e774364
   [junit4]   2> 4733143 T15428 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3baf7df8[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 4733143 T15427 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 4733144 T15427 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 4733144 T15427 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 4733144 T15427 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 4733145 T15427 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 4733145 T15427 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 4733145 T15427 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFileDictionaryLookup-B0113FF25B25E1E0-001/init-core-data-001/index [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFileDictionaryLookup-B0113FF25B25E1E0-001/init-core-data-001/index;done=false>>]
   [junit4]   2> 4733146 T15427 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFileDictionaryLookup-B0113FF25B25E1E0-001/init-core-data-001/index
   [junit4]   2> 4733146 T15427 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFileDictionaryLookup-B0113FF25B25E1E0-001/init-core-data-001 [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFileDictionaryLookup-B0113FF25B25E1E0-001/init-core-data-001;done=false>>]
   [junit4]   2> 4733146 T15427 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFileDictionaryLookup-B0113FF25B25E1E0-001/init-core-data-001
   [junit4]   2> 4733147 T15427 oasc.CoreContainer.create ERROR Error creating core [collection1]: null org.apache.solr.common.SolrException
   [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: java.lang.RuntimeException
   [junit4]   2> 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
   [junit4]   2> 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
   [junit4]   2> 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
   [junit4]   2> 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
   [junit4]   2> 	... 8 more
   [junit4]   2> 
   [junit4]   2> 4733150 T15426 oas.SolrTestCaseJ4.initCore ####initCore end
   [junit4]   2> 4733151 T15426 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 4733151 T15426 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1074573841
   [junit4]   2> NOTE: test params are: codec=Lucene42, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=lv_LV, timezone=Asia/Bishkek
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_60 (64-bit)/cpus=16,threads=1,free=376319592,total=532676608
   [junit4]   2> NOTE: All tests run in this JVM: [SolrPluginUtilsTest, JSONWriterTest, TestPHPSerializedResponseWriter, MBeansHandlerTest, TestConfigSets, TestHashPartitioner, IndexSchemaRuntimeFieldTest, TestIBSimilarityFactory, RegexBoostProcessorTest, HdfsChaosMonkeySafeLeaderTest, CurrencyFieldXmlFileTest, SuggesterTest, TestCSVLoader, TestInitQParser, DocValuesTest, DisMaxRequestHandlerTest, TestStressReorder, TestCollectionAPI, NotRequiredUniqueKeyTest, OverseerTest, ChangedSchemaMergeTest, TestJmxIntegration, InfoHandlerTest, TestExtendedDismaxParser, DirectUpdateHandlerOptimizeTest, TestRecovery, DOMUtilTest, IndexSchemaTest, TestElisionMultitermQuery, TestPseudoReturnFields, OverseerCollectionProcessorTest, ZkSolrClientTest, TestAtomicUpdateErrorCases, TestPostingsSolrHighlighter, SSLMigrationTest, TestManagedSynonymFilterFactory, MultiTermTest, TestReRankQParserPlugin, TestPerFieldSimilarity, SuggesterTSTTest, SuggestComponentTest, HdfsUnloadDistributedZkTest, TestSolrXml, TestOmitPositions, SolrInfoMBeanTest, CircularListTest, TestAnalyzeInfixSuggestions, HighlighterMaxOffsetTest, UUIDFieldTest, TestFoldingMultitermQuery, TestCollationKeyRangeQueries, TestSerializedLuceneMatchVersion, TestImplicitCoreProperties, AtomicUpdatesTest, SolrIndexSplitterTest, AssignTest, TestWriterPerf, TestCopyFieldCollectionResource, UnloadDistributedZkTest, DeleteReplicaTest, TestManagedSchemaFieldResource, TestFaceting, ResourceLoaderTest, SpellingQueryConverterTest, TestZkChroot, TestCoreDiscovery, QueryParsingTest, DocumentAnalysisRequestHandlerTest, HdfsBasicDistributedZkTest, CollectionsAPIDistributedZkTest, TestManagedSchema, CustomCollectionTest, AnalyticsMergeStrategyTest, TestDistributedGrouping, LeaderElectionIntegrationTest, AlternateDirectoryTest, RAMDirectoryFactoryTest, SearchHandlerTest, SpatialFilterTest, TestAddFieldRealTimeGet, PreAnalyzedUpdateProcessorTest, TestConfig, QueryEqualityTest, ReturnFieldsTest, PluginInfoTest, HdfsSyncSliceTest, TestDistributedSearch, TestComponentsName, TestDistributedMissingSort, TestOverriddenPrefixQueryForCustomFieldType, TestRTGBase, TestIndexingPerformance, DocValuesMissingTest, TestReloadAndDeleteDocs, TestSort, TestNumberUtils, TestBM25SimilarityFactory, TestBinaryField, TestRecoveryHdfs, WordBreakSolrSpellCheckerTest, ReplicationFactorTest, SyncSliceTest, ShardSplitTest, DistribCursorPagingTest, TestIntervalFaceting, DistribDocExpirationUpdateProcessorTest, AsyncMigrateRouteKeyTest, TestCloudPivotFacet, RemoteQueryErrorTest, DistributedSuggestComponentTest, TestCloudManagedSchema, CollectionsAPIAsyncDistributedZkTest, DistributedFacetPivotSmallTest, DeleteLastCustomShardedReplicaTest, MergeStrategyTest, LeaderElectionTest, TestHighlightDedupGrouping, TestManagedStopFilterFactory, TestRealTimeGet, ShardRoutingCustomTest, DocExpirationUpdateProcessorFactoryTest, BlockDirectoryTest, DistributedDebugComponentTest, ShowFileRequestHandlerTest, CachingDirectoryFactoryTest, TestReplicationHandlerBackup, HardAutoCommitTest, TestSchemaResource, TestFieldResource, TestSolrQueryParserResource, TestSchemaNameResource, TestDefaultSearchFieldResource, NoCacheHeaderTest, TestSchemaSimilarityResource, TestClassNameShortening, LukeRequestHandlerTest, CoreAdminRequestStatusTest, SolrCoreCheckLockOnStartupTest, BadIndexSchemaTest, HighlighterTest, SchemaVersionSpecificBehaviorTest, FieldMutatingUpdateProcessorTest, TestIndexSearcher, ParsingFieldUpdateProcessorsTest, AddBlockUpdateTest, TestWordDelimiterFilterFactory, TestNRTOpen, TestSolrDeletionPolicy1, DistanceFunctionTest, BJQParserTest, TestChildDocTransformer, TestCSVResponseWriter, MoreLikeThisHandlerTest, TestSurroundQueryParser, RankQueryTest, LoggingHandlerTest, UUIDUpdateProcessorFallbackTest, AnalyticsQueryTest, SOLR749Test, TestCollapseQParserPlugin, FieldAnalysisRequestHandlerTest, TestBinaryResponseWriter, TestQueryTypes, TestLFUCache, HighlighterConfigTest, TestSortingResponseWriter, TestPartialUpdateDeduplication, RequiredFieldsTest, TestReversedWildcardFilterFactory, CoreContainerCoreInitFailuresTest, TestShardHandlerFactory, TestFieldSortValues, OutputWriterTest, TestBlendedInfixSuggestions, TestCustomSort, NumericFieldsTest, TestFreeTextSuggestions, BadCopyFieldTest, TestDocSet, TestFileDictionaryLookup]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestFileDictionaryLookup -Dtests.seed=B0113FF25B25E1E0 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=lv_LV -Dtests.timezone=Asia/Bishkek -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J0 | TestFileDictionaryLookup (suite) <<<
   [junit4]    > Throwable #1: org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: null
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([B0113FF25B25E1E0]:0)
   [junit4]    > 	at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:745)
   [junit4]    > 	at org.apache.solr.util.TestHarness.getCore(TestHarness.java:209)
   [junit4]    > 	at org.apache.solr.util.TestHarness$LocalRequestFactory.makeRequest(TestHarness.java:420)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.req(SolrTestCaseJ4.java:990)
   [junit4]    > 	at org.apache.solr.spelling.suggest.TestFileDictionaryLookup.beforeClass(TestFileDictionaryLookup.java:30)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]    > Caused by: org.apache.solr.common.SolrException
   [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
   [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
   [junit4]    > 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
   [junit4]    > 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
   [junit4]    > 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
   [junit4]    > 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]    > 	... 1 more
   [junit4]    > Caused by: java.lang.RuntimeException
   [junit4]    > 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
   [junit4]    > 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
   [junit4]    > 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
   [junit4]    > 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
   [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
   [junit4]    > 	... 8 more
   [junit4] Completed on J0 in 1.57s, 0 tests, 1 error <<< FAILURES!

[...truncated 150 lines...]
BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:475: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:455: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:45: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:494: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1351: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:966: There were test failures: 419 suites, 1731 tests, 2 suite-level errors, 53 ignored (19 assumptions)

Total time: 125 minutes 26 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-Tests-4.x-Java7 #2065
Archived 3 artifacts
Archive block size is 32768
Received 0 blocks and 219561844 bytes
Compression is 0.0%
Took 36 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



Re: [JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 2066 - Failure

Posted by Chris Hostetter <ho...@fucit.org>.
: Something on 4.x changed in the last ~24 hours or so has started causing 
: all solr "Suggest" based tests to fail reliably, regardless of seed...

Hmmm... this fauses several failures for me everytime...

ant test  -Dtests.class=\*Suggest\*

But try any indiividual "reproduce with" line from those failures and they 
pass.


A quick poke at the code suggests that there is a problem of leaking 
write locks between tests?


There's some stupid exception handling in the solr factories thats masking 
the root problem by just throwing "new RuntimeException()", but it seems 
to be that in all the failures the calls like this...

      return new BlendedInfixSuggester(core.getSolrConfig().luceneMatchVersion, 
                                       FSDirectory.open(new File(indexPath)),
                                       indexAnalyzer, queryAnalyzer, minPrefixChars,
                                       blenderType, numFactor, true);

...are throwing IOExceptions due ot write.lock failures

   [junit4]    > Caused by: 
org.apache.lucene.store.LockObtainFailedException: Lock obtain timed out: 
NativeFSLock@/home/hossman/lucene/4x_dev/solr/build/solr-core/test/J1/blendedInfixDir1/write.lock
   [junit4]    > 	at 
org.apache.lucene.store.Lock.obtain(Lock.java:89)
   [junit4]    > 	at 
org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:756)
   [junit4]    > 	at 
org.apache.lucene.search.suggest.analyzing.AnalyzingInfixSuggester.<init>(AnalyzingInfixSuggester.java:185)
   [junit4]    > 	at 
org.apache.lucene.search.suggest.analyzing.BlendedInfixSuggester.<init>(BlendedInfixSuggester.java:115)
   [junit4]    > 	at 
org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:97)
   [junit4]    > 	... 12 more


...which smells like SOLR-6246, except that these tests aren't doing core 
reloads -- so who's got the write lock?

Looking at recent commits, LUCENE-5889 seems like the most likeley culprit 
for potentially introducing a related bug -- when i reverted it on 4x 
("svn merge -c -1619636 ." as of r1619866) these tests started passing 
again.







: 
: cd solr/core && ant test -Dtests.class=\*Suggest\*
: ...
:    [junit4] Tests with failures:
:    [junit4]   - org.apache.solr.spelling.suggest.TestAnalyzedSuggestions (suite)
:    [junit4]   - org.apache.solr.spelling.suggest.TestAnalyzeInfixSuggestions (suite)
:    [junit4]   - org.apache.solr.spelling.suggest.TestFuzzyAnalyzedSuggestions (suite)
:    [junit4]   - org.apache.solr.spelling.suggest.TestPhraseSuggestions (suite)
: 
: 
: The common problem seems to be related to SolrCore init? ...
: 
: org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: null
: ...
: Caused by: java.lang.RuntimeException
: 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
: 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
: 
: 
: ...anybody have any idea what happened here?
: 
: 
: 
: 
: 
: 
: 
: : Date: Fri, 22 Aug 2014 15:09:03 +0000 (UTC)
: : From: Apache Jenkins Server <je...@builds.apache.org>
: : Reply-To: dev@lucene.apache.org
: : To: dev@lucene.apache.org
: : Subject: [JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 2066 - Failure
: : 
: : Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/2066/
: : 
: : 7 tests failed.
: : FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.MultiThreadedOCPTest
: : 
: : Error Message:
: : 1 thread leaked from SUITE scope at org.apache.solr.cloud.MultiThreadedOCPTest:     1) Thread[id=5295, name=OverseerThreadFactory-2312-thread-5, state=TIMED_WAITING, group=Overseer collection creation process.]         at java.lang.Thread.sleep(Native Method)         at org.apache.solr.cloud.OverseerCollectionProcessor.waitForCoreNodeName(OverseerCollectionProcessor.java:1621)         at org.apache.solr.cloud.OverseerCollectionProcessor.splitShard(OverseerCollectionProcessor.java:1503)         at org.apache.solr.cloud.OverseerCollectionProcessor.processMessage(OverseerCollectionProcessor.java:565)         at org.apache.solr.cloud.OverseerCollectionProcessor$Runner.run(OverseerCollectionProcessor.java:2623)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:745)
: : 
: : Stack Trace:
: : com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.MultiThreadedOCPTest: 
: :    1) Thread[id=5295, name=OverseerThreadFactory-2312-thread-5, state=TIMED_WAITING, group=Overseer collection creation process.]
: :         at java.lang.Thread.sleep(Native Method)
: :         at org.apache.solr.cloud.OverseerCollectionProcessor.waitForCoreNodeName(OverseerCollectionProcessor.java:1621)
: :         at org.apache.solr.cloud.OverseerCollectionProcessor.splitShard(OverseerCollectionProcessor.java:1503)
: :         at org.apache.solr.cloud.OverseerCollectionProcessor.processMessage(OverseerCollectionProcessor.java:565)
: :         at org.apache.solr.cloud.OverseerCollectionProcessor$Runner.run(OverseerCollectionProcessor.java:2623)
: :         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
: :         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
: :         at java.lang.Thread.run(Thread.java:745)
: : 	at __randomizedtesting.SeedInfo.seed([41A319E125435502]:0)
: : 
: : 
: : REGRESSION:  org.apache.solr.cloud.OverseerTest.testOverseerFailure
: : 
: : Error Message:
: : Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
: : 
: : Stack Trace:
: : org.apache.solr.common.SolrException: Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
: : 	at __randomizedtesting.SeedInfo.seed([41A319E125435502:45AB961237E6BA23]:0)
: : 	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:150)
: : 	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:163)
: : 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:125)
: : 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:155)
: : 	at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:314)
: : 	at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:221)
: : 	at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:157)
: : 	at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:662)
: : 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
: : 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
: : 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
: : 	at java.lang.reflect.Method.invoke(Method.java:606)
: : 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
: : 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
: : 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
: : 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
: : 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
: : 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
: : 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
: : 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
: : 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
: : 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
: : 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
: : 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
: : 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: : 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
: : 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
: : 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
: : 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
: : 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
: : 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
: : 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
: : 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: : 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
: : 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
: : 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
: : 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
: : 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
: : 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
: : 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: : 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: : 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: : 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
: : 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
: : 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
: : 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
: : 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: : 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
: : 	at java.lang.Thread.run(Thread.java:745)
: : Caused by: org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
: : 	at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:40)
: : 	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:137)
: : 	... 48 more
: : Caused by: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
: : 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
: : 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
: : 	at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
: : 	at org.apache.solr.common.cloud.SolrZkClient$11.execute(SolrZkClient.java:462)
: : 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
: : 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:459)
: : 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:416)
: : 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:403)
: : 	at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:142)
: : 	at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:34)
: : 	... 49 more
: : 
: : 
: : FAILED:  junit.framework.TestSuite.org.apache.solr.spelling.suggest.TestAnalyzeInfixSuggestions
: : 
: : Error Message:
: : SolrCore 'collection1' is not available due to init failure: null
: : 
: : Stack Trace:
: : org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: null
: : 	at __randomizedtesting.SeedInfo.seed([41A319E125435502]:0)
: : 	at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:745)
: : 	at org.apache.solr.util.TestHarness.getCore(TestHarness.java:209)
: : 	at org.apache.solr.util.TestHarness$LocalRequestFactory.makeRequest(TestHarness.java:420)
: : 	at org.apache.solr.SolrTestCaseJ4.req(SolrTestCaseJ4.java:990)
: : 	at org.apache.solr.spelling.suggest.TestAnalyzeInfixSuggestions.beforeClass(TestAnalyzeInfixSuggestions.java:33)
: : 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
: : 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
: : 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
: : 	at java.lang.reflect.Method.invoke(Method.java:606)
: : 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
: : 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:767)
: : 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
: : 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: : 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
: : 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
: : 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
: : 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
: : 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
: : 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
: : 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: : 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: : 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: : 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
: : 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
: : 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
: : 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
: : 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: : 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
: : 	at java.lang.Thread.run(Thread.java:745)
: : Caused by: org.apache.solr.common.SolrException
: : 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
: : 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
: : 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
: : 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
: : 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
: : 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
: : 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
: : 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
: : 	... 1 more
: : Caused by: java.lang.RuntimeException
: : 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
: : 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
: : 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
: : 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
: : 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
: : 	... 8 more
: : 
: : 
: : FAILED:  junit.framework.TestSuite.org.apache.solr.spelling.suggest.TestFileDictionaryLookup
: : 
: : Error Message:
: : SolrCore 'collection1' is not available due to init failure: null
: : 
: : Stack Trace:
: : org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: null
: : 	at __randomizedtesting.SeedInfo.seed([41A319E125435502]:0)
: : 	at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:745)
: : 	at org.apache.solr.util.TestHarness.getCore(TestHarness.java:209)
: : 	at org.apache.solr.util.TestHarness$LocalRequestFactory.makeRequest(TestHarness.java:420)
: : 	at org.apache.solr.SolrTestCaseJ4.req(SolrTestCaseJ4.java:990)
: : 	at org.apache.solr.spelling.suggest.TestFileDictionaryLookup.beforeClass(TestFileDictionaryLookup.java:30)
: : 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
: : 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
: : 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
: : 	at java.lang.reflect.Method.invoke(Method.java:606)
: : 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
: : 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:767)
: : 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
: : 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: : 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
: : 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
: : 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
: : 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
: : 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
: : 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
: : 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: : 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: : 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: : 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
: : 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
: : 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
: : 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
: : 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: : 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
: : 	at java.lang.Thread.run(Thread.java:745)
: : Caused by: org.apache.solr.common.SolrException
: : 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
: : 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
: : 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
: : 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
: : 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
: : 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
: : 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
: : 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
: : 	... 1 more
: : Caused by: java.lang.RuntimeException
: : 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
: : 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
: : 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
: : 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
: : 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
: : 	... 8 more
: : 
: : 
: : FAILED:  junit.framework.TestSuite.org.apache.solr.spelling.suggest.TestFreeTextSuggestions
: : 
: : Error Message:
: : SolrCore 'collection1' is not available due to init failure: null
: : 
: : Stack Trace:
: : org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: null
: : 	at __randomizedtesting.SeedInfo.seed([41A319E125435502]:0)
: : 	at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:745)
: : 	at org.apache.solr.util.TestHarness.getCore(TestHarness.java:209)
: : 	at org.apache.solr.util.TestHarness$LocalRequestFactory.makeRequest(TestHarness.java:420)
: : 	at org.apache.solr.SolrTestCaseJ4.req(SolrTestCaseJ4.java:990)
: : 	at org.apache.solr.spelling.suggest.TestFreeTextSuggestions.beforeClass(TestFreeTextSuggestions.java:32)
: : 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
: : 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
: : 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
: : 	at java.lang.reflect.Method.invoke(Method.java:606)
: : 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
: : 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:767)
: : 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
: : 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: : 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
: : 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
: : 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
: : 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
: : 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
: : 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
: : 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: : 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: : 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: : 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
: : 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
: : 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
: : 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
: : 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: : 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
: : 	at java.lang.Thread.run(Thread.java:745)
: : Caused by: org.apache.solr.common.SolrException
: : 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
: : 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
: : 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
: : 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
: : 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
: : 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
: : 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
: : 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
: : 	... 1 more
: : Caused by: java.lang.RuntimeException
: : 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
: : 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
: : 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
: : 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
: : 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
: : 	... 8 more
: : 
: : 
: : FAILED:  junit.framework.TestSuite.org.apache.solr.spelling.suggest.TestFuzzyAnalyzedSuggestions
: : 
: : Error Message:
: : SolrCore 'collection1' is not available due to init failure: null
: : 
: : Stack Trace:
: : org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: null
: : 	at __randomizedtesting.SeedInfo.seed([41A319E125435502]:0)
: : 	at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:745)
: : 	at org.apache.solr.util.TestHarness.getCore(TestHarness.java:209)
: : 	at org.apache.solr.util.TestHarness$LocalRequestFactory.makeRequest(TestHarness.java:420)
: : 	at org.apache.solr.SolrTestCaseJ4.req(SolrTestCaseJ4.java:990)
: : 	at org.apache.solr.spelling.suggest.TestFuzzyAnalyzedSuggestions.beforeClass(TestFuzzyAnalyzedSuggestions.java:34)
: : 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
: : 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
: : 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
: : 	at java.lang.reflect.Method.invoke(Method.java:606)
: : 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
: : 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:767)
: : 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
: : 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: : 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
: : 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
: : 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
: : 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
: : 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
: : 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
: : 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: : 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: : 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: : 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
: : 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
: : 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
: : 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
: : 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: : 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
: : 	at java.lang.Thread.run(Thread.java:745)
: : Caused by: org.apache.solr.common.SolrException
: : 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
: : 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
: : 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
: : 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
: : 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
: : 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
: : 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
: : 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
: : 	... 1 more
: : Caused by: java.lang.RuntimeException
: : 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
: : 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
: : 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
: : 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
: : 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
: : 	... 8 more
: : 
: : 
: : FAILED:  junit.framework.TestSuite.org.apache.solr.spelling.suggest.TestHighFrequencyDictionaryFactory
: : 
: : Error Message:
: : SolrCore 'collection1' is not available due to init failure: null
: : 
: : Stack Trace:
: : org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: null
: : 	at __randomizedtesting.SeedInfo.seed([41A319E125435502]:0)
: : 	at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:745)
: : 	at org.apache.solr.util.TestHarness.getCoreInc(TestHarness.java:219)
: : 	at org.apache.solr.util.TestHarness.update(TestHarness.java:235)
: : 	at org.apache.solr.util.BaseTestHarness.checkUpdateStatus(BaseTestHarness.java:282)
: : 	at org.apache.solr.util.BaseTestHarness.validateUpdate(BaseTestHarness.java:252)
: : 	at org.apache.solr.SolrTestCaseJ4.checkUpdateU(SolrTestCaseJ4.java:663)
: : 	at org.apache.solr.SolrTestCaseJ4.assertU(SolrTestCaseJ4.java:642)
: : 	at org.apache.solr.SolrTestCaseJ4.assertU(SolrTestCaseJ4.java:636)
: : 	at org.apache.solr.spelling.suggest.TestHighFrequencyDictionaryFactory.beforeClass(TestHighFrequencyDictionaryFactory.java:32)
: : 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
: : 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
: : 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
: : 	at java.lang.reflect.Method.invoke(Method.java:606)
: : 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
: : 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:767)
: : 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
: : 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: : 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
: : 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
: : 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
: : 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
: : 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
: : 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
: : 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: : 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: : 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: : 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
: : 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
: : 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
: : 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
: : 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: : 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
: : 	at java.lang.Thread.run(Thread.java:745)
: : Caused by: org.apache.solr.common.SolrException
: : 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
: : 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
: : 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
: : 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
: : 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
: : 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
: : 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
: : 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
: : 	... 1 more
: : Caused by: java.lang.RuntimeException
: : 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
: : 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
: : 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
: : 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
: : 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
: : 	... 8 more
: : 
: : 
: : 
: : 
: : Build Log:
: : [...truncated 11256 lines...]
: :    [junit4] Suite: org.apache.solr.spelling.suggest.TestFreeTextSuggestions
: :    [junit4]   2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-41A319E125435502-001/init-core-data-001
: :    [junit4]   2> 317220 T506 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (true)
: :    [junit4]   2> 317221 T506 oas.SolrTestCaseJ4.initCore ####initCore
: :    [junit4]   2> 317221 T506 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/'
: :    [junit4]   2> 317223 T506 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
: :    [junit4]   2> 317223 T506 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/README' to classloader
: :    [junit4]   2> 317224 T506 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
: :    [junit4]   2> 317321 T506 oasc.SolrConfig.<init> Using Lucene MatchVersion: 4.11.0
: :    [junit4]   2> 317361 T506 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-phrasesuggest.xml
: :    [junit4]   2> 317362 T506 oass.IndexSchema.readSchema Reading Solr Schema from schema-phrasesuggest.xml
: :    [junit4]   2> 317370 T506 oass.IndexSchema.readSchema [null] Schema name=test
: :    [junit4]   2> 317396 T506 oass.IndexSchema.readSchema default search field in schema is text
: :    [junit4]   2> 317397 T506 oass.IndexSchema.readSchema unique key field: id
: :    [junit4]   2> 317398 T506 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
: :    [junit4]   2> 317398 T506 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr
: :    [junit4]   2> 317399 T506 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/'
: :    [junit4]   2> 317445 T506 oasc.CoreContainer.<init> New CoreContainer 612440481
: :    [junit4]   2> 317446 T506 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/]
: :    [junit4]   2> 317447 T506 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
: :    [junit4]   2> 317447 T506 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
: :    [junit4]   2> 317447 T506 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
: :    [junit4]   2> 317447 T506 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
: :    [junit4]   2> 317448 T506 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
: :    [junit4]   2> 317448 T506 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
: :    [junit4]   2> 317448 T506 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
: :    [junit4]   2> 317448 T506 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
: :    [junit4]   2> 317449 T506 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
: :    [junit4]   2> 317449 T506 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=30000&connTimeout=30000&retry=false
: :    [junit4]   2> 317449 T506 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
: :    [junit4]   2> 317449 T506 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
: :    [junit4]   2> 317450 T506 oasc.CoreContainer.load Host Name: 
: :    [junit4]   2> 317454 T507 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/'
: :    [junit4]   2> 317456 T507 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
: :    [junit4]   2> 317456 T507 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/README' to classloader
: :    [junit4]   2> 317456 T507 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
: :    [junit4]   2> 317557 T507 oasc.SolrConfig.<init> Using Lucene MatchVersion: 4.11.0
: :    [junit4]   2> 317623 T507 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-phrasesuggest.xml
: :    [junit4]   2> 317624 T507 oass.IndexSchema.readSchema Reading Solr Schema from schema-phrasesuggest.xml
: :    [junit4]   2> 317631 T507 oass.IndexSchema.readSchema [collection1] Schema name=test
: :    [junit4]   2> 317660 T507 oass.IndexSchema.readSchema default search field in schema is text
: :    [junit4]   2> 317662 T507 oass.IndexSchema.readSchema unique key field: id
: :    [junit4]   2> 317664 T507 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/
: :    [junit4]   2> 317664 T507 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
: :    [junit4]   2> 317664 T507 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-41A319E125435502-001/init-core-data-001/
: :    [junit4]   2> 317664 T507 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
: :    [junit4]   2> 317665 T507 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-41A319E125435502-001/init-core-data-001
: :    [junit4]   2> 317665 T507 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-41A319E125435502-001/init-core-data-001/index/
: :    [junit4]   2> 317666 T507 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-41A319E125435502-001/init-core-data-001/index' doesn't exist. Creating new index...
: :    [junit4]   2> 317667 T507 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-41A319E125435502-001/init-core-data-001/index
: :    [junit4]   2> 317667 T507 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=37, maxMergedSegmentMB=73.5712890625, floorSegmentMB=0.76171875, forceMergeDeletesPctAllowed=9.551670063104096, segmentsPerTier=31.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
: :    [junit4]   2> 317668 T507 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
: :    [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@c56677c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5bb89ea),segFN=segments_1,generation=1}
: :    [junit4]   2> 317668 T507 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
: :    [junit4]   2> 317670 T507 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
: :    [junit4]   2> 317670 T507 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
: :    [junit4]   2> 317671 T507 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
: :    [junit4]   2> 317671 T507 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
: :    [junit4]   2> 317671 T507 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
: :    [junit4]   2> 317672 T507 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
: :    [junit4]   2> 317672 T507 oasc.RequestHandlers.initHandlersFromConfig created /suggest_wfst: org.apache.solr.handler.component.SearchHandler
: :    [junit4]   2> 317672 T507 oasc.RequestHandlers.initHandlersFromConfig created /suggest_analyzing: org.apache.solr.handler.component.SearchHandler
: :    [junit4]   2> 317673 T507 oasc.RequestHandlers.initHandlersFromConfig created /infix_suggest_analyzing: org.apache.solr.handler.component.SearchHandler
: :    [junit4]   2> 317673 T507 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_file_dict: org.apache.solr.handler.component.SearchHandler
: :    [junit4]   2> 317673 T507 oasc.RequestHandlers.initHandlersFromConfig created /blended_infix_suggest: org.apache.solr.handler.component.SearchHandler
: :    [junit4]   2> 317674 T507 oasc.RequestHandlers.initHandlersFromConfig created /free_text_suggest: org.apache.solr.handler.component.SearchHandler
: :    [junit4]   2> 317674 T507 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_high_freq_dict: org.apache.solr.handler.component.SearchHandler
: :    [junit4]   2> 317674 T507 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing: org.apache.solr.handler.component.SearchHandler
: :    [junit4]   2> 317674 T507 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_max_edit_2: org.apache.solr.handler.component.SearchHandler
: :    [junit4]   2> 317675 T507 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_non_fuzzy_prefix_4: org.apache.solr.handler.component.SearchHandler
: :    [junit4]   2> 317675 T507 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_min_fuzzy_length_2: org.apache.solr.handler.component.SearchHandler
: :    [junit4]   2> 317703 T507 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
: :    [junit4]   2> 317705 T507 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
: :    [junit4]   2> 317707 T507 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
: :    [junit4]   2> 317709 T507 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
: :    [junit4]   2> 317713 T507 oasu.CommitTracker.<init> Hard AutoCommit: disabled
: :    [junit4]   2> 317713 T507 oasu.CommitTracker.<init> Soft AutoCommit: disabled
: :    [junit4]   2> 317713 T507 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=21, maxMergeAtOnceExplicit=37, maxMergedSegmentMB=49.3046875, floorSegmentMB=0.693359375, forceMergeDeletesPctAllowed=3.635932570392315, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
: :    [junit4]   2> 317714 T507 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
: :    [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@c56677c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5bb89ea),segFN=segments_1,generation=1}
: :    [junit4]   2> 317714 T507 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
: :    [junit4]   2> 317715 T507 oass.SolrIndexSearcher.<init> Opening Searcher@7019cd0b[collection1] main
: :    [junit4]   2> 317716 T507 oasr.ManagedResourceStorage.newStorageIO WARN Cannot write to config directory /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
: :    [junit4]   2> 317716 T507 oasr.RestManager.init Initializing RestManager with initArgs: {}
: :    [junit4]   2> 317716 T507 oasr.ManagedResourceStorage.load Reading _rest_managed.json using InMemoryStorage
: :    [junit4]   2> 317716 T507 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
: :    [junit4]   2> 317717 T507 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using InMemoryStorage
: :    [junit4]   2> 317717 T507 oasr.RestManager.init Initializing 0 registered ManagedResources
: :    [junit4]   2> 317717 T507 oashc.SpellCheckComponent.inform Initializing spell checkers
: :    [junit4]   2> 317717 T507 oasss.Suggester.init init: {name=suggest_wfst,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.WFSTLookupFactory,storeDir=suggest_wfst,buildOnCommit=false,exactMatchFirst=true,sourceLocation=phrasesuggest.txt}
: :    [junit4]   2> 317720 T507 oashc.SpellCheckComponent.inform Initializing spell checkers
: :    [junit4]   2> 317720 T507 oasss.Suggester.init init: {name=suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingLookupFactory,storeDir=suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=ja_suggest,preserveSep=false,sourceLocation=jasuggest.txt}
: :    [junit4]   2> 317721 T507 oashc.SpellCheckComponent.inform Initializing spell checkers
: :    [junit4]   2> 317722 T507 oasss.Suggester.init init: {name=infix_suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingInfixLookupFactory,buildOnCommit=false,suggestAnalyzerFieldType=text,sourceLocation=analyzingInfixSuggest.txt}
: :    [junit4]   2> 317723 T507 oashc.SuggestComponent.inform Initializing SuggestComponent
: :    [junit4]   2> 317723 T507 oasss.SolrSuggester.init init: {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
: :    [junit4]   2> 317725 T507 oasss.SolrSuggester.init Dictionary loaded with params: {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
: :    [junit4]   2> 317725 T507 oashc.SuggestComponent.inform Initializing SuggestComponent
: :    [junit4]   2> 317725 T507 oasss.SolrSuggester.init init: {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator= ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
: :    [junit4]   2> 317726 T507 oasss.SolrSuggester.init Dictionary loaded with params: {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator= ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
: :    [junit4]   2> 317727 T507 oashc.SuggestComponent.inform Initializing SuggestComponent
: :    [junit4]   2> 317727 T507 oasss.SolrSuggester.init init: {name=blended_infix_suggest_linear,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=FileDictionaryFactory,buildOnCommit=false,sourceLocation=blendedInfixSuggest.txt,indexPath=blendedInfixDir1,blenderType=linear,suggestAnalyzerFieldType=text}
: :    [junit4]   2> 318731 T507 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@6af5dbe
: :    [junit4]   2> 318731 T508 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7019cd0b[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
: :    [junit4]   2> 318731 T507 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
: :    [junit4]   2> 318732 T507 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
: :    [junit4]   2> 318732 T507 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
: :    [junit4]   2> 318732 T507 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
: :    [junit4]   2> 318733 T507 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
: :    [junit4]   2> 318733 T507 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
: :    [junit4]   2> 318733 T507 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-41A319E125435502-001/init-core-data-001/index [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-41A319E125435502-001/init-core-data-001/index;done=false>>]
: :    [junit4]   2> 318734 T507 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-41A319E125435502-001/init-core-data-001/index
: :    [junit4]   2> 318734 T507 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-41A319E125435502-001/init-core-data-001 [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-41A319E125435502-001/init-core-data-001;done=false>>]
: :    [junit4]   2> 318734 T507 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-41A319E125435502-001/init-core-data-001
: :    [junit4]   2> 318742 T507 oasc.CoreContainer.create ERROR Error creating core [collection1]: null org.apache.solr.common.SolrException
: :    [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
: :    [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
: :    [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
: :    [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
: :    [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
: :    [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
: :    [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
: :    [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
: :    [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
: :    [junit4]   2> Caused by: java.lang.RuntimeException
: :    [junit4]   2> 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
: :    [junit4]   2> 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
: :    [junit4]   2> 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
: :    [junit4]   2> 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
: :    [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
: :    [junit4]   2> 	... 8 more
: :    [junit4]   2> 
: :    [junit4]   2> 318745 T506 oas.SolrTestCaseJ4.initCore ####initCore end
: :    [junit4]   2> 318745 T506 oas.SolrTestCaseJ4.deleteCore ###deleteCore
: :    [junit4]   2> 318746 T506 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=612440481
: :    [junit4]   2> NOTE: test params are: codec=Lucene49, sim=DefaultSimilarity, locale=tr_TR, timezone=SystemV/AST4ADT
: :    [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_60 (64-bit)/cpus=16,threads=1,free=256741160,total=361758720
: :    [junit4]   2> NOTE: All tests run in this JVM: [AddSchemaFieldsUpdateProcessorFactoryTest, DebugComponentTest, ClusterStateUpdateTest, TestReload, ZkControllerTest, TestWriterPerf, TestRecovery, TestIntervalFaceting, TestDynamicFieldCollectionResource, TestPivotHelperCode, TestMaxScoreQueryParser, TestSchemaSimilarityResource, TestPerFieldSimilarity, TestSolrQueryParser, IndexSchemaRuntimeFieldTest, SampleTest, TestSchemaVersionResource, TestQuerySenderListener, CollectionsAPIAsyncDistributedZkTest, TestInfoStreamLogging, TestBlendedInfixSuggestions, TestFieldCollectionResource, TestFieldResource, HttpPartitionTest, TestFreeTextSuggestions]
: :    [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestFreeTextSuggestions -Dtests.seed=41A319E125435502 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=tr_TR -Dtests.timezone=SystemV/AST4ADT -Dtests.file.encoding=US-ASCII
: :    [junit4] ERROR   0.00s J0 | TestFreeTextSuggestions (suite) <<<
: :    [junit4]    > Throwable #1: org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: null
: :    [junit4]    > 	at __randomizedtesting.SeedInfo.seed([41A319E125435502]:0)
: :    [junit4]    > 	at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:745)
: :    [junit4]    > 	at org.apache.solr.util.TestHarness.getCore(TestHarness.java:209)
: :    [junit4]    > 	at org.apache.solr.util.TestHarness$LocalRequestFactory.makeRequest(TestHarness.java:420)
: :    [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.req(SolrTestCaseJ4.java:990)
: :    [junit4]    > 	at org.apache.solr.spelling.suggest.TestFreeTextSuggestions.beforeClass(TestFreeTextSuggestions.java:32)
: :    [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
: :    [junit4]    > Caused by: org.apache.solr.common.SolrException
: :    [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
: :    [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
: :    [junit4]    > 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
: :    [junit4]    > 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
: :    [junit4]    > 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
: :    [junit4]    > 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
: :    [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
: :    [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
: :    [junit4]    > 	... 1 more
: :    [junit4]    > Caused by: java.lang.RuntimeException
: :    [junit4]    > 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
: :    [junit4]    > 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
: :    [junit4]    > 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
: :    [junit4]    > 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
: :    [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
: :    [junit4]    > 	... 8 more
: :    [junit4] Completed on J0 in 1.60s, 0 tests, 1 error <<< FAILURES!
: : 
: : [...truncated 140 lines...]
: :    [junit4] Suite: org.apache.solr.spelling.suggest.TestFuzzyAnalyzedSuggestions
: :    [junit4]   2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-41A319E125435502-001/init-core-data-001
: :    [junit4]   2> 578472 T1491 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (true)
: :    [junit4]   2> 578473 T1491 oas.SolrTestCaseJ4.initCore ####initCore
: :    [junit4]   2> 578473 T1491 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/'
: :    [junit4]   2> 578474 T1491 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
: :    [junit4]   2> 578475 T1491 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/README' to classloader
: :    [junit4]   2> 578475 T1491 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
: :    [junit4]   2> 578561 T1491 oasc.SolrConfig.<init> Using Lucene MatchVersion: 4.11.0
: :    [junit4]   2> 578603 T1491 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-phrasesuggest.xml
: :    [junit4]   2> 578604 T1491 oass.IndexSchema.readSchema Reading Solr Schema from schema-phrasesuggest.xml
: :    [junit4]   2> 578609 T1491 oass.IndexSchema.readSchema [null] Schema name=test
: :    [junit4]   2> 578629 T1491 oass.IndexSchema.readSchema default search field in schema is text
: :    [junit4]   2> 578630 T1491 oass.IndexSchema.readSchema unique key field: id
: :    [junit4]   2> 578631 T1491 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
: :    [junit4]   2> 578631 T1491 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr
: :    [junit4]   2> 578632 T1491 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/'
: :    [junit4]   2> 578676 T1491 oasc.CoreContainer.<init> New CoreContainer 1482249818
: :    [junit4]   2> 578676 T1491 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/]
: :    [junit4]   2> 578677 T1491 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
: :    [junit4]   2> 578677 T1491 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
: :    [junit4]   2> 578678 T1491 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
: :    [junit4]   2> 578678 T1491 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
: :    [junit4]   2> 578678 T1491 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
: :    [junit4]   2> 578678 T1491 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
: :    [junit4]   2> 578678 T1491 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
: :    [junit4]   2> 578679 T1491 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
: :    [junit4]   2> 578679 T1491 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
: :    [junit4]   2> 578679 T1491 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=30000&connTimeout=30000&retry=false
: :    [junit4]   2> 578679 T1491 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
: :    [junit4]   2> 578680 T1491 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
: :    [junit4]   2> 578680 T1491 oasc.CoreContainer.load Host Name: 
: :    [junit4]   2> 578684 T1492 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/'
: :    [junit4]   2> 578685 T1492 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
: :    [junit4]   2> 578686 T1492 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/README' to classloader
: :    [junit4]   2> 578686 T1492 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
: :    [junit4]   2> 578745 T1492 oasc.SolrConfig.<init> Using Lucene MatchVersion: 4.11.0
: :    [junit4]   2> 578823 T1492 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-phrasesuggest.xml
: :    [junit4]   2> 578824 T1492 oass.IndexSchema.readSchema Reading Solr Schema from schema-phrasesuggest.xml
: :    [junit4]   2> 578831 T1492 oass.IndexSchema.readSchema [collection1] Schema name=test
: :    [junit4]   2> 578856 T1492 oass.IndexSchema.readSchema default search field in schema is text
: :    [junit4]   2> 578858 T1492 oass.IndexSchema.readSchema unique key field: id
: :    [junit4]   2> 578859 T1492 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/
: :    [junit4]   2> 578859 T1492 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
: :    [junit4]   2> 578859 T1492 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-41A319E125435502-001/init-core-data-001/
: :    [junit4]   2> 578860 T1492 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
: :    [junit4]   2> 578860 T1492 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-41A319E125435502-001/init-core-data-001
: :    [junit4]   2> 578861 T1492 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-41A319E125435502-001/init-core-data-001/index/
: :    [junit4]   2> 578861 T1492 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-41A319E125435502-001/init-core-data-001/index' doesn't exist. Creating new index...
: :    [junit4]   2> 578861 T1492 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-41A319E125435502-001/init-core-data-001/index
: :    [junit4]   2> 578862 T1492 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=27, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
: :    [junit4]   2> 578863 T1492 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
: :    [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@7c9e4a46 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@324787a1),segFN=segments_1,generation=1}
: :    [junit4]   2> 578863 T1492 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
: :    [junit4]   2> 578865 T1492 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
: :    [junit4]   2> 578865 T1492 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
: :    [junit4]   2> 578866 T1492 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
: :    [junit4]   2> 578866 T1492 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
: :    [junit4]   2> 578866 T1492 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
: :    [junit4]   2> 578867 T1492 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
: :    [junit4]   2> 578867 T1492 oasc.RequestHandlers.initHandlersFromConfig created /suggest_wfst: org.apache.solr.handler.component.SearchHandler
: :    [junit4]   2> 578867 T1492 oasc.RequestHandlers.initHandlersFromConfig created /suggest_analyzing: org.apache.solr.handler.component.SearchHandler
: :    [junit4]   2> 578868 T1492 oasc.RequestHandlers.initHandlersFromConfig created /infix_suggest_analyzing: org.apache.solr.handler.component.SearchHandler
: :    [junit4]   2> 578868 T1492 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_file_dict: org.apache.solr.handler.component.SearchHandler
: :    [junit4]   2> 578868 T1492 oasc.RequestHandlers.initHandlersFromConfig created /blended_infix_suggest: org.apache.solr.handler.component.SearchHandler
: :    [junit4]   2> 578869 T1492 oasc.RequestHandlers.initHandlersFromConfig created /free_text_suggest: org.apache.solr.handler.component.SearchHandler
: :    [junit4]   2> 578869 T1492 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_high_freq_dict: org.apache.solr.handler.component.SearchHandler
: :    [junit4]   2> 578869 T1492 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing: org.apache.solr.handler.component.SearchHandler
: :    [junit4]   2> 578870 T1492 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_max_edit_2: org.apache.solr.handler.component.SearchHandler
: :    [junit4]   2> 578870 T1492 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_non_fuzzy_prefix_4: org.apache.solr.handler.component.SearchHandler
: :    [junit4]   2> 578870 T1492 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_min_fuzzy_length_2: org.apache.solr.handler.component.SearchHandler
: :    [junit4]   2> 578888 T1492 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
: :    [junit4]   2> 578890 T1492 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
: :    [junit4]   2> 578892 T1492 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
: :    [junit4]   2> 578894 T1492 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
: :    [junit4]   2> 578897 T1492 oasu.CommitTracker.<init> Hard AutoCommit: disabled
: :    [junit4]   2> 578898 T1492 oasu.CommitTracker.<init> Soft AutoCommit: disabled
: :    [junit4]   2> 578898 T1492 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=48, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.31149779368116737]
: :    [junit4]   2> 578899 T1492 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
: :    [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@7c9e4a46 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@324787a1),segFN=segments_1,generation=1}
: :    [junit4]   2> 578899 T1492 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
: :    [junit4]   2> 578899 T1492 oass.SolrIndexSearcher.<init> Opening Searcher@59329086[collection1] main
: :    [junit4]   2> 578900 T1492 oasr.ManagedResourceStorage.newStorageIO WARN Cannot write to config directory /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
: :    [junit4]   2> 578900 T1492 oasr.RestManager.init Initializing RestManager with initArgs: {}
: :    [junit4]   2> 578901 T1492 oasr.ManagedResourceStorage.load Reading _rest_managed.json using InMemoryStorage
: :    [junit4]   2> 578901 T1492 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
: :    [junit4]   2> 578901 T1492 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using InMemoryStorage
: :    [junit4]   2> 578901 T1492 oasr.RestManager.init Initializing 0 registered ManagedResources
: :    [junit4]   2> 578902 T1492 oashc.SpellCheckComponent.inform Initializing spell checkers
: :    [junit4]   2> 578902 T1492 oasss.Suggester.init init: {name=suggest_wfst,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.WFSTLookupFactory,storeDir=suggest_wfst,buildOnCommit=false,exactMatchFirst=true,sourceLocation=phrasesuggest.txt}
: :    [junit4]   2> 578904 T1492 oashc.SpellCheckComponent.inform Initializing spell checkers
: :    [junit4]   2> 578904 T1492 oasss.Suggester.init init: {name=suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingLookupFactory,storeDir=suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=ja_suggest,preserveSep=false,sourceLocation=jasuggest.txt}
: :    [junit4]   2> 578905 T1492 oashc.SpellCheckComponent.inform Initializing spell checkers
: :    [junit4]   2> 578905 T1492 oasss.Suggester.init init: {name=infix_suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingInfixLookupFactory,buildOnCommit=false,suggestAnalyzerFieldType=text,sourceLocation=analyzingInfixSuggest.txt}
: :    [junit4]   2> 578906 T1492 oashc.SuggestComponent.inform Initializing SuggestComponent
: :    [junit4]   2> 578907 T1492 oasss.SolrSuggester.init init: {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
: :    [junit4]   2> 578908 T1492 oasss.SolrSuggester.init Dictionary loaded with params: {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
: :    [junit4]   2> 578908 T1492 oashc.SuggestComponent.inform Initializing SuggestComponent
: :    [junit4]   2> 578908 T1492 oasss.SolrSuggester.init init: {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator= ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
: :    [junit4]   2> 578909 T1492 oasss.SolrSuggester.init Dictionary loaded with params: {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator= ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
: :    [junit4]   2> 578910 T1492 oashc.SuggestComponent.inform Initializing SuggestComponent
: :    [junit4]   2> 578910 T1492 oasss.SolrSuggester.init init: {name=blended_infix_suggest_linear,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=FileDictionaryFactory,buildOnCommit=false,sourceLocation=blendedInfixSuggest.txt,indexPath=blendedInfixDir1,blenderType=linear,suggestAnalyzerFieldType=text}
: :    [junit4]   2> 579918 T1492 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@6ae7b2a
: :    [junit4]   2> 579918 T1493 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@59329086[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
: :    [junit4]   2> 579918 T1492 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
: :    [junit4]   2> 579919 T1492 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
: :    [junit4]   2> 579919 T1492 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
: :    [junit4]   2> 579919 T1492 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
: :    [junit4]   2> 579920 T1492 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
: :    [junit4]   2> 579920 T1492 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
: :    [junit4]   2> 579920 T1492 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-41A319E125435502-001/init-core-data-001 [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-41A319E125435502-001/init-core-data-001;done=false>>]
: :    [junit4]   2> 579920 T1492 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-41A319E125435502-001/init-core-data-001
: :    [junit4]   2> 579921 T1492 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-41A319E125435502-001/init-core-data-001/index [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-41A319E125435502-001/init-core-data-001/index;done=false>>]
: :    [junit4]   2> 579921 T1492 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-41A319E125435502-001/init-core-data-001/index
: :    [junit4]   2> 579921 T1492 oasc.CoreContainer.create ERROR Error creating core [collection1]: null org.apache.solr.common.SolrException
: :    [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
: :    [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
: :    [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
: :    [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
: :    [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
: :    [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
: :    [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
: :    [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
: :    [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
: :    [junit4]   2> Caused by: java.lang.RuntimeException
: :    [junit4]   2> 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
: :    [junit4]   2> 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
: :    [junit4]   2> 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
: :    [junit4]   2> 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
: :    [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
: :    [junit4]   2> 	... 8 more
: :    [junit4]   2> 
: :    [junit4]   2> 579925 T1491 oas.SolrTestCaseJ4.initCore ####initCore end
: :    [junit4]   2> 579925 T1491 oas.SolrTestCaseJ4.deleteCore ###deleteCore
: :    [junit4]   2> 579926 T1491 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1482249818
: :    [junit4]   2> NOTE: test params are: codec=Lucene45, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=zh_TW, timezone=America/Blanc-Sablon
: :    [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_60 (64-bit)/cpus=16,threads=1,free=340470168,total=520093696
: :    [junit4]   2> NOTE: All tests run in this JVM: [AddSchemaFieldsUpdateProcessorFactoryTest, DebugComponentTest, ClusterStateUpdateTest, TestReload, ZkControllerTest, TestWriterPerf, TestRecovery, TestIntervalFaceting, TestDynamicFieldCollectionResource, TestPivotHelperCode, TestMaxScoreQueryParser, TestSchemaSimilarityResource, TestPerFieldSimilarity, TestSolrQueryParser, IndexSchemaRuntimeFieldTest, SampleTest, TestSchemaVersionResource, TestQuerySenderListener, CollectionsAPIAsyncDistributedZkTest, TestInfoStreamLogging, TestBlendedInfixSuggestions, TestFieldCollectionResource, TestFieldResource, HttpPartitionTest, TestFreeTextSuggestions, TestExceedMaxTermLength, TestRecoveryHdfs, StatelessScriptUpdateProcessorFactoryTest, TestBinaryResponseWriter, TestLeaderElectionZkExpiry, XsltUpdateRequestHandlerTest, TestReversedWildcardFilterFactory, TestSolrCoreProperties, AliasIntegrationTest, TestBM25SimilarityFactory, QueryParsingTest, DeleteReplicaTest, CustomCollectionTest, TestR
 eloadAndDeleteDocs, CachingDirectoryFactoryTest, IndexBasedSpellCheckerTest, TestQuerySenderNoQuery, ResourceLoaderTest, MinimalSchemaTest, InfoHandlerTest, NumericFieldsTest, SolrPluginUtilsTest, TestManagedStopFilterFactory, TestFuzzyAnalyzedSuggestions]
: :    [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestFuzzyAnalyzedSuggestions -Dtests.seed=41A319E125435502 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=zh_TW -Dtests.timezone=America/Blanc-Sablon -Dtests.file.encoding=US-ASCII
: :    [junit4] ERROR   0.00s J0 | TestFuzzyAnalyzedSuggestions (suite) <<<
: :    [junit4]    > Throwable #1: org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: null
: :    [junit4]    > 	at __randomizedtesting.SeedInfo.seed([41A319E125435502]:0)
: :    [junit4]    > 	at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:745)
: :    [junit4]    > 	at org.apache.solr.util.TestHarness.getCore(TestHarness.java:209)
: :    [junit4]    > 	at org.apache.solr.util.TestHarness$LocalRequestFactory.makeRequest(TestHarness.java:420)
: :    [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.req(SolrTestCaseJ4.java:990)
: :    [junit4]    > 	at org.apache.solr.spelling.suggest.TestFuzzyAnalyzedSuggestions.beforeClass(TestFuzzyAnalyzedSuggestions.java:34)
: :    [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
: :    [junit4]    > Caused by: org.apache.solr.common.SolrException
: :    [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
: :    [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
: :    [junit4]    > 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
: :    [junit4]    > 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
: :    [junit4]    > 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
: :    [junit4]    > 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
: :    [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
: :    [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
: :    [junit4]    > 	... 1 more
: :    [junit4]    > Caused by: java.lang.RuntimeException
: :    [junit4]    > 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
: :    [junit4]    > 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
: :    [junit4]    > 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
: :    [junit4]    > 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
: :    [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
: :    [junit4]    > 	... 8 more
: :    [junit4] Completed on J0 in 1.49s, 0 tests, 1 error <<< FAILURES!
: : 
: : [...truncated 293 lines...]
: :    [junit4] Suite: org.apache.solr.cloud.OverseerTest
: :    [junit4]   2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.OverseerTest-41A319E125435502-001/init-core-data-001
: :    [junit4]   2> 2078956 T4164 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
: :    [junit4]   2> 2078956 T4164 oas.SolrTestCaseJ4.initCore ####initCore
: :    [junit4]   2> 2078957 T4164 oas.SolrTestCaseJ4.initCore ####initCore end
: :    [junit4]   2> 2078961 T4164 oas.SolrTestCaseJ4.setUp ###Starting testReplay
: :    [junit4]   2> 2078962 T4164 oasc.ZkTestServer.run STARTING ZK TEST SERVER
: :    [junit4]   1> client port:0.0.0.0/0.0.0.0:0
: :    [junit4]   2> 2078963 T4165 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
: :    [junit4]   2> 2079063 T4164 oasc.ZkTestServer.run start zk server on port:30697
: :    [junit4]   2> 2079064 T4164 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
: :    [junit4]   2> 2079068 T4171 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2c6f62bf name:ZooKeeperConnection Watcher:127.0.0.1:30697/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
: :    [junit4]   2> 2079069 T4164 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
: :    [junit4]   2> 2079069 T4164 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
: :    [junit4]   2> 2079072 T4173 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3a715d1c name:ZooKeeperConnection Watcher:127.0.0.1:30697 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
: :    [junit4]   2> 2079072 T4164 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
: :    [junit4]   2> 2079075 T4164 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
: :    [junit4]   2> 2079076 T4175 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a474341 name:ZooKeeperConnection Watcher:127.0.0.1:30697 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
: :    [junit4]   2> 2079076 T4164 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
: :    [junit4]   2> 2079077 T4164 oascc.SolrZkClient.makePath makePath: /solr
: :    [junit4]   2> 2079080 T4164 oascc.SolrZkClient.makePath makePath: /live_nodes
: :    [junit4]   2> 2079082 T4164 oascc.SolrZkClient.makePath makePath: /clusterstate.json
: :    [junit4]   2> 2079083 T4164 oascc.SolrZkClient.makePath makePath: /aliases.json
: :    [junit4]   2> 2079084 T4164 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
: :    [junit4]   2> 2079086 T4164 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
: :    [junit4]   2> 2079089 T4164 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
: :    [junit4]   2> 2079090 T4177 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@592e7c3f name:ZooKeeperConnection Watcher:127.0.0.1:30697/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
: :    [junit4]   2> 2079090 T4164 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
: :    [junit4]   2> 2079091 T4164 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: retry=false
: :    [junit4]   2> 2079095 T4164 oascc.SolrZkClient.makePath makePath: /overseer_elect
: :    [junit4]   2> 2079096 T4164 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
: :    [junit4]   2> 2079097 T4164 oasc.Overseer.close Overseer (id=null) closing
: :    [junit4]   2> 2079099 T4164 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:30697_solr
: :    [junit4]   2> 2079099 T4164 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
: :    [junit4]   2> 2079100 T4164 oasc.Overseer.start Overseer (id=92321677498122243-127.0.0.1:30697_solr-n_0000000000) starting
: :    [junit4]   2> 2079102 T4164 oascc.SolrZkClient.makePath makePath: /overseer/queue
: :    [junit4]   2> 2079104 T4164 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
: :    [junit4]   2> 2079106 T4164 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
: :    [junit4]   2> 2079107 T4164 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
: :    [junit4]   2> 2079109 T4164 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
: :    [junit4]   2> 2079113 T4164 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
: :    [junit4]   2> 2079113 T4179 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
: :    [junit4]   2> 2079115 T4178 oasc.Overseer$ClusterStateUpdater.run Replaying operations from work queue.
: :    [junit4]   2> 2079115 T4178 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
: :    [junit4]   2> 	  "operation":"state",
: :    [junit4]   2> 	  "base_url":"http://127.0.0.1/solr",
: :    [junit4]   2> 	  "node_name":"node1",
: :    [junit4]   2> 	  "shard":"s1",
: :    [junit4]   2> 	  "collection":"collection1",
: :    [junit4]   2> 	  "core":"core1",
: :    [junit4]   2> 	  "roles":"",
: :    [junit4]   2> 	  "state":"recovering"}
: :    [junit4]   2> 2079116 T4181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
: :    [junit4]   2> 2079118 T4178 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
: :    [junit4]   2> 	  "operation":"state",
: :    [junit4]   2> 	  "base_url":"http://127.0.0.1/solr",
: :    [junit4]   2> 	  "node_name":"node1",
: :    [junit4]   2> 	  "shard":"s1",
: :    [junit4]   2> 	  "collection":"collection1",
: :    [junit4]   2> 	  "core":"core2",
: :    [junit4]   2> 	  "roles":"",
: :    [junit4]   2> 	  "state":"recovering"}
: :    [junit4]   2> 2079119 T4181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
: :    [junit4]   2> 2079120 T4178 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
: :    [junit4]   2> 2079121 T4178 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
: :    [junit4]   2> 	  "operation":"state",
: :    [junit4]   2> 	  "base_url":"http://127.0.0.1/solr",
: :    [junit4]   2> 	  "node_name":"node1",
: :    [junit4]   2> 	  "shard":"s1",
: :    [junit4]   2> 	  "collection":"collection1",
: :    [junit4]   2> 	  "core":"core3",
: :    [junit4]   2> 	  "roles":"",
: :    [junit4]   2> 	  "state":"recovering"}
: :    [junit4]   2> 2079123 T4182 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
: :    [junit4]   2> 2079123 T4181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
: :    [junit4]   2> 2079219 T4164 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:30697 30697
: :    [junit4]   2> 2079416 T4165 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:30697 30697
: :    [junit4]   2> 2079419 T4164 oas.SolrTestCaseJ4.tearDown ###Ending testReplay
: :    [junit4]   2> 2079420 T4164 oasc.Overseer.close Overseer (id=92321677498122243-127.0.0.1:30697_solr-n_0000000000) closing
: :    [junit4]   2> 2079420 T4178 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:30697_solr
: :    [junit4]   2> 2079423 T4183 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
: :    [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
: :    [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
: :    [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
: :    [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:307)
: :    [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:304)
: :    [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
: :    [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:304)
: :    [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:320)
: :    [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:89)
: :    [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:292)
: :    [junit4]   2> 
: :    [junit4]   2> 2079431 T4164 oas.SolrTestCaseJ4.setUp ###Starting testShardAssignmentBigger
: :    [junit4]   2> 2079432 T4164 oasc.ZkTestServer.run STARTING ZK TEST SERVER
: :    [junit4]   1> client port:0.0.0.0/0.0.0.0:0
: :    [junit4]   2> 2079433 T4184 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
: :    [junit4]   2> 2079533 T4164 oasc.ZkTestServer.run start zk server on port:24615
: :    [junit4]   2> 2079534 T4164 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
: :    [junit4]   2> 2079538 T4190 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3fcf951c name:ZooKeeperConnection Watcher:127.0.0.1:24615 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
: :    [junit4]   2> 2079538 T4164 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
: :    [junit4]   2> 2079542 T4164 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
: :    [junit4]   2> 2079543 T4192 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@43d55824 name:ZooKeeperConnection Watcher:127.0.0.1:24615 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
: :    [junit4]   2> 2079543 T4164 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
: :    [junit4]   2> 2079544 T4164 oascc.SolrZkClient.makePath makePath: /solr
: :    [junit4]   2> 2079549 T4164 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
: :    [junit4]   2> 2079550 T4194 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3e50bb84 name:ZooKeeperConnection Watcher:127.0.0.1:24615/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
: :    [junit4
: : 
: : [...truncated too long message...]
: : 
: : .concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
: :    [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
: :    [junit4]   2> Caused by: java.lang.RuntimeException
: :    [junit4]   2> 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
: :    [junit4]   2> 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
: :    [junit4]   2> 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
: :    [junit4]   2> 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
: :    [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
: :    [junit4]   2> 	... 8 more
: :    [junit4]   2> 
: :    [junit4]   2> 4724166 T9902 oas.SolrTestCaseJ4.initCore ####initCore end
: :    [junit4]   2> 4724167 T9902 oas.SolrTestCaseJ4.deleteCore ###deleteCore
: :    [junit4]   2> 4724167 T9902 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1765317080
: :    [junit4]   2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=319), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=319)), sim=DefaultSimilarity, locale=ar_EG, timezone=America/Guayaquil
: :    [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_60 (64-bit)/cpus=16,threads=1,free=188245632,total=536870912
: :    [junit4]   2> NOTE: All tests run in this JVM: [AddSchemaFieldsUpdateProcessorFactoryTest, DebugComponentTest, ClusterStateUpdateTest, TestReload, ZkControllerTest, TestWriterPerf, TestRecovery, TestIntervalFaceting, TestDynamicFieldCollectionResource, TestPivotHelperCode, TestMaxScoreQueryParser, TestSchemaSimilarityResource, TestPerFieldSimilarity, TestSolrQueryParser, IndexSchemaRuntimeFieldTest, SampleTest, TestSchemaVersionResource, TestQuerySenderListener, CollectionsAPIAsyncDistributedZkTest, TestInfoStreamLogging, TestBlendedInfixSuggestions, TestFieldCollectionResource, TestFieldResource, HttpPartitionTest, TestFreeTextSuggestions, TestExceedMaxTermLength, TestRecoveryHdfs, StatelessScriptUpdateProcessorFactoryTest, TestBinaryResponseWriter, TestLeaderElectionZkExpiry, XsltUpdateRequestHandlerTest, TestReversedWildcardFilterFactory, TestSolrCoreProperties, AliasIntegrationTest, TestBM25SimilarityFactory, QueryParsingTest, DeleteReplicaTest, CustomCollectionTest, TestR
 eloadAndDeleteDocs, CachingDirectoryFactoryTest, IndexBasedSpellCheckerTest, TestQuerySenderNoQuery, ResourceLoaderTest, MinimalSchemaTest, InfoHandlerTest, NumericFieldsTest, SolrPluginUtilsTest, TestManagedStopFilterFactory, TestFuzzyAnalyzedSuggestions, HdfsUnloadDistributedZkTest, SystemInfoHandlerTest, TestFastWriter, SolrCmdDistributorTest, TestManagedSchema, HdfsDirectoryTest, TimeZoneUtilsTest, OverseerCollectionProcessorTest, TestSurroundQueryParser, DistribDocExpirationUpdateProcessorTest, HdfsSyncSliceTest, NotRequiredUniqueKeyTest, TestReRankQParserPlugin, TestStressLucene, PathHierarchyTokenizerFactoryTest, TestSolrQueryParserDefaultOperatorResource, TestNonNRTOpen, BasicDistributedZkTest, TestStandardQParsers, TestCloudManagedSchema, ZkSolrClientTest, TestOmitPositions, SolrTestCaseJ4Test, BadComponentTest, TestPartialUpdateDeduplication, StressHdfsTest, DistributedIntervalFacetingTest, SuggesterTest, DistributedQueryElevationComponentTest, HdfsRecoveryZkTest, FieldMut
 atingUpdateProcessorTest, ReplicationFactorTest, AnalyticsMergeStrategyTest, AssignTest, CoreAdminCreateDiscoverTest, ResponseHeaderTest, TermVectorComponentDistributedTest, ExternalFileFieldSortTest, HdfsLockFactoryTest, SSLMigrationTest, PolyFieldTest, DocExpirationUpdateProcessorFactoryTest, TestCustomSort, ConvertedLegacyTest, TestIBSimilarityFactory, ZkNodePropsTest, TestNoOpRegenerator, CollectionsAPIDistributedZkTest, DocumentBuilderTest, QueryElevationComponentTest, ChaosMonkeySafeLeaderTest, TestCloudManagedSchemaConcurrent, ShardRoutingTest, UnloadDistributedZkTest, AsyncMigrateRouteKeyTest, TestManagedSchemaFieldResource, LeaderElectionIntegrationTest, TestRequestStatusCollectionAPI, TestDistribDocBasedVersion, DistributedTermsComponentTest, TestDistributedMissingSort, TestJoin, DistributedFacetPivotLargeTest, TestCollectionAPI, MergeStrategyTest, TestCoreContainer, TestHashPartitioner, PeerSyncTest, TestRealTimeGet, TestGroupingSearch, TestManagedSynonymFilterFactory, Te
 stDocBasedVersionConstraints, ZkCLITest, TestSolr4Spatial, TestRangeQuery, TestSolrXmlPersistence, SpellCheckComponentTest, CacheHeaderTest, TestCopyFieldCollectionResource, TestSchemaNameResource, TestUniqueKeyFieldResource, TestFaceting, TestStressUserVersions, SolrXmlInZkTest, StatsComponentTest, BasicFunctionalityTest, CursorMarkTest, TestFunctionQuery, CurrencyFieldXmlFileTest, SchemaVersionSpecificBehaviorTest, TestAtomicUpdateErrorCases, DocValuesMissingTest, TestExtendedDismaxParser, TestIndexSearcher, TestMultiCoreConfBootstrap, TestPseudoReturnFields, SignatureUpdateProcessorFactoryTest, SpatialFilterTest, TestWordDelimiterFilterFactory, TestCSVLoader, TestNRTOpen, TestSolrDeletionPolicy1, DisMaxRequestHandlerTest, XmlUpdateRequestHandlerTest, BJQParserTest, TestCSVResponseWriter, DirectSolrSpellCheckerTest, TestCoreDiscovery, TermVectorComponentTest, TestConfig, LoggingHandlerTest, TermsComponentTest, TestUpdate, AnalyticsQueryTest, TestTrie, SOLR749Test, IndexSchemaTest,
  FieldAnalysisRequestHandlerTest, RegexBoostProcessorTest, CoreMergeIndexesAdminHandlerTest, TestQueryUtils, TestQueryTypes, TestComponentsName, TestSolrDeletionPolicy2, CopyFieldTest, RequiredFieldsTest, TestPostingsSolrHighlighter, DocValuesMultiTest, TestSolrXml, TestSolr4Spatial2, TestAnalyzeInfixSuggestions, TestHighFrequencyDictionaryFactory, TestLuceneMatchVersion, TestFileDictionaryLookup]
: :    [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestFileDictionaryLookup -Dtests.seed=41A319E125435502 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar_EG -Dtests.timezone=America/Guayaquil -Dtests.file.encoding=US-ASCII
: :    [junit4] ERROR   0.00s J0 | TestFileDictionaryLookup (suite) <<<
: :    [junit4]    > Throwable #1: org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: null
: :    [junit4]    > 	at __randomizedtesting.SeedInfo.seed([41A319E125435502]:0)
: :    [junit4]    > 	at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:745)
: :    [junit4]    > 	at org.apache.solr.util.TestHarness.getCore(TestHarness.java:209)
: :    [junit4]    > 	at org.apache.solr.util.TestHarness$LocalRequestFactory.makeRequest(TestHarness.java:420)
: :    [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.req(SolrTestCaseJ4.java:990)
: :    [junit4]    > 	at org.apache.solr.spelling.suggest.TestFileDictionaryLookup.beforeClass(TestFileDictionaryLookup.java:30)
: :    [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
: :    [junit4]    > Caused by: org.apache.solr.common.SolrException
: :    [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
: :    [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
: :    [junit4]    > 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
: :    [junit4]    > 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
: :    [junit4]    > 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
: :    [junit4]    > 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
: :    [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
: :    [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
: :    [junit4]    > 	... 1 more
: :    [junit4]    > Caused by: java.lang.RuntimeException
: :    [junit4]    > 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
: :    [junit4]    > 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
: :    [junit4]    > 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
: :    [junit4]    > 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
: :    [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
: :    [junit4]    > 	... 8 more
: :    [junit4] Completed on J0 in 1.68s, 0 tests, 1 error <<< FAILURES!
: : 
: : [...truncated 147 lines...]
: : BUILD FAILED
: : /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:475: The following error occurred while executing this line:
: : /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:455: The following error occurred while executing this line:
: : /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:45: The following error occurred while executing this line:
: : /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/extra-targets.xml:37: The following error occurred while executing this line:
: : /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:189: The following error occurred while executing this line:
: : /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:496: The following error occurred while executing this line:
: : /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1351: The following error occurred while executing this line:
: : /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:966: There were test failures: 419 suites, 1723 tests, 6 suite-level errors, 1 error, 53 ignored (19 assumptions)
: : 
: : Total time: 132 minutes 35 seconds
: : Build step 'Invoke Ant' marked build as failure
: : Archiving artifacts
: : Sending artifact delta relative to Lucene-Solr-Tests-4.x-Java7 #2065
: : Archived 3 artifacts
: : Archive block size is 32768
: : Received 0 blocks and 225965606 bytes
: : Compression is 0.0%
: : Took 41 sec
: : Recording test results
: : Email was triggered for: Failure
: : Sending email for trigger: Failure
: : 
: : 
: : 
: 
: -Hoss
: http://www.lucidworks.com/

-Hoss
http://www.lucidworks.com/

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Re: [JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 2066 - Failure

Posted by Chris Hostetter <ho...@fucit.org>.
Something on 4.x changed in the last ~24 hours or so has started causing 
all solr "Suggest" based tests to fail reliably, regardless of seed...

cd solr/core && ant test -Dtests.class=\*Suggest\*
...
   [junit4] Tests with failures:
   [junit4]   - org.apache.solr.spelling.suggest.TestAnalyzedSuggestions (suite)
   [junit4]   - org.apache.solr.spelling.suggest.TestAnalyzeInfixSuggestions (suite)
   [junit4]   - org.apache.solr.spelling.suggest.TestFuzzyAnalyzedSuggestions (suite)
   [junit4]   - org.apache.solr.spelling.suggest.TestPhraseSuggestions (suite)


The common problem seems to be related to SolrCore init? ...

org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: null
...
Caused by: java.lang.RuntimeException
	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)


...anybody have any idea what happened here?







: Date: Fri, 22 Aug 2014 15:09:03 +0000 (UTC)
: From: Apache Jenkins Server <je...@builds.apache.org>
: Reply-To: dev@lucene.apache.org
: To: dev@lucene.apache.org
: Subject: [JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 2066 - Failure
: 
: Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/2066/
: 
: 7 tests failed.
: FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.MultiThreadedOCPTest
: 
: Error Message:
: 1 thread leaked from SUITE scope at org.apache.solr.cloud.MultiThreadedOCPTest:     1) Thread[id=5295, name=OverseerThreadFactory-2312-thread-5, state=TIMED_WAITING, group=Overseer collection creation process.]         at java.lang.Thread.sleep(Native Method)         at org.apache.solr.cloud.OverseerCollectionProcessor.waitForCoreNodeName(OverseerCollectionProcessor.java:1621)         at org.apache.solr.cloud.OverseerCollectionProcessor.splitShard(OverseerCollectionProcessor.java:1503)         at org.apache.solr.cloud.OverseerCollectionProcessor.processMessage(OverseerCollectionProcessor.java:565)         at org.apache.solr.cloud.OverseerCollectionProcessor$Runner.run(OverseerCollectionProcessor.java:2623)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:745)
: 
: Stack Trace:
: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.MultiThreadedOCPTest: 
:    1) Thread[id=5295, name=OverseerThreadFactory-2312-thread-5, state=TIMED_WAITING, group=Overseer collection creation process.]
:         at java.lang.Thread.sleep(Native Method)
:         at org.apache.solr.cloud.OverseerCollectionProcessor.waitForCoreNodeName(OverseerCollectionProcessor.java:1621)
:         at org.apache.solr.cloud.OverseerCollectionProcessor.splitShard(OverseerCollectionProcessor.java:1503)
:         at org.apache.solr.cloud.OverseerCollectionProcessor.processMessage(OverseerCollectionProcessor.java:565)
:         at org.apache.solr.cloud.OverseerCollectionProcessor$Runner.run(OverseerCollectionProcessor.java:2623)
:         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
:         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
:         at java.lang.Thread.run(Thread.java:745)
: 	at __randomizedtesting.SeedInfo.seed([41A319E125435502]:0)
: 
: 
: REGRESSION:  org.apache.solr.cloud.OverseerTest.testOverseerFailure
: 
: Error Message:
: Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
: 
: Stack Trace:
: org.apache.solr.common.SolrException: Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
: 	at __randomizedtesting.SeedInfo.seed([41A319E125435502:45AB961237E6BA23]:0)
: 	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:150)
: 	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:163)
: 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:125)
: 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:155)
: 	at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:314)
: 	at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:221)
: 	at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:157)
: 	at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:662)
: 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
: 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
: 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
: 	at java.lang.reflect.Method.invoke(Method.java:606)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
: 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
: 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
: 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
: 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
: 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
: 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
: 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
: 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
: 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
: 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
: 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
: 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
: 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
: 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
: 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
: 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
: 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
: 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
: 	at java.lang.Thread.run(Thread.java:745)
: Caused by: org.apache.solr.common.SolrException: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
: 	at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:40)
: 	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:137)
: 	... 48 more
: Caused by: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
: 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
: 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
: 	at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
: 	at org.apache.solr.common.cloud.SolrZkClient$11.execute(SolrZkClient.java:462)
: 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
: 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:459)
: 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:416)
: 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:403)
: 	at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:142)
: 	at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:34)
: 	... 49 more
: 
: 
: FAILED:  junit.framework.TestSuite.org.apache.solr.spelling.suggest.TestAnalyzeInfixSuggestions
: 
: Error Message:
: SolrCore 'collection1' is not available due to init failure: null
: 
: Stack Trace:
: org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: null
: 	at __randomizedtesting.SeedInfo.seed([41A319E125435502]:0)
: 	at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:745)
: 	at org.apache.solr.util.TestHarness.getCore(TestHarness.java:209)
: 	at org.apache.solr.util.TestHarness$LocalRequestFactory.makeRequest(TestHarness.java:420)
: 	at org.apache.solr.SolrTestCaseJ4.req(SolrTestCaseJ4.java:990)
: 	at org.apache.solr.spelling.suggest.TestAnalyzeInfixSuggestions.beforeClass(TestAnalyzeInfixSuggestions.java:33)
: 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
: 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
: 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
: 	at java.lang.reflect.Method.invoke(Method.java:606)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:767)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
: 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
: 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
: 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
: 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
: 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
: 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
: 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
: 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
: 	at java.lang.Thread.run(Thread.java:745)
: Caused by: org.apache.solr.common.SolrException
: 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
: 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
: 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
: 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
: 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
: 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
: 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
: 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
: 	... 1 more
: Caused by: java.lang.RuntimeException
: 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
: 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
: 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
: 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
: 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
: 	... 8 more
: 
: 
: FAILED:  junit.framework.TestSuite.org.apache.solr.spelling.suggest.TestFileDictionaryLookup
: 
: Error Message:
: SolrCore 'collection1' is not available due to init failure: null
: 
: Stack Trace:
: org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: null
: 	at __randomizedtesting.SeedInfo.seed([41A319E125435502]:0)
: 	at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:745)
: 	at org.apache.solr.util.TestHarness.getCore(TestHarness.java:209)
: 	at org.apache.solr.util.TestHarness$LocalRequestFactory.makeRequest(TestHarness.java:420)
: 	at org.apache.solr.SolrTestCaseJ4.req(SolrTestCaseJ4.java:990)
: 	at org.apache.solr.spelling.suggest.TestFileDictionaryLookup.beforeClass(TestFileDictionaryLookup.java:30)
: 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
: 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
: 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
: 	at java.lang.reflect.Method.invoke(Method.java:606)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:767)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
: 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
: 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
: 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
: 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
: 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
: 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
: 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
: 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
: 	at java.lang.Thread.run(Thread.java:745)
: Caused by: org.apache.solr.common.SolrException
: 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
: 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
: 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
: 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
: 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
: 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
: 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
: 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
: 	... 1 more
: Caused by: java.lang.RuntimeException
: 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
: 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
: 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
: 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
: 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
: 	... 8 more
: 
: 
: FAILED:  junit.framework.TestSuite.org.apache.solr.spelling.suggest.TestFreeTextSuggestions
: 
: Error Message:
: SolrCore 'collection1' is not available due to init failure: null
: 
: Stack Trace:
: org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: null
: 	at __randomizedtesting.SeedInfo.seed([41A319E125435502]:0)
: 	at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:745)
: 	at org.apache.solr.util.TestHarness.getCore(TestHarness.java:209)
: 	at org.apache.solr.util.TestHarness$LocalRequestFactory.makeRequest(TestHarness.java:420)
: 	at org.apache.solr.SolrTestCaseJ4.req(SolrTestCaseJ4.java:990)
: 	at org.apache.solr.spelling.suggest.TestFreeTextSuggestions.beforeClass(TestFreeTextSuggestions.java:32)
: 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
: 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
: 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
: 	at java.lang.reflect.Method.invoke(Method.java:606)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:767)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
: 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
: 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
: 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
: 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
: 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
: 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
: 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
: 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
: 	at java.lang.Thread.run(Thread.java:745)
: Caused by: org.apache.solr.common.SolrException
: 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
: 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
: 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
: 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
: 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
: 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
: 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
: 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
: 	... 1 more
: Caused by: java.lang.RuntimeException
: 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
: 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
: 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
: 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
: 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
: 	... 8 more
: 
: 
: FAILED:  junit.framework.TestSuite.org.apache.solr.spelling.suggest.TestFuzzyAnalyzedSuggestions
: 
: Error Message:
: SolrCore 'collection1' is not available due to init failure: null
: 
: Stack Trace:
: org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: null
: 	at __randomizedtesting.SeedInfo.seed([41A319E125435502]:0)
: 	at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:745)
: 	at org.apache.solr.util.TestHarness.getCore(TestHarness.java:209)
: 	at org.apache.solr.util.TestHarness$LocalRequestFactory.makeRequest(TestHarness.java:420)
: 	at org.apache.solr.SolrTestCaseJ4.req(SolrTestCaseJ4.java:990)
: 	at org.apache.solr.spelling.suggest.TestFuzzyAnalyzedSuggestions.beforeClass(TestFuzzyAnalyzedSuggestions.java:34)
: 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
: 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
: 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
: 	at java.lang.reflect.Method.invoke(Method.java:606)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:767)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
: 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
: 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
: 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
: 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
: 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
: 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
: 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
: 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
: 	at java.lang.Thread.run(Thread.java:745)
: Caused by: org.apache.solr.common.SolrException
: 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
: 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
: 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
: 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
: 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
: 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
: 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
: 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
: 	... 1 more
: Caused by: java.lang.RuntimeException
: 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
: 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
: 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
: 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
: 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
: 	... 8 more
: 
: 
: FAILED:  junit.framework.TestSuite.org.apache.solr.spelling.suggest.TestHighFrequencyDictionaryFactory
: 
: Error Message:
: SolrCore 'collection1' is not available due to init failure: null
: 
: Stack Trace:
: org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: null
: 	at __randomizedtesting.SeedInfo.seed([41A319E125435502]:0)
: 	at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:745)
: 	at org.apache.solr.util.TestHarness.getCoreInc(TestHarness.java:219)
: 	at org.apache.solr.util.TestHarness.update(TestHarness.java:235)
: 	at org.apache.solr.util.BaseTestHarness.checkUpdateStatus(BaseTestHarness.java:282)
: 	at org.apache.solr.util.BaseTestHarness.validateUpdate(BaseTestHarness.java:252)
: 	at org.apache.solr.SolrTestCaseJ4.checkUpdateU(SolrTestCaseJ4.java:663)
: 	at org.apache.solr.SolrTestCaseJ4.assertU(SolrTestCaseJ4.java:642)
: 	at org.apache.solr.SolrTestCaseJ4.assertU(SolrTestCaseJ4.java:636)
: 	at org.apache.solr.spelling.suggest.TestHighFrequencyDictionaryFactory.beforeClass(TestHighFrequencyDictionaryFactory.java:32)
: 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
: 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
: 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
: 	at java.lang.reflect.Method.invoke(Method.java:606)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:767)
: 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
: 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
: 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
: 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
: 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
: 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
: 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
: 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
: 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
: 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
: 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
: 	at java.lang.Thread.run(Thread.java:745)
: Caused by: org.apache.solr.common.SolrException
: 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
: 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
: 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
: 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
: 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
: 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
: 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
: 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
: 	... 1 more
: Caused by: java.lang.RuntimeException
: 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
: 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
: 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
: 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
: 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
: 	... 8 more
: 
: 
: 
: 
: Build Log:
: [...truncated 11256 lines...]
:    [junit4] Suite: org.apache.solr.spelling.suggest.TestFreeTextSuggestions
:    [junit4]   2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-41A319E125435502-001/init-core-data-001
:    [junit4]   2> 317220 T506 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (true)
:    [junit4]   2> 317221 T506 oas.SolrTestCaseJ4.initCore ####initCore
:    [junit4]   2> 317221 T506 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/'
:    [junit4]   2> 317223 T506 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
:    [junit4]   2> 317223 T506 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/README' to classloader
:    [junit4]   2> 317224 T506 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
:    [junit4]   2> 317321 T506 oasc.SolrConfig.<init> Using Lucene MatchVersion: 4.11.0
:    [junit4]   2> 317361 T506 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-phrasesuggest.xml
:    [junit4]   2> 317362 T506 oass.IndexSchema.readSchema Reading Solr Schema from schema-phrasesuggest.xml
:    [junit4]   2> 317370 T506 oass.IndexSchema.readSchema [null] Schema name=test
:    [junit4]   2> 317396 T506 oass.IndexSchema.readSchema default search field in schema is text
:    [junit4]   2> 317397 T506 oass.IndexSchema.readSchema unique key field: id
:    [junit4]   2> 317398 T506 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
:    [junit4]   2> 317398 T506 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr
:    [junit4]   2> 317399 T506 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/'
:    [junit4]   2> 317445 T506 oasc.CoreContainer.<init> New CoreContainer 612440481
:    [junit4]   2> 317446 T506 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/]
:    [junit4]   2> 317447 T506 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
:    [junit4]   2> 317447 T506 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
:    [junit4]   2> 317447 T506 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
:    [junit4]   2> 317447 T506 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
:    [junit4]   2> 317448 T506 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
:    [junit4]   2> 317448 T506 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
:    [junit4]   2> 317448 T506 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
:    [junit4]   2> 317448 T506 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
:    [junit4]   2> 317449 T506 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
:    [junit4]   2> 317449 T506 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=30000&connTimeout=30000&retry=false
:    [junit4]   2> 317449 T506 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
:    [junit4]   2> 317449 T506 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
:    [junit4]   2> 317450 T506 oasc.CoreContainer.load Host Name: 
:    [junit4]   2> 317454 T507 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/'
:    [junit4]   2> 317456 T507 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
:    [junit4]   2> 317456 T507 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/README' to classloader
:    [junit4]   2> 317456 T507 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
:    [junit4]   2> 317557 T507 oasc.SolrConfig.<init> Using Lucene MatchVersion: 4.11.0
:    [junit4]   2> 317623 T507 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-phrasesuggest.xml
:    [junit4]   2> 317624 T507 oass.IndexSchema.readSchema Reading Solr Schema from schema-phrasesuggest.xml
:    [junit4]   2> 317631 T507 oass.IndexSchema.readSchema [collection1] Schema name=test
:    [junit4]   2> 317660 T507 oass.IndexSchema.readSchema default search field in schema is text
:    [junit4]   2> 317662 T507 oass.IndexSchema.readSchema unique key field: id
:    [junit4]   2> 317664 T507 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/
:    [junit4]   2> 317664 T507 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
:    [junit4]   2> 317664 T507 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-41A319E125435502-001/init-core-data-001/
:    [junit4]   2> 317664 T507 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
:    [junit4]   2> 317665 T507 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-41A319E125435502-001/init-core-data-001
:    [junit4]   2> 317665 T507 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-41A319E125435502-001/init-core-data-001/index/
:    [junit4]   2> 317666 T507 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-41A319E125435502-001/init-core-data-001/index' doesn't exist. Creating new index...
:    [junit4]   2> 317667 T507 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-41A319E125435502-001/init-core-data-001/index
:    [junit4]   2> 317667 T507 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=37, maxMergedSegmentMB=73.5712890625, floorSegmentMB=0.76171875, forceMergeDeletesPctAllowed=9.551670063104096, segmentsPerTier=31.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
:    [junit4]   2> 317668 T507 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
:    [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@c56677c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5bb89ea),segFN=segments_1,generation=1}
:    [junit4]   2> 317668 T507 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
:    [junit4]   2> 317670 T507 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
:    [junit4]   2> 317670 T507 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
:    [junit4]   2> 317671 T507 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
:    [junit4]   2> 317671 T507 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
:    [junit4]   2> 317671 T507 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
:    [junit4]   2> 317672 T507 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
:    [junit4]   2> 317672 T507 oasc.RequestHandlers.initHandlersFromConfig created /suggest_wfst: org.apache.solr.handler.component.SearchHandler
:    [junit4]   2> 317672 T507 oasc.RequestHandlers.initHandlersFromConfig created /suggest_analyzing: org.apache.solr.handler.component.SearchHandler
:    [junit4]   2> 317673 T507 oasc.RequestHandlers.initHandlersFromConfig created /infix_suggest_analyzing: org.apache.solr.handler.component.SearchHandler
:    [junit4]   2> 317673 T507 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_file_dict: org.apache.solr.handler.component.SearchHandler
:    [junit4]   2> 317673 T507 oasc.RequestHandlers.initHandlersFromConfig created /blended_infix_suggest: org.apache.solr.handler.component.SearchHandler
:    [junit4]   2> 317674 T507 oasc.RequestHandlers.initHandlersFromConfig created /free_text_suggest: org.apache.solr.handler.component.SearchHandler
:    [junit4]   2> 317674 T507 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_high_freq_dict: org.apache.solr.handler.component.SearchHandler
:    [junit4]   2> 317674 T507 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing: org.apache.solr.handler.component.SearchHandler
:    [junit4]   2> 317674 T507 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_max_edit_2: org.apache.solr.handler.component.SearchHandler
:    [junit4]   2> 317675 T507 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_non_fuzzy_prefix_4: org.apache.solr.handler.component.SearchHandler
:    [junit4]   2> 317675 T507 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_min_fuzzy_length_2: org.apache.solr.handler.component.SearchHandler
:    [junit4]   2> 317703 T507 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
:    [junit4]   2> 317705 T507 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
:    [junit4]   2> 317707 T507 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
:    [junit4]   2> 317709 T507 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
:    [junit4]   2> 317713 T507 oasu.CommitTracker.<init> Hard AutoCommit: disabled
:    [junit4]   2> 317713 T507 oasu.CommitTracker.<init> Soft AutoCommit: disabled
:    [junit4]   2> 317713 T507 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=21, maxMergeAtOnceExplicit=37, maxMergedSegmentMB=49.3046875, floorSegmentMB=0.693359375, forceMergeDeletesPctAllowed=3.635932570392315, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
:    [junit4]   2> 317714 T507 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
:    [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@c56677c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5bb89ea),segFN=segments_1,generation=1}
:    [junit4]   2> 317714 T507 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
:    [junit4]   2> 317715 T507 oass.SolrIndexSearcher.<init> Opening Searcher@7019cd0b[collection1] main
:    [junit4]   2> 317716 T507 oasr.ManagedResourceStorage.newStorageIO WARN Cannot write to config directory /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
:    [junit4]   2> 317716 T507 oasr.RestManager.init Initializing RestManager with initArgs: {}
:    [junit4]   2> 317716 T507 oasr.ManagedResourceStorage.load Reading _rest_managed.json using InMemoryStorage
:    [junit4]   2> 317716 T507 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
:    [junit4]   2> 317717 T507 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using InMemoryStorage
:    [junit4]   2> 317717 T507 oasr.RestManager.init Initializing 0 registered ManagedResources
:    [junit4]   2> 317717 T507 oashc.SpellCheckComponent.inform Initializing spell checkers
:    [junit4]   2> 317717 T507 oasss.Suggester.init init: {name=suggest_wfst,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.WFSTLookupFactory,storeDir=suggest_wfst,buildOnCommit=false,exactMatchFirst=true,sourceLocation=phrasesuggest.txt}
:    [junit4]   2> 317720 T507 oashc.SpellCheckComponent.inform Initializing spell checkers
:    [junit4]   2> 317720 T507 oasss.Suggester.init init: {name=suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingLookupFactory,storeDir=suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=ja_suggest,preserveSep=false,sourceLocation=jasuggest.txt}
:    [junit4]   2> 317721 T507 oashc.SpellCheckComponent.inform Initializing spell checkers
:    [junit4]   2> 317722 T507 oasss.Suggester.init init: {name=infix_suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingInfixLookupFactory,buildOnCommit=false,suggestAnalyzerFieldType=text,sourceLocation=analyzingInfixSuggest.txt}
:    [junit4]   2> 317723 T507 oashc.SuggestComponent.inform Initializing SuggestComponent
:    [junit4]   2> 317723 T507 oasss.SolrSuggester.init init: {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
:    [junit4]   2> 317725 T507 oasss.SolrSuggester.init Dictionary loaded with params: {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
:    [junit4]   2> 317725 T507 oashc.SuggestComponent.inform Initializing SuggestComponent
:    [junit4]   2> 317725 T507 oasss.SolrSuggester.init init: {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator= ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
:    [junit4]   2> 317726 T507 oasss.SolrSuggester.init Dictionary loaded with params: {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator= ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
:    [junit4]   2> 317727 T507 oashc.SuggestComponent.inform Initializing SuggestComponent
:    [junit4]   2> 317727 T507 oasss.SolrSuggester.init init: {name=blended_infix_suggest_linear,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=FileDictionaryFactory,buildOnCommit=false,sourceLocation=blendedInfixSuggest.txt,indexPath=blendedInfixDir1,blenderType=linear,suggestAnalyzerFieldType=text}
:    [junit4]   2> 318731 T507 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@6af5dbe
:    [junit4]   2> 318731 T508 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7019cd0b[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
:    [junit4]   2> 318731 T507 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
:    [junit4]   2> 318732 T507 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
:    [junit4]   2> 318732 T507 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
:    [junit4]   2> 318732 T507 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
:    [junit4]   2> 318733 T507 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
:    [junit4]   2> 318733 T507 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
:    [junit4]   2> 318733 T507 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-41A319E125435502-001/init-core-data-001/index [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-41A319E125435502-001/init-core-data-001/index;done=false>>]
:    [junit4]   2> 318734 T507 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-41A319E125435502-001/init-core-data-001/index
:    [junit4]   2> 318734 T507 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-41A319E125435502-001/init-core-data-001 [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-41A319E125435502-001/init-core-data-001;done=false>>]
:    [junit4]   2> 318734 T507 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFreeTextSuggestions-41A319E125435502-001/init-core-data-001
:    [junit4]   2> 318742 T507 oasc.CoreContainer.create ERROR Error creating core [collection1]: null org.apache.solr.common.SolrException
:    [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
:    [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
:    [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
:    [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
:    [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
:    [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
:    [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
:    [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
:    [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
:    [junit4]   2> Caused by: java.lang.RuntimeException
:    [junit4]   2> 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
:    [junit4]   2> 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
:    [junit4]   2> 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
:    [junit4]   2> 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
:    [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
:    [junit4]   2> 	... 8 more
:    [junit4]   2> 
:    [junit4]   2> 318745 T506 oas.SolrTestCaseJ4.initCore ####initCore end
:    [junit4]   2> 318745 T506 oas.SolrTestCaseJ4.deleteCore ###deleteCore
:    [junit4]   2> 318746 T506 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=612440481
:    [junit4]   2> NOTE: test params are: codec=Lucene49, sim=DefaultSimilarity, locale=tr_TR, timezone=SystemV/AST4ADT
:    [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_60 (64-bit)/cpus=16,threads=1,free=256741160,total=361758720
:    [junit4]   2> NOTE: All tests run in this JVM: [AddSchemaFieldsUpdateProcessorFactoryTest, DebugComponentTest, ClusterStateUpdateTest, TestReload, ZkControllerTest, TestWriterPerf, TestRecovery, TestIntervalFaceting, TestDynamicFieldCollectionResource, TestPivotHelperCode, TestMaxScoreQueryParser, TestSchemaSimilarityResource, TestPerFieldSimilarity, TestSolrQueryParser, IndexSchemaRuntimeFieldTest, SampleTest, TestSchemaVersionResource, TestQuerySenderListener, CollectionsAPIAsyncDistributedZkTest, TestInfoStreamLogging, TestBlendedInfixSuggestions, TestFieldCollectionResource, TestFieldResource, HttpPartitionTest, TestFreeTextSuggestions]
:    [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestFreeTextSuggestions -Dtests.seed=41A319E125435502 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=tr_TR -Dtests.timezone=SystemV/AST4ADT -Dtests.file.encoding=US-ASCII
:    [junit4] ERROR   0.00s J0 | TestFreeTextSuggestions (suite) <<<
:    [junit4]    > Throwable #1: org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: null
:    [junit4]    > 	at __randomizedtesting.SeedInfo.seed([41A319E125435502]:0)
:    [junit4]    > 	at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:745)
:    [junit4]    > 	at org.apache.solr.util.TestHarness.getCore(TestHarness.java:209)
:    [junit4]    > 	at org.apache.solr.util.TestHarness$LocalRequestFactory.makeRequest(TestHarness.java:420)
:    [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.req(SolrTestCaseJ4.java:990)
:    [junit4]    > 	at org.apache.solr.spelling.suggest.TestFreeTextSuggestions.beforeClass(TestFreeTextSuggestions.java:32)
:    [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
:    [junit4]    > Caused by: org.apache.solr.common.SolrException
:    [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
:    [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
:    [junit4]    > 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
:    [junit4]    > 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
:    [junit4]    > 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
:    [junit4]    > 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
:    [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
:    [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
:    [junit4]    > 	... 1 more
:    [junit4]    > Caused by: java.lang.RuntimeException
:    [junit4]    > 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
:    [junit4]    > 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
:    [junit4]    > 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
:    [junit4]    > 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
:    [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
:    [junit4]    > 	... 8 more
:    [junit4] Completed on J0 in 1.60s, 0 tests, 1 error <<< FAILURES!
: 
: [...truncated 140 lines...]
:    [junit4] Suite: org.apache.solr.spelling.suggest.TestFuzzyAnalyzedSuggestions
:    [junit4]   2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-41A319E125435502-001/init-core-data-001
:    [junit4]   2> 578472 T1491 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (true)
:    [junit4]   2> 578473 T1491 oas.SolrTestCaseJ4.initCore ####initCore
:    [junit4]   2> 578473 T1491 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/'
:    [junit4]   2> 578474 T1491 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
:    [junit4]   2> 578475 T1491 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/README' to classloader
:    [junit4]   2> 578475 T1491 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
:    [junit4]   2> 578561 T1491 oasc.SolrConfig.<init> Using Lucene MatchVersion: 4.11.0
:    [junit4]   2> 578603 T1491 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-phrasesuggest.xml
:    [junit4]   2> 578604 T1491 oass.IndexSchema.readSchema Reading Solr Schema from schema-phrasesuggest.xml
:    [junit4]   2> 578609 T1491 oass.IndexSchema.readSchema [null] Schema name=test
:    [junit4]   2> 578629 T1491 oass.IndexSchema.readSchema default search field in schema is text
:    [junit4]   2> 578630 T1491 oass.IndexSchema.readSchema unique key field: id
:    [junit4]   2> 578631 T1491 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
:    [junit4]   2> 578631 T1491 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr
:    [junit4]   2> 578632 T1491 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/'
:    [junit4]   2> 578676 T1491 oasc.CoreContainer.<init> New CoreContainer 1482249818
:    [junit4]   2> 578676 T1491 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/]
:    [junit4]   2> 578677 T1491 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
:    [junit4]   2> 578677 T1491 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
:    [junit4]   2> 578678 T1491 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
:    [junit4]   2> 578678 T1491 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
:    [junit4]   2> 578678 T1491 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
:    [junit4]   2> 578678 T1491 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
:    [junit4]   2> 578678 T1491 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
:    [junit4]   2> 578679 T1491 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
:    [junit4]   2> 578679 T1491 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
:    [junit4]   2> 578679 T1491 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=30000&connTimeout=30000&retry=false
:    [junit4]   2> 578679 T1491 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
:    [junit4]   2> 578680 T1491 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
:    [junit4]   2> 578680 T1491 oasc.CoreContainer.load Host Name: 
:    [junit4]   2> 578684 T1492 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/'
:    [junit4]   2> 578685 T1492 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
:    [junit4]   2> 578686 T1492 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/README' to classloader
:    [junit4]   2> 578686 T1492 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
:    [junit4]   2> 578745 T1492 oasc.SolrConfig.<init> Using Lucene MatchVersion: 4.11.0
:    [junit4]   2> 578823 T1492 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-phrasesuggest.xml
:    [junit4]   2> 578824 T1492 oass.IndexSchema.readSchema Reading Solr Schema from schema-phrasesuggest.xml
:    [junit4]   2> 578831 T1492 oass.IndexSchema.readSchema [collection1] Schema name=test
:    [junit4]   2> 578856 T1492 oass.IndexSchema.readSchema default search field in schema is text
:    [junit4]   2> 578858 T1492 oass.IndexSchema.readSchema unique key field: id
:    [junit4]   2> 578859 T1492 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/
:    [junit4]   2> 578859 T1492 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
:    [junit4]   2> 578859 T1492 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/, dataDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-41A319E125435502-001/init-core-data-001/
:    [junit4]   2> 578860 T1492 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
:    [junit4]   2> 578860 T1492 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-41A319E125435502-001/init-core-data-001
:    [junit4]   2> 578861 T1492 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-41A319E125435502-001/init-core-data-001/index/
:    [junit4]   2> 578861 T1492 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-41A319E125435502-001/init-core-data-001/index' doesn't exist. Creating new index...
:    [junit4]   2> 578861 T1492 oasc.CachingDirectoryFactory.get return new directory for /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-41A319E125435502-001/init-core-data-001/index
:    [junit4]   2> 578862 T1492 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=27, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
:    [junit4]   2> 578863 T1492 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
:    [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@7c9e4a46 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@324787a1),segFN=segments_1,generation=1}
:    [junit4]   2> 578863 T1492 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
:    [junit4]   2> 578865 T1492 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
:    [junit4]   2> 578865 T1492 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
:    [junit4]   2> 578866 T1492 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
:    [junit4]   2> 578866 T1492 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
:    [junit4]   2> 578866 T1492 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
:    [junit4]   2> 578867 T1492 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
:    [junit4]   2> 578867 T1492 oasc.RequestHandlers.initHandlersFromConfig created /suggest_wfst: org.apache.solr.handler.component.SearchHandler
:    [junit4]   2> 578867 T1492 oasc.RequestHandlers.initHandlersFromConfig created /suggest_analyzing: org.apache.solr.handler.component.SearchHandler
:    [junit4]   2> 578868 T1492 oasc.RequestHandlers.initHandlersFromConfig created /infix_suggest_analyzing: org.apache.solr.handler.component.SearchHandler
:    [junit4]   2> 578868 T1492 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_file_dict: org.apache.solr.handler.component.SearchHandler
:    [junit4]   2> 578868 T1492 oasc.RequestHandlers.initHandlersFromConfig created /blended_infix_suggest: org.apache.solr.handler.component.SearchHandler
:    [junit4]   2> 578869 T1492 oasc.RequestHandlers.initHandlersFromConfig created /free_text_suggest: org.apache.solr.handler.component.SearchHandler
:    [junit4]   2> 578869 T1492 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_high_freq_dict: org.apache.solr.handler.component.SearchHandler
:    [junit4]   2> 578869 T1492 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing: org.apache.solr.handler.component.SearchHandler
:    [junit4]   2> 578870 T1492 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_max_edit_2: org.apache.solr.handler.component.SearchHandler
:    [junit4]   2> 578870 T1492 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_non_fuzzy_prefix_4: org.apache.solr.handler.component.SearchHandler
:    [junit4]   2> 578870 T1492 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_min_fuzzy_length_2: org.apache.solr.handler.component.SearchHandler
:    [junit4]   2> 578888 T1492 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
:    [junit4]   2> 578890 T1492 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
:    [junit4]   2> 578892 T1492 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
:    [junit4]   2> 578894 T1492 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
:    [junit4]   2> 578897 T1492 oasu.CommitTracker.<init> Hard AutoCommit: disabled
:    [junit4]   2> 578898 T1492 oasu.CommitTracker.<init> Soft AutoCommit: disabled
:    [junit4]   2> 578898 T1492 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=48, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.31149779368116737]
:    [junit4]   2> 578899 T1492 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
:    [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@7c9e4a46 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@324787a1),segFN=segments_1,generation=1}
:    [junit4]   2> 578899 T1492 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
:    [junit4]   2> 578899 T1492 oass.SolrIndexSearcher.<init> Opening Searcher@59329086[collection1] main
:    [junit4]   2> 578900 T1492 oasr.ManagedResourceStorage.newStorageIO WARN Cannot write to config directory /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
:    [junit4]   2> 578900 T1492 oasr.RestManager.init Initializing RestManager with initArgs: {}
:    [junit4]   2> 578901 T1492 oasr.ManagedResourceStorage.load Reading _rest_managed.json using InMemoryStorage
:    [junit4]   2> 578901 T1492 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
:    [junit4]   2> 578901 T1492 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using InMemoryStorage
:    [junit4]   2> 578901 T1492 oasr.RestManager.init Initializing 0 registered ManagedResources
:    [junit4]   2> 578902 T1492 oashc.SpellCheckComponent.inform Initializing spell checkers
:    [junit4]   2> 578902 T1492 oasss.Suggester.init init: {name=suggest_wfst,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.WFSTLookupFactory,storeDir=suggest_wfst,buildOnCommit=false,exactMatchFirst=true,sourceLocation=phrasesuggest.txt}
:    [junit4]   2> 578904 T1492 oashc.SpellCheckComponent.inform Initializing spell checkers
:    [junit4]   2> 578904 T1492 oasss.Suggester.init init: {name=suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingLookupFactory,storeDir=suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=ja_suggest,preserveSep=false,sourceLocation=jasuggest.txt}
:    [junit4]   2> 578905 T1492 oashc.SpellCheckComponent.inform Initializing spell checkers
:    [junit4]   2> 578905 T1492 oasss.Suggester.init init: {name=infix_suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingInfixLookupFactory,buildOnCommit=false,suggestAnalyzerFieldType=text,sourceLocation=analyzingInfixSuggest.txt}
:    [junit4]   2> 578906 T1492 oashc.SuggestComponent.inform Initializing SuggestComponent
:    [junit4]   2> 578907 T1492 oasss.SolrSuggester.init init: {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
:    [junit4]   2> 578908 T1492 oasss.SolrSuggester.init Dictionary loaded with params: {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
:    [junit4]   2> 578908 T1492 oashc.SuggestComponent.inform Initializing SuggestComponent
:    [junit4]   2> 578908 T1492 oasss.SolrSuggester.init init: {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator= ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
:    [junit4]   2> 578909 T1492 oasss.SolrSuggester.init Dictionary loaded with params: {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator= ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
:    [junit4]   2> 578910 T1492 oashc.SuggestComponent.inform Initializing SuggestComponent
:    [junit4]   2> 578910 T1492 oasss.SolrSuggester.init init: {name=blended_infix_suggest_linear,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=FileDictionaryFactory,buildOnCommit=false,sourceLocation=blendedInfixSuggest.txt,indexPath=blendedInfixDir1,blenderType=linear,suggestAnalyzerFieldType=text}
:    [junit4]   2> 579918 T1492 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@6ae7b2a
:    [junit4]   2> 579918 T1493 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@59329086[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
:    [junit4]   2> 579918 T1492 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
:    [junit4]   2> 579919 T1492 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
:    [junit4]   2> 579919 T1492 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
:    [junit4]   2> 579919 T1492 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
:    [junit4]   2> 579920 T1492 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
:    [junit4]   2> 579920 T1492 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
:    [junit4]   2> 579920 T1492 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-41A319E125435502-001/init-core-data-001 [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-41A319E125435502-001/init-core-data-001;done=false>>]
:    [junit4]   2> 579920 T1492 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-41A319E125435502-001/init-core-data-001
:    [junit4]   2> 579921 T1492 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-41A319E125435502-001/init-core-data-001/index [CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-41A319E125435502-001/init-core-data-001/index;done=false>>]
:    [junit4]   2> 579921 T1492 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solr.spelling.suggest.TestFuzzyAnalyzedSuggestions-41A319E125435502-001/init-core-data-001/index
:    [junit4]   2> 579921 T1492 oasc.CoreContainer.create ERROR Error creating core [collection1]: null org.apache.solr.common.SolrException
:    [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
:    [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
:    [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
:    [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
:    [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
:    [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
:    [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
:    [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
:    [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
:    [junit4]   2> Caused by: java.lang.RuntimeException
:    [junit4]   2> 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
:    [junit4]   2> 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
:    [junit4]   2> 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
:    [junit4]   2> 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
:    [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
:    [junit4]   2> 	... 8 more
:    [junit4]   2> 
:    [junit4]   2> 579925 T1491 oas.SolrTestCaseJ4.initCore ####initCore end
:    [junit4]   2> 579925 T1491 oas.SolrTestCaseJ4.deleteCore ###deleteCore
:    [junit4]   2> 579926 T1491 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1482249818
:    [junit4]   2> NOTE: test params are: codec=Lucene45, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=zh_TW, timezone=America/Blanc-Sablon
:    [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_60 (64-bit)/cpus=16,threads=1,free=340470168,total=520093696
:    [junit4]   2> NOTE: All tests run in this JVM: [AddSchemaFieldsUpdateProcessorFactoryTest, DebugComponentTest, ClusterStateUpdateTest, TestReload, ZkControllerTest, TestWriterPerf, TestRecovery, TestIntervalFaceting, TestDynamicFieldCollectionResource, TestPivotHelperCode, TestMaxScoreQueryParser, TestSchemaSimilarityResource, TestPerFieldSimilarity, TestSolrQueryParser, IndexSchemaRuntimeFieldTest, SampleTest, TestSchemaVersionResource, TestQuerySenderListener, CollectionsAPIAsyncDistributedZkTest, TestInfoStreamLogging, TestBlendedInfixSuggestions, TestFieldCollectionResource, TestFieldResource, HttpPartitionTest, TestFreeTextSuggestions, TestExceedMaxTermLength, TestRecoveryHdfs, StatelessScriptUpdateProcessorFactoryTest, TestBinaryResponseWriter, TestLeaderElectionZkExpiry, XsltUpdateRequestHandlerTest, TestReversedWildcardFilterFactory, TestSolrCoreProperties, AliasIntegrationTest, TestBM25SimilarityFactory, QueryParsingTest, DeleteReplicaTest, CustomCollectionTest, TestRel
 oadAndDeleteDocs, CachingDirectoryFactoryTest, IndexBasedSpellCheckerTest, TestQuerySenderNoQuery, ResourceLoaderTest, MinimalSchemaTest, InfoHandlerTest, NumericFieldsTest, SolrPluginUtilsTest, TestManagedStopFilterFactory, TestFuzzyAnalyzedSuggestions]
:    [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestFuzzyAnalyzedSuggestions -Dtests.seed=41A319E125435502 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=zh_TW -Dtests.timezone=America/Blanc-Sablon -Dtests.file.encoding=US-ASCII
:    [junit4] ERROR   0.00s J0 | TestFuzzyAnalyzedSuggestions (suite) <<<
:    [junit4]    > Throwable #1: org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: null
:    [junit4]    > 	at __randomizedtesting.SeedInfo.seed([41A319E125435502]:0)
:    [junit4]    > 	at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:745)
:    [junit4]    > 	at org.apache.solr.util.TestHarness.getCore(TestHarness.java:209)
:    [junit4]    > 	at org.apache.solr.util.TestHarness$LocalRequestFactory.makeRequest(TestHarness.java:420)
:    [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.req(SolrTestCaseJ4.java:990)
:    [junit4]    > 	at org.apache.solr.spelling.suggest.TestFuzzyAnalyzedSuggestions.beforeClass(TestFuzzyAnalyzedSuggestions.java:34)
:    [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
:    [junit4]    > Caused by: org.apache.solr.common.SolrException
:    [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
:    [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
:    [junit4]    > 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
:    [junit4]    > 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
:    [junit4]    > 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
:    [junit4]    > 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
:    [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
:    [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
:    [junit4]    > 	... 1 more
:    [junit4]    > Caused by: java.lang.RuntimeException
:    [junit4]    > 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
:    [junit4]    > 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
:    [junit4]    > 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
:    [junit4]    > 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
:    [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
:    [junit4]    > 	... 8 more
:    [junit4] Completed on J0 in 1.49s, 0 tests, 1 error <<< FAILURES!
: 
: [...truncated 293 lines...]
:    [junit4] Suite: org.apache.solr.cloud.OverseerTest
:    [junit4]   2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J1/./solr.cloud.OverseerTest-41A319E125435502-001/init-core-data-001
:    [junit4]   2> 2078956 T4164 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
:    [junit4]   2> 2078956 T4164 oas.SolrTestCaseJ4.initCore ####initCore
:    [junit4]   2> 2078957 T4164 oas.SolrTestCaseJ4.initCore ####initCore end
:    [junit4]   2> 2078961 T4164 oas.SolrTestCaseJ4.setUp ###Starting testReplay
:    [junit4]   2> 2078962 T4164 oasc.ZkTestServer.run STARTING ZK TEST SERVER
:    [junit4]   1> client port:0.0.0.0/0.0.0.0:0
:    [junit4]   2> 2078963 T4165 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
:    [junit4]   2> 2079063 T4164 oasc.ZkTestServer.run start zk server on port:30697
:    [junit4]   2> 2079064 T4164 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
:    [junit4]   2> 2079068 T4171 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2c6f62bf name:ZooKeeperConnection Watcher:127.0.0.1:30697/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 2079069 T4164 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
:    [junit4]   2> 2079069 T4164 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
:    [junit4]   2> 2079072 T4173 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3a715d1c name:ZooKeeperConnection Watcher:127.0.0.1:30697 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 2079072 T4164 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
:    [junit4]   2> 2079075 T4164 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
:    [junit4]   2> 2079076 T4175 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a474341 name:ZooKeeperConnection Watcher:127.0.0.1:30697 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 2079076 T4164 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
:    [junit4]   2> 2079077 T4164 oascc.SolrZkClient.makePath makePath: /solr
:    [junit4]   2> 2079080 T4164 oascc.SolrZkClient.makePath makePath: /live_nodes
:    [junit4]   2> 2079082 T4164 oascc.SolrZkClient.makePath makePath: /clusterstate.json
:    [junit4]   2> 2079083 T4164 oascc.SolrZkClient.makePath makePath: /aliases.json
:    [junit4]   2> 2079084 T4164 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
:    [junit4]   2> 2079086 T4164 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
:    [junit4]   2> 2079089 T4164 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
:    [junit4]   2> 2079090 T4177 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@592e7c3f name:ZooKeeperConnection Watcher:127.0.0.1:30697/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 2079090 T4164 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
:    [junit4]   2> 2079091 T4164 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: retry=false
:    [junit4]   2> 2079095 T4164 oascc.SolrZkClient.makePath makePath: /overseer_elect
:    [junit4]   2> 2079096 T4164 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
:    [junit4]   2> 2079097 T4164 oasc.Overseer.close Overseer (id=null) closing
:    [junit4]   2> 2079099 T4164 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:30697_solr
:    [junit4]   2> 2079099 T4164 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
:    [junit4]   2> 2079100 T4164 oasc.Overseer.start Overseer (id=92321677498122243-127.0.0.1:30697_solr-n_0000000000) starting
:    [junit4]   2> 2079102 T4164 oascc.SolrZkClient.makePath makePath: /overseer/queue
:    [junit4]   2> 2079104 T4164 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
:    [junit4]   2> 2079106 T4164 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
:    [junit4]   2> 2079107 T4164 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
:    [junit4]   2> 2079109 T4164 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
:    [junit4]   2> 2079113 T4164 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
:    [junit4]   2> 2079113 T4179 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
:    [junit4]   2> 2079115 T4178 oasc.Overseer$ClusterStateUpdater.run Replaying operations from work queue.
:    [junit4]   2> 2079115 T4178 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
:    [junit4]   2> 	  "operation":"state",
:    [junit4]   2> 	  "base_url":"http://127.0.0.1/solr",
:    [junit4]   2> 	  "node_name":"node1",
:    [junit4]   2> 	  "shard":"s1",
:    [junit4]   2> 	  "collection":"collection1",
:    [junit4]   2> 	  "core":"core1",
:    [junit4]   2> 	  "roles":"",
:    [junit4]   2> 	  "state":"recovering"}
:    [junit4]   2> 2079116 T4181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
:    [junit4]   2> 2079118 T4178 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
:    [junit4]   2> 	  "operation":"state",
:    [junit4]   2> 	  "base_url":"http://127.0.0.1/solr",
:    [junit4]   2> 	  "node_name":"node1",
:    [junit4]   2> 	  "shard":"s1",
:    [junit4]   2> 	  "collection":"collection1",
:    [junit4]   2> 	  "core":"core2",
:    [junit4]   2> 	  "roles":"",
:    [junit4]   2> 	  "state":"recovering"}
:    [junit4]   2> 2079119 T4181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
:    [junit4]   2> 2079120 T4178 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
:    [junit4]   2> 2079121 T4178 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
:    [junit4]   2> 	  "operation":"state",
:    [junit4]   2> 	  "base_url":"http://127.0.0.1/solr",
:    [junit4]   2> 	  "node_name":"node1",
:    [junit4]   2> 	  "shard":"s1",
:    [junit4]   2> 	  "collection":"collection1",
:    [junit4]   2> 	  "core":"core3",
:    [junit4]   2> 	  "roles":"",
:    [junit4]   2> 	  "state":"recovering"}
:    [junit4]   2> 2079123 T4182 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
:    [junit4]   2> 2079123 T4181 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 0)
:    [junit4]   2> 2079219 T4164 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:30697 30697
:    [junit4]   2> 2079416 T4165 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:30697 30697
:    [junit4]   2> 2079419 T4164 oas.SolrTestCaseJ4.tearDown ###Ending testReplay
:    [junit4]   2> 2079420 T4164 oasc.Overseer.close Overseer (id=92321677498122243-127.0.0.1:30697_solr-n_0000000000) closing
:    [junit4]   2> 2079420 T4178 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:30697_solr
:    [junit4]   2> 2079423 T4183 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
:    [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
:    [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
:    [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
:    [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:307)
:    [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:304)
:    [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
:    [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:304)
:    [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:320)
:    [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:89)
:    [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:292)
:    [junit4]   2> 
:    [junit4]   2> 2079431 T4164 oas.SolrTestCaseJ4.setUp ###Starting testShardAssignmentBigger
:    [junit4]   2> 2079432 T4164 oasc.ZkTestServer.run STARTING ZK TEST SERVER
:    [junit4]   1> client port:0.0.0.0/0.0.0.0:0
:    [junit4]   2> 2079433 T4184 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
:    [junit4]   2> 2079533 T4164 oasc.ZkTestServer.run start zk server on port:24615
:    [junit4]   2> 2079534 T4164 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
:    [junit4]   2> 2079538 T4190 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3fcf951c name:ZooKeeperConnection Watcher:127.0.0.1:24615 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 2079538 T4164 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
:    [junit4]   2> 2079542 T4164 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
:    [junit4]   2> 2079543 T4192 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@43d55824 name:ZooKeeperConnection Watcher:127.0.0.1:24615 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
:    [junit4]   2> 2079543 T4164 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
:    [junit4]   2> 2079544 T4164 oascc.SolrZkClient.makePath makePath: /solr
:    [junit4]   2> 2079549 T4164 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
:    [junit4]   2> 2079550 T4194 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3e50bb84 name:ZooKeeperConnection Watcher:127.0.0.1:24615/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
:    [junit4
: 
: [...truncated too long message...]
: 
: .concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
:    [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
:    [junit4]   2> Caused by: java.lang.RuntimeException
:    [junit4]   2> 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
:    [junit4]   2> 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
:    [junit4]   2> 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
:    [junit4]   2> 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
:    [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
:    [junit4]   2> 	... 8 more
:    [junit4]   2> 
:    [junit4]   2> 4724166 T9902 oas.SolrTestCaseJ4.initCore ####initCore end
:    [junit4]   2> 4724167 T9902 oas.SolrTestCaseJ4.deleteCore ###deleteCore
:    [junit4]   2> 4724167 T9902 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1765317080
:    [junit4]   2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=319), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=319)), sim=DefaultSimilarity, locale=ar_EG, timezone=America/Guayaquil
:    [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_60 (64-bit)/cpus=16,threads=1,free=188245632,total=536870912
:    [junit4]   2> NOTE: All tests run in this JVM: [AddSchemaFieldsUpdateProcessorFactoryTest, DebugComponentTest, ClusterStateUpdateTest, TestReload, ZkControllerTest, TestWriterPerf, TestRecovery, TestIntervalFaceting, TestDynamicFieldCollectionResource, TestPivotHelperCode, TestMaxScoreQueryParser, TestSchemaSimilarityResource, TestPerFieldSimilarity, TestSolrQueryParser, IndexSchemaRuntimeFieldTest, SampleTest, TestSchemaVersionResource, TestQuerySenderListener, CollectionsAPIAsyncDistributedZkTest, TestInfoStreamLogging, TestBlendedInfixSuggestions, TestFieldCollectionResource, TestFieldResource, HttpPartitionTest, TestFreeTextSuggestions, TestExceedMaxTermLength, TestRecoveryHdfs, StatelessScriptUpdateProcessorFactoryTest, TestBinaryResponseWriter, TestLeaderElectionZkExpiry, XsltUpdateRequestHandlerTest, TestReversedWildcardFilterFactory, TestSolrCoreProperties, AliasIntegrationTest, TestBM25SimilarityFactory, QueryParsingTest, DeleteReplicaTest, CustomCollectionTest, TestRel
 oadAndDeleteDocs, CachingDirectoryFactoryTest, IndexBasedSpellCheckerTest, TestQuerySenderNoQuery, ResourceLoaderTest, MinimalSchemaTest, InfoHandlerTest, NumericFieldsTest, SolrPluginUtilsTest, TestManagedStopFilterFactory, TestFuzzyAnalyzedSuggestions, HdfsUnloadDistributedZkTest, SystemInfoHandlerTest, TestFastWriter, SolrCmdDistributorTest, TestManagedSchema, HdfsDirectoryTest, TimeZoneUtilsTest, OverseerCollectionProcessorTest, TestSurroundQueryParser, DistribDocExpirationUpdateProcessorTest, HdfsSyncSliceTest, NotRequiredUniqueKeyTest, TestReRankQParserPlugin, TestStressLucene, PathHierarchyTokenizerFactoryTest, TestSolrQueryParserDefaultOperatorResource, TestNonNRTOpen, BasicDistributedZkTest, TestStandardQParsers, TestCloudManagedSchema, ZkSolrClientTest, TestOmitPositions, SolrTestCaseJ4Test, BadComponentTest, TestPartialUpdateDeduplication, StressHdfsTest, DistributedIntervalFacetingTest, SuggesterTest, DistributedQueryElevationComponentTest, HdfsRecoveryZkTest, FieldMutat
 ingUpdateProcessorTest, ReplicationFactorTest, AnalyticsMergeStrategyTest, AssignTest, CoreAdminCreateDiscoverTest, ResponseHeaderTest, TermVectorComponentDistributedTest, ExternalFileFieldSortTest, HdfsLockFactoryTest, SSLMigrationTest, PolyFieldTest, DocExpirationUpdateProcessorFactoryTest, TestCustomSort, ConvertedLegacyTest, TestIBSimilarityFactory, ZkNodePropsTest, TestNoOpRegenerator, CollectionsAPIDistributedZkTest, DocumentBuilderTest, QueryElevationComponentTest, ChaosMonkeySafeLeaderTest, TestCloudManagedSchemaConcurrent, ShardRoutingTest, UnloadDistributedZkTest, AsyncMigrateRouteKeyTest, TestManagedSchemaFieldResource, LeaderElectionIntegrationTest, TestRequestStatusCollectionAPI, TestDistribDocBasedVersion, DistributedTermsComponentTest, TestDistributedMissingSort, TestJoin, DistributedFacetPivotLargeTest, TestCollectionAPI, MergeStrategyTest, TestCoreContainer, TestHashPartitioner, PeerSyncTest, TestRealTimeGet, TestGroupingSearch, TestManagedSynonymFilterFactory, Test
 DocBasedVersionConstraints, ZkCLITest, TestSolr4Spatial, TestRangeQuery, TestSolrXmlPersistence, SpellCheckComponentTest, CacheHeaderTest, TestCopyFieldCollectionResource, TestSchemaNameResource, TestUniqueKeyFieldResource, TestFaceting, TestStressUserVersions, SolrXmlInZkTest, StatsComponentTest, BasicFunctionalityTest, CursorMarkTest, TestFunctionQuery, CurrencyFieldXmlFileTest, SchemaVersionSpecificBehaviorTest, TestAtomicUpdateErrorCases, DocValuesMissingTest, TestExtendedDismaxParser, TestIndexSearcher, TestMultiCoreConfBootstrap, TestPseudoReturnFields, SignatureUpdateProcessorFactoryTest, SpatialFilterTest, TestWordDelimiterFilterFactory, TestCSVLoader, TestNRTOpen, TestSolrDeletionPolicy1, DisMaxRequestHandlerTest, XmlUpdateRequestHandlerTest, BJQParserTest, TestCSVResponseWriter, DirectSolrSpellCheckerTest, TestCoreDiscovery, TermVectorComponentTest, TestConfig, LoggingHandlerTest, TermsComponentTest, TestUpdate, AnalyticsQueryTest, TestTrie, SOLR749Test, IndexSchemaTest, F
 ieldAnalysisRequestHandlerTest, RegexBoostProcessorTest, CoreMergeIndexesAdminHandlerTest, TestQueryUtils, TestQueryTypes, TestComponentsName, TestSolrDeletionPolicy2, CopyFieldTest, RequiredFieldsTest, TestPostingsSolrHighlighter, DocValuesMultiTest, TestSolrXml, TestSolr4Spatial2, TestAnalyzeInfixSuggestions, TestHighFrequencyDictionaryFactory, TestLuceneMatchVersion, TestFileDictionaryLookup]
:    [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestFileDictionaryLookup -Dtests.seed=41A319E125435502 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar_EG -Dtests.timezone=America/Guayaquil -Dtests.file.encoding=US-ASCII
:    [junit4] ERROR   0.00s J0 | TestFileDictionaryLookup (suite) <<<
:    [junit4]    > Throwable #1: org.apache.solr.common.SolrException: SolrCore 'collection1' is not available due to init failure: null
:    [junit4]    > 	at __randomizedtesting.SeedInfo.seed([41A319E125435502]:0)
:    [junit4]    > 	at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:745)
:    [junit4]    > 	at org.apache.solr.util.TestHarness.getCore(TestHarness.java:209)
:    [junit4]    > 	at org.apache.solr.util.TestHarness$LocalRequestFactory.makeRequest(TestHarness.java:420)
:    [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.req(SolrTestCaseJ4.java:990)
:    [junit4]    > 	at org.apache.solr.spelling.suggest.TestFileDictionaryLookup.beforeClass(TestFileDictionaryLookup.java:30)
:    [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
:    [junit4]    > Caused by: org.apache.solr.common.SolrException
:    [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
:    [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
:    [junit4]    > 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
:    [junit4]    > 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:255)
:    [junit4]    > 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:249)
:    [junit4]    > 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
:    [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
:    [junit4]    > 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
:    [junit4]    > 	... 1 more
:    [junit4]    > Caused by: java.lang.RuntimeException
:    [junit4]    > 	at org.apache.solr.spelling.suggest.fst.BlendedInfixLookupFactory.create(BlendedInfixLookupFactory.java:102)
:    [junit4]    > 	at org.apache.solr.spelling.suggest.SolrSuggester.init(SolrSuggester.java:104)
:    [junit4]    > 	at org.apache.solr.handler.component.SuggestComponent.inform(SuggestComponent.java:113)
:    [junit4]    > 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:651)
:    [junit4]    > 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:856)
:    [junit4]    > 	... 8 more
:    [junit4] Completed on J0 in 1.68s, 0 tests, 1 error <<< FAILURES!
: 
: [...truncated 147 lines...]
: BUILD FAILED
: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:475: The following error occurred while executing this line:
: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:455: The following error occurred while executing this line:
: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:45: The following error occurred while executing this line:
: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/extra-targets.xml:37: The following error occurred while executing this line:
: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:189: The following error occurred while executing this line:
: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:496: The following error occurred while executing this line:
: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1351: The following error occurred while executing this line:
: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:966: There were test failures: 419 suites, 1723 tests, 6 suite-level errors, 1 error, 53 ignored (19 assumptions)
: 
: Total time: 132 minutes 35 seconds
: Build step 'Invoke Ant' marked build as failure
: Archiving artifacts
: Sending artifact delta relative to Lucene-Solr-Tests-4.x-Java7 #2065
: Archived 3 artifacts
: Archive block size is 32768
: Received 0 blocks and 225965606 bytes
: Compression is 0.0%
: Took 41 sec
: Recording test results
: Email was triggered for: Failure
: Sending email for trigger: Failure
: 
: 
: 

-Hoss
http://www.lucidworks.com/