You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/11/04 12:40:53 UTC

[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0_40-ea-b09) - Build # 11564 - Failure!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/11564/
Java: 32bit/jdk1.8.0_40-ea-b09 -client -XX:+UseSerialGC (asserts: true)

2 tests failed.
REGRESSION:  org.apache.solr.cloud.DistribDocExpirationUpdateProcessorTest.testDistribSearch

Error Message:
There are still nodes recoverying - waited for 30 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 30 seconds
	at __randomizedtesting.SeedInfo.seed([99406107AF3F7693:18A6EF1FD86016AF]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:178)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:840)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForThingsToLevelOut(AbstractFullDistribZkTestBase.java:1459)
	at org.apache.solr.cloud.DistribDocExpirationUpdateProcessorTest.doTest(DistribDocExpirationUpdateProcessorTest.java:79)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
	at sun.reflect.GeneratedMethodAccessor57.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)


REGRESSION:  org.apache.solr.spelling.SpellCheckCollatorTest.testEstimatedHitCounts

Error Message:
Exception during query

Stack Trace:
java.lang.RuntimeException: Exception during query
	at __randomizedtesting.SeedInfo.seed([99406107AF3F7693:A8FBDF320A006643]:0)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:723)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:690)
	at org.apache.solr.spelling.SpellCheckCollatorTest.testEstimatedHitCounts(SpellCheckCollatorTest.java:530)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//lst[@name='spellcheck']/lst[@name='collations']/lst[@name='collation']/int[@name='hits' and 6 <= . and . <= 10]
	xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">4</int></lst><result name="response" numFound="0" start="0"></result><lst name="spellcheck"><lst name="suggestions"><lst name="everother"><int name="numFound">1</int><int name="startOffset">9</int><int name="endOffset">18</int><arr name="suggestion"><str>everyother</str></arr></lst></lst><lst name="collations"><lst name="collation"><str name="collationQuery">teststop:everyother</str><int name="hits">14</int><lst name="misspellingsAndCorrections"><str name="everother">everyother</str></lst></lst></lst></lst>
</response>

	request was:spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Aeverother&spellcheck.collateMaxCollectDocs=5
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:716)
	... 42 more




Build Log:
[...truncated 11361 lines...]
   [junit4] Suite: org.apache.solr.spelling.SpellCheckCollatorTest
   [junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.spelling.SpellCheckCollatorTest-99406107AF3F7693-001/init-core-data-001
   [junit4]   2> 1663515 T3073 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
   [junit4]   2> 1663516 T3073 oas.SolrTestCaseJ4.initCore ####initCore
   [junit4]   2> 1663517 T3073 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/'
   [junit4]   2> 1663517 T3073 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
   [junit4]   2> 1663518 T3073 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 1663518 T3073 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 1663569 T3073 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1663589 T3073 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-spellcheckcomponent.xml
   [junit4]   2> 1663590 T3073 oass.IndexSchema.readSchema Reading Solr Schema from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml
   [junit4]   2> 1663600 T3073 oass.IndexSchema.readSchema [null] Schema name=test
   [junit4]   2> 1663733 T3073 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1663738 T3073 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1663739 T3073 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1663749 T3073 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1663751 T3073 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1663753 T3073 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1663754 T3073 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1663754 T3073 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1663755 T3073 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1663755 T3073 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1663756 T3073 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1663756 T3073 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1663756 T3073 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr
   [junit4]   2> 1663757 T3073 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/'
   [junit4]   2> 1663788 T3073 oasc.CoreContainer.<init> New CoreContainer 7096418
   [junit4]   2> 1663788 T3073 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/]
   [junit4]   2> 1663789 T3073 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 1663789 T3073 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 1663790 T3073 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 1663790 T3073 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1663790 T3073 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 1663791 T3073 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1663791 T3073 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1663792 T3073 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1663792 T3073 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1663792 T3073 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1663796 T3073 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=30000&connTimeout=30000&retry=false
   [junit4]   2> 1663799 T3073 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1663799 T3073 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1663800 T3073 oasc.CoreContainer.load Host Name: 
   [junit4]   2> 1663803 T3074 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/'
   [junit4]   2> 1663805 T3074 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
   [junit4]   2> 1663805 T3074 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 1663806 T3074 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 1663847 T3074 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1663862 T3074 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-spellcheckcomponent.xml
   [junit4]   2> 1663863 T3074 oass.IndexSchema.readSchema Reading Solr Schema from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml
   [junit4]   2> 1663873 T3074 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1664008 T3074 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1664013 T3074 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1664014 T3074 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1664023 T3074 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1664026 T3074 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1664028 T3074 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1664028 T3074 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1664029 T3074 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1664029 T3074 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1664029 T3074 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1664030 T3074 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1664030 T3074 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/
   [junit4]   2> 1664030 T3074 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1664031 T3074 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.spelling.SpellCheckCollatorTest-99406107AF3F7693-001/init-core-data-001/
   [junit4]   2> 1664031 T3074 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 1664032 T3074 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.spelling.SpellCheckCollatorTest-99406107AF3F7693-001/init-core-data-001
   [junit4]   2> 1664032 T3074 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.spelling.SpellCheckCollatorTest-99406107AF3F7693-001/init-core-data-001/index/
   [junit4]   2> 1664032 T3074 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.spelling.SpellCheckCollatorTest-99406107AF3F7693-001/init-core-data-001/index' doesn't exist. Creating new index...
   [junit4]   2> 1664033 T3074 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.spelling.SpellCheckCollatorTest-99406107AF3F7693-001/init-core-data-001/index
   [junit4]   2> 1664033 T3074 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=22, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2592201588121793]
   [junit4]   2> 1664034 T3074 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-181488d)),segFN=segments_1,generation=1}
   [junit4]   2> 1664034 T3074 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1664035 T3074 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1664035 T3074 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1664036 T3074 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1664036 T3074 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1664036 T3074 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1664036 T3074 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1664037 T3074 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1664037 T3074 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1664037 T3074 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1664039 T3074 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1664040 T3074 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1664041 T3074 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1664042 T3074 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1664044 T3074 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1664044 T3074 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1664044 T3074 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=22, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 1664045 T3074 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-181488d)),segFN=segments_1,generation=1}
   [junit4]   2> 1664045 T3074 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1664045 T3074 oass.SolrIndexSearcher.<init> Opening Searcher@190d383[collection1] main
   [junit4]   2> 1664046 T3074 oasr.ManagedResourceStorage.newStorageIO WARN Cannot write to config directory /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
   [junit4]   2> 1664046 T3074 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1664046 T3074 oasr.ManagedResourceStorage.load Reading _rest_managed.json using InMemoryStorage
   [junit4]   2> 1664047 T3074 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
   [junit4]   2> 1664047 T3074 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using InMemoryStorage
   [junit4]   2> 1664047 T3074 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1664047 T3074 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 1664052 T3074 oashc.SpellCheckComponent.inform Registering newSearcher listener for spellchecker: default
   [junit4]   2> 1664056 T3074 oashc.SpellCheckComponent.inform Registering newSearcher listener for spellchecker: default_teststop
   [junit4]   2> 1664056 T3074 oass.DirectSolrSpellChecker.init init: {name=direct,classname=solr.DirectSolrSpellChecker,minQueryLength=3,maxQueryFrequency=100.0,field=teststop}
   [junit4]   2> 1664057 T3074 oass.DirectSolrSpellChecker.init init: {name=direct_lowerfilt,classname=solr.DirectSolrSpellChecker,minQueryLength=3,maxQueryFrequency=100.0,field=lowerfilt}
   [junit4]   2> 1664060 T3074 oashc.SpellCheckComponent.inform Registering newSearcher listener for spellchecker: threshold
   [junit4]   2> 1664060 T3074 oass.DirectSolrSpellChecker.init init: {name=threshold_direct,classname=solr.DirectSolrSpellChecker,field=lowerfilt,spellcheckIndexDir=spellcheckerThreshold,buildOnCommit=true,thresholdTokenFrequency=0.29}
   [junit4]   2> 1664061 T3074 oashc.SpellCheckComponent.inform Registering newSearcher listener for spellchecker: threshold_direct
   [junit4]   2> 1664064 T3074 oashc.SpellCheckComponent.inform Registering newSearcher listener for spellchecker: multipleFields
   [junit4]   2> 1664074 T3074 oashc.SpellCheckComponent.inform Registering newSearcher listener for spellchecker: freq
   [junit4]   2> 1664077 T3074 oashc.SpellCheckComponent.inform Registering newSearcher listener for spellchecker: fqcn
   [junit4]   2> 1664078 T3075 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@190d383[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1664078 T3074 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1664080 T3073 oas.SolrTestCaseJ4.initCore ####initCore end
   [junit4]   2> ASYNC  NEW_CORE C1582 name=collection1 org.apache.solr.core.SolrCore@53fed4
   [junit4]   2> 1664081 T3073 C1582 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[0]} 0 1
   [junit4]   2> ASYNC  NEW_CORE C1583 name=collection1 org.apache.solr.core.SolrCore@53fed4
   [junit4]   2> 1664100 T3073 C1583 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[1]} 0 17
   [junit4]   2> 1664104 T3073 C1583 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[2]} 0 1
   [junit4]   2> 1664112 T3073 C1583 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[3]} 0 6
   [junit4]   2> 1664115 T3073 C1583 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[4]} 0 1
   [junit4]   2> 1664121 T3073 C1583 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[5]} 0 5
   [junit4]   2> 1664123 T3073 C1583 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[6]} 0 1
   [junit4]   2> 1664129 T3073 C1583 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[7]} 0 5
   [junit4]   2> 1664130 T3073 C1583 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[8]} 0 0
   [junit4]   2> 1664135 T3073 C1583 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[9]} 0 4
   [junit4]   2> 1664137 T3073 C1583 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[10]} 0 1
   [junit4]   2> 1664141 T3073 C1583 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[11]} 0 3
   [junit4]   2> 1664143 T3073 C1583 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[12]} 0 1
   [junit4]   2> 1664148 T3073 C1583 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[13]} 0 4
   [junit4]   2> 1664149 T3073 C1583 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[14]} 0 1
   [junit4]   2> 1664153 T3073 C1583 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[15]} 0 3
   [junit4]   2> 1664155 T3073 C1583 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[16]} 0 1
   [junit4]   2> 1664156 T3073 C1583 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1664178 T3073 C1583 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-181488d)),segFN=segments_1,generation=1}
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-181488d)),segFN=segments_2,generation=2}
   [junit4]   2> 1664179 T3073 C1583 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
   [junit4]   2> 1664182 T3073 C1583 oass.SolrIndexSearcher.<init> Opening Searcher@25fc7f[collection1] main
   [junit4]   2> 1664183 T3073 C1583 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 1664183 T3075 oashc.SpellCheckComponent$SpellCheckerListener.buildSpellIndex Building spell index for spell checker: default
   [junit4]   2> 1664229 T3075 oashc.SpellCheckComponent$SpellCheckerListener.buildSpellIndex Building spell index for spell checker: default_teststop
   [junit4]   2> 1664288 T3075 oashc.SpellCheckComponent$SpellCheckerListener.buildSpellIndex Building spell index for spell checker: threshold
   [junit4]   2> 1664310 T3075 oashc.SpellCheckComponent$SpellCheckerListener.buildSpellIndex Building spell index for spell checker: threshold_direct
   [junit4]   2> 1664311 T3075 oashc.SpellCheckComponent$SpellCheckerListener.buildSpellIndex Building spell index for spell checker: multipleFields
   [junit4]   2> 1664358 T3075 oashc.SpellCheckComponent$SpellCheckerListener.buildSpellIndex Building spell index for spell checker: freq
   [junit4]   2> 1664409 T3075 oashc.SpellCheckComponent$SpellCheckerListener.buildSpellIndex Building spell index for spell checker: fqcn
   [junit4]   2> 1664461 T3075 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@25fc7f[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):C2) Uninverting(_1(6.0.0):C2) Uninverting(_2(6.0.0):C2) Uninverting(_3(6.0.0):C2) Uninverting(_4(6.0.0):C2) Uninverting(_5(6.0.0):C2) Uninverting(_6(6.0.0):C2) Uninverting(_7(6.0.0):C2) Uninverting(_8(6.0.0):C1)))}
   [junit4]   2> 1664462 T3073 C1583 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 307
   [junit4]   2> 1664466 T3073 oas.SolrTestCaseJ4.setUp ###Starting testCollateWithMultipleRequestHandlers
   [junit4]   2> 1664523 T3073 oas.SolrTestCaseJ4.tearDown ###Ending testCollateWithMultipleRequestHandlers
   [junit4]   2> 1664528 T3073 oas.SolrTestCaseJ4.setUp ###Starting testZeroTries
   [junit4]   2> 1664607 T3073 oas.SolrTestCaseJ4.tearDown ###Ending testZeroTries
   [junit4]   2> 1664611 T3073 oas.SolrTestCaseJ4.setUp ###Starting testContextSensitiveCollate
   [junit4]   2> 1664647 T3073 C1583 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&spellcheck.dictionary=direct&indent=true&spellcheck.maxCollations=1&spellcheck.maxCollationTries=10&spellcheck.alternativeTermCount=5&spellcheck.build=true&spellcheck.extendedResults=true&q=teststop:(flew+AND+form+AND+heathrow)&spellcheck.maxResultsForSuggest=0&spellcheck=true&spellcheck.count=10&spellcheck.collate=true} hits=0 status=0 QTime=35 
   [junit4]   2> 1664657 T3073 C1583 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&spellcheck.dictionary=direct&indent=true&spellcheck.maxCollations=1&spellcheck.maxCollationTries=10&spellcheck.alternativeTermCount=5&spellcheck.extendedResults=true&q=teststop:(june+AND+customs)&spellcheck.maxResultsForSuggest=1&spellcheck=true&spellcheck.count=10&spellcheck.collate=true} hits=1 status=0 QTime=7 
   [junit4]   2> 1664661 T3073 C1583 oasc.SolrCore.execute [collection1] webapp=null path=null params={mm=2&q=teststop:(june+customs)&qt=spellCheckCompRH&spellcheck.dictionary=direct&indent=true&spellcheck=true&spellcheck.count=10&spellcheck.alternativeTermCount=0&spellcheck.collate=true} hits=2 status=0 QTime=1 
   [junit4]   2> 1664748 T3073 C1583 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&spellcheck.dictionary=default_teststop&indent=true&spellcheck.maxCollations=1&spellcheck.maxCollationTries=10&spellcheck.alternativeTermCount=5&spellcheck.build=true&spellcheck.extendedResults=true&q=teststop:(flew+AND+form+AND+heathrow)&spellcheck.maxResultsForSuggest=0&spellcheck=true&spellcheck.count=10&spellcheck.collate=true} hits=0 status=0 QTime=86 
   [junit4]   2> 1664754 T3073 C1583 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&spellcheck.dictionary=default_teststop&indent=true&spellcheck.maxCollations=1&spellcheck.maxCollationTries=10&spellcheck.alternativeTermCount=5&spellcheck.extendedResults=true&q=teststop:(june+AND+customs)&spellcheck.maxResultsForSuggest=1&spellcheck=true&spellcheck.count=10&spellcheck.collate=true} hits=1 status=0 QTime=3 
   [junit4]   2> 1664758 T3073 C1583 oasc.SolrCore.execute [collection1] webapp=null path=null params={mm=2&q=teststop:(june+customs)&qt=spellCheckCompRH&spellcheck.dictionary=default_teststop&indent=true&spellcheck=true&spellcheck.count=10&spellcheck.alternativeTermCount=0&spellcheck.collate=true} hits=2 status=0 QTime=1 
   [junit4]   2> 1664758 T3073 oas.SolrTestCaseJ4.tearDown ###Ending testContextSensitiveCollate
   [junit4]   2> 1664762 T3073 oas.SolrTestCaseJ4.setUp ###Starting testEstimatedHitCounts
   [junit4]   2> 1664767 T3073 C1583 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Ametnoia} hits=0 status=0 QTime=4 
   [junit4]   2> 1664773 T3073 C1583 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Ametnoia&spellcheck.collateMaxCollectDocs=0} hits=0 status=0 QTime=5 
   [junit4]   2> 1664779 T3073 C1583 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Ametnoia&spellcheck.collateMaxCollectDocs=30} hits=0 status=0 QTime=4 
   [junit4]   2> 1664785 T3073 C1583 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Ametnoia&spellcheck.collateMaxCollectDocs=100} hits=0 status=0 QTime=4 
   [junit4]   2> 1664790 T3073 C1583 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Ametnoia&spellcheck.collateMaxCollectDocs=10000} hits=0 status=0 QTime=4 
   [junit4]   2> 1664795 T3073 C1583 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Ametnoia&spellcheck.collateMaxCollectDocs=9} hits=0 status=0 QTime=4 
   [junit4]   2> 1664800 T3073 C1583 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Ametnoia&spellcheck.collateMaxCollectDocs=14} hits=0 status=0 QTime=4 
   [junit4]   2> 1664804 T3073 C1583 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Ametnoia&spellcheck.collateMaxCollectDocs=12} hits=0 status=0 QTime=3 
   [junit4]   2> 1664809 T3073 C1583 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Ametnoia&spellcheck.collateMaxCollectDocs=16} hits=0 status=0 QTime=4 
   [junit4]   2> 1664813 T3073 C1583 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Ametnoia&spellcheck.collateMaxCollectDocs=5} hits=0 status=0 QTime=3 
   [junit4]   2> 1664817 T3073 C1583 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Ametnoia&spellcheck.collateMaxCollectDocs=1} hits=0 status=0 QTime=3 
   [junit4]   2> 1664822 T3073 C1583 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Ametnoia&spellcheck.collateMaxCollectDocs=4} hits=0 status=0 QTime=4 
   [junit4]   2> 1664826 T3073 C1583 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Ametnoia&spellcheck.collateMaxCollectDocs=11} hits=0 status=0 QTime=3 
   [junit4]   2> 1664831 T3073 C1583 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Ametnoia&spellcheck.collateMaxCollectDocs=13} hits=0 status=0 QTime=4 
   [junit4]   2> 1664835 T3073 C1583 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Ametnoia&spellcheck.collateMaxCollectDocs=10} hits=0 status=0 QTime=3 
   [junit4]   2> 1664839 T3073 C1583 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Ametnoia&spellcheck.collateMaxCollectDocs=16} hits=0 status=0 QTime=3 
   [junit4]   2> 1664844 T3073 C1583 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Ametnoia&spellcheck.collateMaxCollectDocs=2} hits=0 status=0 QTime=3 
   [junit4]   2> 1664848 T3073 C1583 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Ametnoia&spellcheck.collateMaxCollectDocs=11} hits=0 status=0 QTime=3 
   [junit4]   2> 1664852 T3073 C1583 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Ametnoia&spellcheck.collateMaxCollectDocs=9} hits=0 status=0 QTime=3 
   [junit4]   2> 1664857 T3073 C1583 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Ametnoia&spellcheck.collateMaxCollectDocs=17} hits=0 status=0 QTime=4 
   [junit4]   2> 1664861 T3073 C1583 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Ametnoia&spellcheck.collateMaxCollectDocs=17} hits=0 status=0 QTime=3 
   [junit4]   2> 1664865 T3073 C1583 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Ametnoia&spellcheck.collateMaxCollectDocs=11} hits=0 status=0 QTime=3 
   [junit4]   2> 1664869 T3073 C1583 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Ametnoia&spellcheck.collateMaxCollectDocs=11} hits=0 status=0 QTime=3 
   [junit4]   2> 1664873 T3073 C1583 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Ametnoia&spellcheck.collateMaxCollectDocs=15} hits=0 status=0 QTime=3 
   [junit4]   2> 1664877 T3073 C1583 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Ametnoia&spellcheck.collateMaxCollectDocs=8} hits=0 status=0 QTime=3 
   [junit4]   2> 1664882 T3073 C1583 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Ametnoia&spellcheck.collateMaxCollectDocs=9} hits=0 status=0 QTime=4 
   [junit4]   2> 1664886 T3073 C1583 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Ametnoia&spellcheck.collateMaxCollectDocs=14} hits=0 status=0 QTime=3 
   [junit4]   2> 1664890 T3073 C1583 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Ametnoia&spellcheck.collateMaxCollectDocs=1} hits=0 status=0 QTime=3 
   [junit4]   2> 1664894 T3073 C1583 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Ametnoia&spellcheck.collateMaxCollectDocs=8} hits=0 status=0 QTime=3 
   [junit4]   2> 1664898 T3073 C1583 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Ametnoia&spellcheck.collateMaxCollectDocs=8} hits=0 status=0 QTime=3 
   [junit4]   2> ASYNC  NEW_CORE C1584 name=collection1 org.apache.solr.core.SolrCore@53fed4
   [junit4]   2> 1664914 T3073 C1584 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Ametnoia&spellcheck.collateMaxCollectDocs=13} hits=0 status=0 QTime=15 
   [junit4]   2> 1664921 T3073 C1584 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Ametnoia&spellcheck.collateMaxCollectDocs=4} hits=0 status=0 QTime=5 
   [junit4]   2> 1664930 T3073 C1584 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Ametnoia&spellcheck.collateMaxCollectDocs=4} hits=0 status=0 QTime=7 
   [junit4]   2> 1664938 T3073 C1584 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Ametnoia&spellcheck.collateMaxCollectDocs=17} hits=0 status=0 QTime=6 
   [junit4]   2> 1664945 T3073 C1584 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Ametnoia&spellcheck.collateMaxCollectDocs=17} hits=0 status=0 QTime=6 
   [junit4]   2> 1664950 T3073 C1584 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Ametnoia&spellcheck.collateMaxCollectDocs=12} hits=0 status=0 QTime=4 
   [junit4]   2> 1664955 T3073 C1584 oasc.SolrCore.execute [collection1] webapp=null path=null params={spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Aeverother&spellcheck.collateMaxCollectDocs=5} hits=0 status=0 QTime=4 
   [junit4]   2> 1664956 T3073 oas.SolrTestCaseJ4.assertQ ERROR REQUEST FAILED: xpath=//lst[@name='spellcheck']/lst[@name='collations']/lst[@name='collation']/int[@name='hits' and 6 <= . and . <= 10]
   [junit4]   2> 		xml response was: <?xml version="1.0" encoding="UTF-8"?>
   [junit4]   2> 	<response>
   [junit4]   2> 	<lst name="responseHeader"><int name="status">0</int><int name="QTime">4</int></lst><result name="response" numFound="0" start="0"></result><lst name="spellcheck"><lst name="suggestions"><lst name="everother"><int name="numFound">1</int><int name="startOffset">9</int><int name="endOffset">18</int><arr name="suggestion"><str>everyother</str></arr></lst></lst><lst name="collations"><lst name="collation"><str name="collationQuery">teststop:everyother</str><int name="hits">14</int><lst name="misspellingsAndCorrections"><str name="everother">everyother</str></lst></lst></lst></lst>
   [junit4]   2> 	</response>
   [junit4]   2> 	
   [junit4]   2> 		request was:spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Aeverother&spellcheck.collateMaxCollectDocs=5
   [junit4]   2> 1664958 T3073 oasc.SolrException.log ERROR REQUEST FAILED: spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Aeverother&spellcheck.collateMaxCollectDocs=5:java.lang.RuntimeException: REQUEST FAILED: xpath=//lst[@name='spellcheck']/lst[@name='collations']/lst[@name='collation']/int[@name='hits' and 6 <= . and . <= 10]
   [junit4]   2> 		xml response was: <?xml version="1.0" encoding="UTF-8"?>
   [junit4]   2> 	<response>
   [junit4]   2> 	<lst name="responseHeader"><int name="status">0</int><int name="QTime">4</int></lst><result name="response" numFound="0" start="0"></result><lst name="spellcheck"><lst name="suggestions"><lst name="everother"><int name="numFound">1</int><int name="startOffset">9</int><int name="endOffset">18</int><arr name="suggestion"><str>everyother</str></arr></lst></lst><lst name="collations"><lst name="collation"><str name="collationQuery">teststop:everyother</str><int name="hits">14</int><lst name="misspellingsAndCorrections"><str name="everother">everyother</str></lst></lst></lst></lst>
   [junit4]   2> 	</response>
   [junit4]   2> 	
   [junit4]   2> 		request was:spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Aeverother&spellcheck.collateMaxCollectDocs=5
   [junit4]   2> 		at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:716)
   [junit4]   2> 		at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:690)
   [junit4]   2> 		at org.apache.solr.spelling.SpellCheckCollatorTest.testEstimatedHitCounts(SpellCheckCollatorTest.java:530)
   [junit4]   2> 		at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 		at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2> 		at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 		at java.lang.reflect.Method.invoke(Method.java:497)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
   [junit4]   2> 		at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
   [junit4]   2> 		at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
   [junit4]   2> 		at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
   [junit4]   2> 		at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
   [junit4]   2> 		at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
   [junit4]   2> 		at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2> 		at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 		at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
   [junit4]   2> 		at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2> 		at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
   [junit4]   2> 		at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 		at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
   [junit4]   2> 		at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 	
   [junit4]   2> 1664959 T3073 oas.SolrTestCaseJ4.tearDown ###Ending testEstimatedHitCounts
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SpellCheckCollatorTest -Dtests.method=testEstimatedHitCounts -Dtests.seed=99406107AF3F7693 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar_QA -Dtests.timezone=Asia/Amman -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.22s J0 | SpellCheckCollatorTest.testEstimatedHitCounts <<<
   [junit4]    > Throwable #1: java.lang.RuntimeException: Exception during query
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([99406107AF3F7693:A8FBDF320A006643]:0)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:723)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:690)
   [junit4]    > 	at org.apache.solr.spelling.SpellCheckCollatorTest.testEstimatedHitCounts(SpellCheckCollatorTest.java:530)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]    > Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//lst[@name='spellcheck']/lst[@name='collations']/lst[@name='collation']/int[@name='hits' and 6 <= . and . <= 10]
   [junit4]    > 	xml response was: <?xml version="1.0" encoding="UTF-8"?>
   [junit4]    > <response>
   [junit4]    > <lst name="responseHeader"><int name="status">0</int><int name="QTime">4</int></lst><result name="response" numFound="0" start="0"></result><lst name="spellcheck"><lst name="suggestions"><lst name="everother"><int name="numFound">1</int><int name="startOffset">9</int><int name="endOffset">18</int><arr name="suggestion"><str>everyother</str></arr></lst></lst><lst name="collations"><lst name="collation"><str name="collationQuery">teststop:everyother</str><int name="hits">14</int><lst name="misspellingsAndCorrections"><str name="everother">everyother</str></lst></lst></lst></lst>
   [junit4]    > </response>
   [junit4]    > 	request was:spellcheck=true&spellcheck.dictionary=direct&spellcheck.count=1&spellcheck.collate=true&spellcheck.maxCollationTries=1&spellcheck.maxCollations=1&spellcheck.collateExtendedResults=true&qt=spellCheckCompRH&q=teststop%3Aeverother&spellcheck.collateMaxCollectDocs=5
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:716)
   [junit4]    > 	... 42 more
   [junit4]   2> 1664981 T3073 oas.SolrTestCaseJ4.setUp ###Starting testCollationWithHypens
   [junit4]   2> 1665115 T3073 oas.SolrTestCaseJ4.tearDown ###Ending testCollationWithHypens
   [junit4]   2> 1665121 T3073 oas.SolrTestCaseJ4.setUp ###Starting testCollateWithGrouping
   [junit4]   2> 1665174 T3073 oas.SolrTestCaseJ4.tearDown ###Ending testCollateWithGrouping
   [junit4]   2> 1665181 T3073 oas.SolrTestCaseJ4.setUp ###Starting testCollateWithFilter
   [junit4]   2> 1665254 T3073 oas.SolrTestCaseJ4.tearDown ###Ending testCollateWithFilter
   [junit4]   2> 1665258 T3073 oas.SolrTestCaseJ4.setUp ###Starting testExtendedCollate
   [junit4]   2> 1665335 T3073 oas.SolrTestCaseJ4.tearDown ###Ending testExtendedCollate
   [junit4]   2> 1665339 T3073 oas.SolrTestCaseJ4.setUp ###Starting testCollateWithOverride
   [junit4]   2> 1665351 T3073 C1584 oasc.SolrCore.execute [collection1] webapp=null path=null params={mm=1&q=partisian+politcal+mashine&defType=edismax&spellcheck.dictionary=direct&qt=spellCheckCompRH&spellcheck=true&qf=teststop&spellcheck.maxCollations=10&spellcheck.count=10&spellcheck.maxCollationTries=10&spellcheck.collate=true} hits=0 status=0 QTime=12 
   [junit4]   2> 1665364 T3073 C1584 oasc.SolrCore.execute [collection1] webapp=null path=null params={mm=1&q=partisian+politcal+mashine&defType=edismax&spellcheck.dictionary=direct&qt=spellCheckCompRH&spellcheck.collateParam.mm=100%25&spellcheck=true&qf=teststop&spellcheck.maxCollations=10&spellcheck.count=10&spellcheck.maxCollationTries=10&spellcheck.collate=true} hits=0 status=0 QTime=12 
   [junit4]   2> 1665365 T3073 oas.SolrTestCaseJ4.tearDown ###Ending testCollateWithOverride
   [junit4]   2> 1665366 T3073 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 1665366 T3073 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=7096418
   [junit4]   2> 1665367 T3073 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@53fed4
   [junit4]   2> 1665367 T3073 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=17,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 1665367 T3073 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 1665368 T3073 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 1665368 T3073 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 1665369 T3073 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 1665370 T3073 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 1665370 T3073 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.spelling.SpellCheckCollatorTest-99406107AF3F7693-001/init-core-data-001 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.spelling.SpellCheckCollatorTest-99406107AF3F7693-001/init-core-data-001;done=false>>]
   [junit4]   2> 1665371 T3073 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.spelling.SpellCheckCollatorTest-99406107AF3F7693-001/init-core-data-001
   [junit4]   2> 1665371 T3073 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.spelling.SpellCheckCollatorTest-99406107AF3F7693-001/init-core-data-001/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.spelling.SpellCheckCollatorTest-99406107AF3F7693-001/init-core-data-001/index;done=false>>]
   [junit4]   2> 1665371 T3073 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.spelling.SpellCheckCollatorTest-99406107AF3F7693-001/init-core-data-001/index
   [junit4]   2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.spelling.SpellCheckCollatorTest-99406107AF3F7693-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene50): {start1=PostingsFormat(name=LuceneVarGapFixedInterval), lowerfilt1=PostingsFormat(name=SimpleText), multiDefault=FST50, teststop=FST50, intDefault=Lucene50(blocksize=128), range_facet_l=FST50, lowerfilt1and2=FST50, end4=PostingsFormat(name=SimpleText), end3=Lucene50(blocksize=128), end2=PostingsFormat(name=LuceneVarGapFixedInterval), end1=FST50, lowerfilt=FST50, gram1=FST50, id=PostingsFormat(name=LuceneVarGapFixedInterval), gram2=PostingsFormat(name=LuceneVarGapFixedInterval), gram3=Lucene50(blocksize=128), start3=PostingsFormat(name=SimpleText), gram4=PostingsFormat(name=SimpleText), start2=FST50, word=FST50, timestamp=FST50, start4=Lucene50(blocksize=128)}, docValues:{timestamp=DocValuesFormat(name=Asserting)}, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=ar_QA, timezone=Asia/Amman
   [junit4]   2> NOTE: Linux 3.13.0-39-generic i386/Oracle Corporation 1.8.0_40-ea (32-bit)/cpus=8,threads=1,free=102710168,total=310853632
   [junit4]   2> NOTE: All tests run in this JVM: [ResponseLogComponentTest, TestSchemaSimilarityResource, TestCodecSupport, ReturnFieldsTest, TestCloudInspectUtil, TestSurroundQueryParser, TestLMJelinekMercerSimilarityFactory, FieldMutatingUpdateProcessorTest, TestRTGBase, TestSolr4Spatial, CursorPagingTest, SyncSliceTest, TestSolrIndexConfig, TestCollectionAPI, SystemInfoHandlerTest, TestRangeQuery, ShardRoutingTest, DistributedSpellCheckComponentTest, TestReload, TestHashPartitioner, HdfsBasicDistributedZkTest, TestShardHandlerFactory, ParsingFieldUpdateProcessorsTest, DirectSolrSpellCheckerTest, OutOfBoxZkACLAndCredentialsProvidersTest, TestExceedMaxTermLength, TestSolrDeletionPolicy1, TestCoreDiscovery, DocValuesMultiTest, ShardSplitTest, XmlUpdateRequestHandlerTest, TimeZoneUtilsTest, SuggesterWFSTTest, TestReplicationHandler, TestSolrJ, HighlighterTest, DistributedQueryComponentCustomSortTest, SimpleCollectionCreateDeleteTest, CoreAdminHandlerTest, TestSuggestSpellingConverter, ChaosMonkeyNothingIsSafeTest, TestDynamicFieldResource, MoreLikeThisHandlerTest, SolrCoreCheckLockOnStartupTest, PluginInfoTest, TestLRUCache, TestFuzzyAnalyzedSuggestions, UpdateParamsTest, TestComplexPhraseQParserPlugin, ResponseHeaderTest, SpellPossibilityIteratorTest, ZkNodePropsTest, StandardRequestHandlerTest, TestFieldResource, TestDFRSimilarityFactory, ExternalFileFieldSortTest, TestSolrCoreProperties, HdfsBasicDistributedZk2Test, BasicFunctionalityTest, TestSimpleQParserPlugin, SolrXmlInZkTest, TestStressUserVersions, TestDocumentBuilder, CursorMarkTest, MultiThreadedOCPTest, TestIntervalFaceting, DistributedFacetPivotLargeTest, TestSearchPerf, FastVectorHighlighterTest, QueryEqualityTest, SpellCheckCollatorTest]
   [junit4] Completed on J0 in 1.90s, 9 tests, 1 error <<< FAILURES!

[...truncated 493 lines...]
   [junit4] Suite: org.apache.solr.cloud.DistribDocExpirationUpdateProcessorTest
   [junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DistribDocExpirationUpdateProcessorTest-99406107AF3F7693-001/init-core-data-001
   [junit4]   2> 2456399 T5583 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
   [junit4]   2> 2456399 T5583 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 2456403 T5583 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 2456404 T5583 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2456405 T5584 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 2456505 T5583 oasc.ZkTestServer.run start zk server on port:51578
   [junit4]   2> 2456506 T5583 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 2456507 T5583 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2456509 T5590 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4381e3 name:ZooKeeperConnection Watcher:127.0.0.1:51578 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2456509 T5583 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2456510 T5583 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 2456510 T5583 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 2456512 T5583 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 2456513 T5583 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2456514 T5592 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1af2baf name:ZooKeeperConnection Watcher:127.0.0.1:51578/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2456515 T5583 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2456515 T5583 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 2456515 T5583 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 2456518 T5583 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 2456519 T5583 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 2456521 T5583 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 2456523 T5583 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-doc-expire-update-processor.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 2456524 T5583 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 2456527 T5583 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
   [junit4]   2> 2456527 T5583 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 2456530 T5583 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 2456531 T5583 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 2456533 T5583 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 2456534 T5583 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 2456538 T5583 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 2456539 T5583 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 2456543 T5583 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 2456544 T5583 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 2456547 T5583 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 2456548 T5583 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 2456550 T5583 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 2456551 T5583 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 2456553 T5583 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 2456554 T5583 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 2456556 T5583 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 2456557 T5583 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 2456559 T5583 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 2456559 T5583 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 2456561 T5583 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 2456562 T5583 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2456563 T5594 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@cf18ff name:ZooKeeperConnection Watcher:127.0.0.1:51578/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2456563 T5583 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2456564 T5583 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 2456876 T5583 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 2456882 T5583 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 2456888 T5583 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:45712
   [junit4]   2> 2456891 T5583 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 2456892 T5583 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 2456892 T5583 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DistribDocExpirationUpdateProcessorTest-99406107AF3F7693-001/tempDir-002
   [junit4]   2> 2456893 T5583 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DistribDocExpirationUpdateProcessorTest-99406107AF3F7693-001/tempDir-002/'
   [junit4]   2> 2456914 T5583 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DistribDocExpirationUpdateProcessorTest-99406107AF3F7693-001/tempDir-002/solr.xml
   [junit4]   2> 2456927 T5583 oasc.CoreContainer.<init> New CoreContainer 15762729
   [junit4]   2> 2456927 T5583 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DistribDocExpirationUpdateProcessorTest-99406107AF3F7693-001/tempDir-002/]
   [junit4]   2> 2456928 T5583 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 2456928 T5583 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 2456929 T5583 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 2456929 T5583 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 2456930 T5583 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 2456930 T5583 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 2456930 T5583 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 2456931 T5583 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 2456931 T5583 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 2456931 T5583 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 2456933 T5583 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 2456935 T5583 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 2456936 T5583 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 2456936 T5583 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 2456937 T5583 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51578/solr
   [junit4]   2> 2456937 T5583 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 2456938 T5583 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 2456938 T5583 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2456940 T5605 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@93be4c name:ZooKeeperConnection Watcher:127.0.0.1:51578 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2456941 T5583 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2456941 T5583 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 2456943 T5583 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2456944 T5607 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@365222 name:ZooKeeperConnection Watcher:127.0.0.1:51578/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2456944 T5583 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2456945 T5583 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 2456947 T5583 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 2456949 T5583 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 2456951 T5583 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 2456953 T5583 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 2456955 T5583 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 2456957 T5583 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45712_
   [junit4]   2> 2456958 T5583 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45712_
   [junit4]   2> 2456960 T5583 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 2456962 T5583 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 2456964 T5583 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 2456966 T5583 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:45712_
   [junit4]   2> 2456967 T5583 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 2456969 T5583 oasc.Overseer.start Overseer (id=92740015766634500-127.0.0.1:45712_-n_0000000000) starting
   [junit4]   2> 2456971 T5583 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 2456977 T5583 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 2456978 T5609 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 2456978 T5583 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 2456980 T5583 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 2456981 T5583 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2456984 T5608 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 2456987 T5611 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 2456988 T5611 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 2456989 T5612 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 2456989 T5611 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 2456992 T5608 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"https://127.0.0.1:45712",
   [junit4]   2> 	  "node_name":"127.0.0.1:45712_",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 2456993 T5608 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 2456993 T5608 oasc.Overseer$ClusterStateUpdater.createCollection state version control_collection 1
   [junit4]   2> 2456994 T5608 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 2456996 T5612 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2457990 T5611 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 2457991 T5611 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 2457992 T5611 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 2457992 T5611 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 2457993 T5611 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 2457993 T5611 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DistribDocExpirationUpdateProcessorTest-99406107AF3F7693-001/tempDir-002/collection1/'
   [junit4]   2> 2457994 T5611 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DistribDocExpirationUpdateProcessorTest-99406107AF3F7693-001/tempDir-002/collection1/lib/.svn/' to classloader
   [junit4]   2> 2457994 T5611 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DistribDocExpirationUpdateProcessorTest-99406107AF3F7693-001/tempDir-002/collection1/lib/classes/' to classloader
   [junit4]   2> 2457995 T5611 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DistribDocExpirationUpdateProcessorTest-99406107AF3F7693-001/tempDir-002/collection1/lib/README' to classloader
   [junit4]   2> 2458024 T5611 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 2458035 T5611 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 2458036 T5611 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 2458044 T5611 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 2458176 T5611 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 2458178 T5611 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 2458179 T5611 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 2458182 T5611 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 2458204 T5611 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 2458205 T5611 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 2458205 T5611 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DistribDocExpirationUpdateProcessorTest-99406107AF3F7693-001/tempDir-002/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DistribDocExpirationUpdateProcessorTest-99406107AF3F7693-001/tempDir-001/control/data/
   [junit4]   2> 2458205 T5611 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 2458206 T5611 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DistribDocExpirationUpdateProcessorTest-99406107AF3F7693-001/tempDir-001/control/data
   [junit4]   2> 2458206 T5611 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DistribDocExpirationUpdateProcessorTest-99406107AF3F7693-001/tempDir-001/control/data/index/
   [junit4]   2> 2458206 T5611 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DistribDocExpirationUpdateProcessorTest-99406107AF3F7693-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
   [junit4]   2> 2458207 T5611 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DistribDocExpirationUpdateProcessorTest-99406107AF3F7693-001/tempDir-001/control/data/index
   [junit4]   2> 2458207 T5611 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=12, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6394970237487286]
   [junit4]   2> 2458208 T5611 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-1792101)),segFN=segments_1,generation=1}
   [junit4]   2> 2458209 T5611 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2458210 T5611 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "convert-ttl-defaults"
   [junit4]   2> 2458226 T5611 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "convert-ttl-field"
   [junit4]   2> 2458226 T5611 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "convert-ttl-param"
   [junit4]   2> 2458227 T5611 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "convert-ttl-field-with-param-default"
   [junit4]   2> 2458227 T5611 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "scheduled-delete" (default)
   [junit4]   2> 2458253 T5611 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "scheduled-delete" (default)
   [junit4]   2> 2458253 T5611 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2458253 T5611 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2458254 T5611 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2458254 T5611 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 2458254 T5611 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 2458254 T5611 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 2458255 T5611 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
   [junit4]   2> 2458255 T5611 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 2458255 T5611 oasc.RequestHandlers.initHandlersFromConfig created /admin/: solr.admin.AdminHandlers
   [junit4]   2> 2458257 T5611 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2458259 T5611 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2458260 T5611 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2458261 T5611 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2458263 T5611 o

[...truncated too long message...]

62)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:124)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:313)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:220)
   [junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:466)
   [junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:229)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:162)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:124)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:313)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:220)
   [junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:466)
   [junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:229)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:162)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:124)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:357)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:266)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 2532964 T5799 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 2532987 T5583 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
   [junit4]   2> 2537977 T5583 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
   [junit4]   2> 2537979 T5583 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:51578 51578
   [junit4]   2> 2538687 T5584 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:51578 51578
   [junit4]   2> 2538689 T5584 oasc.ZkTestServer$ZKServerMain.runFromConfig WARN Watch limit violations: 
   [junit4]   2> 	Maximum concurrent create/delete watches above limit:
   [junit4]   2> 	
   [junit4]   2> 		6	/solr/aliases.json
   [junit4]   2> 		6	/solr/clusterstate.json
   [junit4]   2> 	
   [junit4]   2> 	Maximum concurrent children watches above limit:
   [junit4]   2> 	
   [junit4]   2> 		6	/solr/live_nodes
   [junit4]   2> 		5	/solr/overseer/queue
   [junit4]   2> 		5	/solr/overseer/collection-queue-work
   [junit4]   2> 	
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=DistribDocExpirationUpdateProcessorTest -Dtests.method=testDistribSearch -Dtests.seed=99406107AF3F7693 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ja_JP -Dtests.timezone=Zulu -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] FAILURE 82.3s J0 | DistribDocExpirationUpdateProcessorTest.testDistribSearch <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: There are still nodes recoverying - waited for 30 seconds
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([99406107AF3F7693:18A6EF1FD86016AF]:0)
   [junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:178)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:840)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForThingsToLevelOut(AbstractFullDistribZkTestBase.java:1459)
   [junit4]    > 	at org.apache.solr.cloud.DistribDocExpirationUpdateProcessorTest.doTest(DistribDocExpirationUpdateProcessorTest.java:79)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 2538713 T5583 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DistribDocExpirationUpdateProcessorTest-99406107AF3F7693-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene50): {_version_=PostingsFormat(name=Memory doPackFST= false), id=BlockTreeOrds(blocksize=128)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=ja_JP, timezone=Zulu
   [junit4]   2> NOTE: Linux 3.13.0-39-generic i386/Oracle Corporation 1.8.0_40-ea (32-bit)/cpus=8,threads=1,free=157945296,total=346583040
   [junit4]   2> NOTE: All tests run in this JVM: [ResponseLogComponentTest, TestSchemaSimilarityResource, TestCodecSupport, ReturnFieldsTest, TestCloudInspectUtil, TestSurroundQueryParser, TestLMJelinekMercerSimilarityFactory, FieldMutatingUpdateProcessorTest, TestRTGBase, TestSolr4Spatial, CursorPagingTest, SyncSliceTest, TestSolrIndexConfig, TestCollectionAPI, SystemInfoHandlerTest, TestRangeQuery, ShardRoutingTest, DistributedSpellCheckComponentTest, TestReload, TestHashPartitioner, HdfsBasicDistributedZkTest, TestShardHandlerFactory, ParsingFieldUpdateProcessorsTest, DirectSolrSpellCheckerTest, OutOfBoxZkACLAndCredentialsProvidersTest, TestExceedMaxTermLength, TestSolrDeletionPolicy1, TestCoreDiscovery, DocValuesMultiTest, ShardSplitTest, XmlUpdateRequestHandlerTest, TimeZoneUtilsTest, SuggesterWFSTTest, TestReplicationHandler, TestSolrJ, HighlighterTest, DistributedQueryComponentCustomSortTest, SimpleCollectionCreateDeleteTest, CoreAdminHandlerTest, TestSuggestSpellingConverter, ChaosMonkeyNothingIsSafeTest, TestDynamicFieldResource, MoreLikeThisHandlerTest, SolrCoreCheckLockOnStartupTest, PluginInfoTest, TestLRUCache, TestFuzzyAnalyzedSuggestions, UpdateParamsTest, TestComplexPhraseQParserPlugin, ResponseHeaderTest, SpellPossibilityIteratorTest, ZkNodePropsTest, StandardRequestHandlerTest, TestFieldResource, TestDFRSimilarityFactory, ExternalFileFieldSortTest, TestSolrCoreProperties, HdfsBasicDistributedZk2Test, BasicFunctionalityTest, TestSimpleQParserPlugin, SolrXmlInZkTest, TestStressUserVersions, TestDocumentBuilder, CursorMarkTest, MultiThreadedOCPTest, TestIntervalFaceting, DistributedFacetPivotLargeTest, TestSearchPerf, FastVectorHighlighterTest, QueryEqualityTest, SpellCheckCollatorTest, InfoHandlerTest, TestCloudManagedSchema, TestStressReorder, LeaderInitiatedRecoveryOnCommitTest, UnloadDistributedZkTest, XsltUpdateRequestHandlerTest, SolrIndexSplitterTest, MigrateRouteKeyTest, JSONWriterTest, TestBulkSchemaAPI, DocumentBuilderTest, StatelessScriptUpdateProcessorFactoryTest, TestNRTOpen, TestRawResponseWriter, RankQueryTest, PreAnalyzedUpdateProcessorTest, HdfsRecoveryZkTest, SharedFSAutoReplicaFailoverUtilsTest, OverseerTest, MinimalSchemaTest, DistributedExpandComponentTest, IndexSchemaTest, TestStressVersions, TestRequestStatusCollectionAPI, OverseerCollectionProcessorTest, TestBinaryResponseWriter, TestFoldingMultitermQuery, RegexBoostProcessorTest, ShowFileRequestHandlerTest, IndexBasedSpellCheckerTest, JsonLoaderTest, OpenExchangeRatesOrgProviderTest, TestDynamicFieldCollectionResource, DirectUpdateHandlerTest, SuggesterTest, TestTrie, NoCacheHeaderTest, TestWordDelimiterFilterFactory, SortByFunctionTest, DistanceFunctionTest, DebugComponentTest, CacheHeaderTest, TestQueryUtils, PrimitiveFieldTypeTest, FileBasedSpellCheckerTest, TestValueSourceCache, TermVectorComponentTest, FieldAnalysisRequestHandlerTest, IndexSchemaRuntimeFieldTest, TestJmxIntegration, MBeansHandlerTest, TestAnalyzedSuggestions, TestPartialUpdateDeduplication, TestComponentsName, TestLFUCache, HighlighterConfigTest, TestQuerySenderListener, SolrIndexConfigTest, TestStressRecovery, SolrTestCaseJ4Test, TestCursorMarkWithoutUniqueKey, TestDistributedMissingSort, AssignTest, AsyncMigrateRouteKeyTest, CollectionsAPIAsyncDistributedZkTest, DeleteShardTest, DistribDocExpirationUpdateProcessorTest]
   [junit4] Completed on J0 in 82.38s, 1 test, 1 failure <<< FAILURES!

[...truncated 292 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:525: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:473: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:61: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:502: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1358: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:965: There were test failures: 441 suites, 1801 tests, 1 error, 1 failure, 44 ignored (21 assumptions)

Total time: 108 minutes 12 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.8.0_40-ea-b09 -client -XX:+UseSerialGC (asserts: true)
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any