You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2014/01/16 08:02:03 UTC

[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 1864 - Failure

Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/1864/

1 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.spelling.suggest.TestFreeTextSuggestions

Error Message:
o=-9223372036854775808

Stack Trace:
java.lang.AssertionError: o=-9223372036854775808
	at __randomizedtesting.SeedInfo.seed([CB0AA5A193FA1857]:0)
	at org.apache.lucene.util.fst.PositiveIntOutputs.valid(PositiveIntOutputs.java:104)
	at org.apache.lucene.util.fst.PositiveIntOutputs.common(PositiveIntOutputs.java:47)
	at org.apache.lucene.util.fst.PositiveIntOutputs.common(PositiveIntOutputs.java:32)
	at org.apache.lucene.util.fst.Builder.add(Builder.java:422)
	at org.apache.lucene.search.suggest.analyzing.FreeTextSuggester.build(FreeTextSuggester.java:359)
	at org.apache.lucene.search.suggest.analyzing.FreeTextSuggester.build(FreeTextSuggester.java:278)
	at org.apache.lucene.search.suggest.Lookup.build(Lookup.java:167)
	at org.apache.solr.spelling.suggest.SolrSuggester.build(SolrSuggester.java:142)
	at org.apache.solr.handler.component.SuggestComponent.prepare(SuggestComponent.java:163)
	at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:193)
	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
	at org.apache.solr.core.SolrCore.execute(SolrCore.java:1913)
	at org.apache.solr.util.TestHarness.query(TestHarness.java:291)
	at org.apache.solr.util.TestHarness.query(TestHarness.java:273)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:618)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:611)
	at org.apache.solr.spelling.suggest.TestFreeTextSuggestions.beforeClass(TestFreeTextSuggestions.java:30)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:677)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:724)




Build Log:
[...truncated 11946 lines...]
   [junit4] Suite: org.apache.solr.spelling.suggest.TestFreeTextSuggestions
   [junit4]   2> 2287201 T5170 oas.SolrTestCaseJ4.initCore ####initCore
   [junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-TestFreeTextSuggestions-1389855703745
   [junit4]   2> 2287203 T5170 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/'
   [junit4]   2> 2287204 T5170 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 2287204 T5170 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 2287310 T5170 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 2287392 T5170 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-phrasesuggest.xml
   [junit4]   2> 2287394 T5170 oass.IndexSchema.readSchema Reading Solr Schema from schema-phrasesuggest.xml
   [junit4]   2> 2287402 T5170 oass.IndexSchema.readSchema [null] Schema name=test
   [junit4]   2> 2287450 T5170 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 2287453 T5170 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 2287455 T5170 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 2287456 T5170 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr
   [junit4]   2> 2287456 T5170 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/'
   [junit4]   2> 2287494 T5170 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 2287495 T5170 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr
   [junit4]   2> 2287495 T5170 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/'
   [junit4]   2> 2287628 T5170 oasc.CoreContainer.<init> New CoreContainer 30535420
   [junit4]   2> 2287629 T5170 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/]
   [junit4]   2> 2287631 T5170 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 2287631 T5170 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 2287631 T5170 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 2287632 T5170 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 2287632 T5170 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 2287633 T5170 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 2287633 T5170 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 2287634 T5170 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 2287634 T5170 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 2287646 T5170 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 2287646 T5170 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 2287647 T5170 oasc.CoreContainer.load Host Name: 
   [junit4]   2> 2287654 T5171 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1
   [junit4]   2> 2287655 T5171 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/'
   [junit4]   2> 2287656 T5171 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 2287657 T5171 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 2287734 T5171 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 2287818 T5171 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-phrasesuggest.xml
   [junit4]   2> 2287819 T5171 oass.IndexSchema.readSchema Reading Solr Schema from schema-phrasesuggest.xml
   [junit4]   2> 2287826 T5171 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 2287869 T5171 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 2287872 T5171 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 2287874 T5171 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 2287874 T5171 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-TestFreeTextSuggestions-1389855703745/
   [junit4]   2> 2287875 T5171 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 2287876 T5171 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-TestFreeTextSuggestions-1389855703745
   [junit4]   2> 2287876 T5171 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-TestFreeTextSuggestions-1389855703745/index/
   [junit4]   2> 2287876 T5171 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-TestFreeTextSuggestions-1389855703745/index' doesn't exist. Creating new index...
   [junit4]   2> 2287877 T5171 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-TestFreeTextSuggestions-1389855703745/index
   [junit4]   2> 2287878 T5171 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1935836600, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 2287879 T5171 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@6e3a75b8 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@30776db0),segFN=segments_1,generation=1}
   [junit4]   2> 2287879 T5171 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2287882 T5171 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 2287882 T5171 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 2287883 T5171 oasc.RequestHandlers.initHandlersFromConfig created /suggest_wfst: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 2287883 T5171 oasc.RequestHandlers.initHandlersFromConfig created /suggest_analyzing: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 2287884 T5171 oasc.RequestHandlers.initHandlersFromConfig created /infix_suggest_analyzing: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 2287884 T5171 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_file_dict: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 2287884 T5171 oasc.RequestHandlers.initHandlersFromConfig created /free_text_suggest: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 2287885 T5171 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_high_freq_dict: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 2287885 T5171 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 2287885 T5171 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_max_edit_2: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 2287886 T5171 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_non_fuzzy_prefix_4: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 2287886 T5171 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_min_fuzzy_length_2: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 2287891 T5171 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 2287891 T5171 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 2287891 T5171 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=33, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 2287892 T5171 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@6e3a75b8 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@30776db0),segFN=segments_1,generation=1}
   [junit4]   2> 2287893 T5171 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2287893 T5171 oass.SolrIndexSearcher.<init> Opening Searcher@5cdeb0b7 main
   [junit4]   2> 2287893 T5171 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 2287894 T5171 oasss.Suggester.init init: {name=suggest_wfst,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.WFSTLookupFactory,storeDir=suggest_wfst,buildOnCommit=false,exactMatchFirst=true,sourceLocation=phrasesuggest.txt}
   [junit4]   2> 2287896 T5171 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 2287896 T5171 oasss.Suggester.init init: {name=suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingLookupFactory,storeDir=suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=ja_suggest,preserveSep=false,sourceLocation=jasuggest.txt}
   [junit4]   2> 2287898 T5171 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 2287898 T5171 oasss.Suggester.init init: {name=infix_suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingInfixLookupFactory,buildOnCommit=false,suggestAnalyzerFieldType=text,sourceLocation=analyzingInfixSuggest.txt}
   [junit4]   2> 2287905 T5171 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 2287905 T5171 oasss.SolrSuggester.init init: {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
   [junit4]   2> 2287907 T5171 oasss.SolrSuggester.init Dictionary loaded with params: {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
   [junit4]   2> 2287907 T5171 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 2287907 T5171 oasss.SolrSuggester.init init: {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator= ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
   [junit4]   2> 2287909 T5171 oasss.SolrSuggester.init Dictionary loaded with params: {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator= ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
   [junit4]   2> 2287909 T5171 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 2287909 T5171 oasss.SolrSuggester.init init: {name=fuzzy_suggest_analyzing_with_file_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.FileDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,sourceLocation=fuzzysuggest.txt}
   [junit4]   2> 2287910 T5171 oasss.SolrSuggester.init WARN Loading stored lookup data failed, possibly not cached yet
   [junit4]   2> 2287911 T5171 oasss.SolrSuggester.init Dictionary loaded with params: {name=fuzzy_suggest_analyzing_with_file_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.FileDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,sourceLocation=fuzzysuggest.txt}
   [junit4]   2> 2287911 T5171 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 2287911 T5171 oasss.Suggester.init init: {name=fuzzy_suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,sourceLocation=fuzzysuggest.txt}
   [junit4]   2> 2287912 T5171 oasss.Suggester.init WARN Loading stored lookup data failed java.io.FileNotFoundException: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-TestFreeTextSuggestions-1389855703745/fuzzy_suggest_analyzing/fwfsta.bin (No such file or directory)
   [junit4]   2> 	at java.io.FileInputStream.open(Native Method)
   [junit4]   2> 	at java.io.FileInputStream.<init>(FileInputStream.java:138)
   [junit4]   2> 	at org.apache.solr.spelling.suggest.Suggester.init(Suggester.java:116)
   [junit4]   2> 	at org.apache.solr.handler.component.SpellCheckComponent.inform(SpellCheckComponent.java:636)
   [junit4]   2> 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:631)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:832)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:627)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.createFromLocal(CoreContainer.java:562)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:597)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:258)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:250)
   [junit4]   2> 	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:166)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
   [junit4]   2> 	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:166)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:724)
   [junit4]   2> 
   [junit4]   2> 2287913 T5171 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 2287913 T5171 oasss.Suggester.init init: {name=fuzzy_suggest_analyzing_with_max_edit_2,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,storeDir=fuzzy_suggest_analyzing_with_max_edit_2,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,maxEdits=2,sourceLocation=fuzzysuggest.txt}
   [junit4]   2> 2287915 T5171 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 2287915 T5171 oasss.Suggester.init init: {name=fuzzy_suggest_analyzing_with_non_fuzzy_prefix_4,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,storeDir=fuzzy_suggest_analyzing_with_non_fuzzy_prefix_4,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,nonFuzzyPrefix=4,sourceLocation=fuzzysuggest.txt}
   [junit4]   2> 2287916 T5171 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 2287916 T5171 oasss.Suggester.init init: {name=fuzzy_suggest_analyzing_with_min_fuzzy_length_2,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,storeDir=fuzzy_suggest_analyzing_with_min_fuzzy_length_2,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,minFuzzyLength=2,sourceLocation=fuzzysuggest.txt}
   [junit4]   2> 2287918 T5172 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5cdeb0b7 main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 2287918 T5171 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 2287936 T5170 oas.SolrTestCaseJ4.initCore ####initCore end
   [junit4]   2> ASYNC  NEW_CORE C906 name=collection1 org.apache.solr.core.SolrCore@6a78ed21
   [junit4]   2> 2287936 T5170 C906 oashc.SuggestComponent.prepare SuggestComponent prepare with : {params(q=&suggest.buildAll=true&qt=/free_text_suggest),defaults(suggest=true)}
   [junit4]   2> 2287937 T5170 C906 oasss.SolrSuggester.build build()
   [junit4]   2> 2288005 T5170 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 2288006 T5170 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=30535420
   [junit4]   2> 2288006 T5170 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@6a78ed21
   [junit4]   2> 2288006 T5170 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 2288007 T5170 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 2288007 T5170 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 2288008 T5170 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 2288010 T5170 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 2288010 T5170 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 2288011 T5170 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-TestFreeTextSuggestions-1389855703745 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-TestFreeTextSuggestions-1389855703745;done=false>>]
   [junit4]   2> 2288011 T5170 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-TestFreeTextSuggestions-1389855703745
   [junit4]   2> 2288012 T5170 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-TestFreeTextSuggestions-1389855703745/index [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-TestFreeTextSuggestions-1389855703745/index;done=false>>]
   [junit4]   2> 2288012 T5170 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-TestFreeTextSuggestions-1389855703745/index
   [junit4]   2> NOTE: test params are: codec=Lucene3x, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=de_CH, timezone=America/Managua
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_25 (64-bit)/cpus=16,threads=1,free=274107536,total=454033408
   [junit4]   2> NOTE: All tests run in this JVM: [TestSolrIndexConfig, TestReplicationHandler, TestCopyFieldCollectionResource, TestZkChroot, OverseerCollectionProcessorTest, TestDocumentBuilder, OpenExchangeRatesOrgProviderTest, BasicZkTest, AliasIntegrationTest, DisMaxRequestHandlerTest, SuggestComponentTest, SimplePostToolTest, ZkNodePropsTest, FieldMutatingUpdateProcessorTest, MBeansHandlerTest, PingRequestHandlerTest, TestFastWriter, StatelessScriptUpdateProcessorFactoryTest, TestConfig, DebugComponentTest, AddBlockUpdateTest, TestRecovery, DocumentBuilderTest, TestCSVResponseWriter, TestPartialUpdateDeduplication, OutputWriterTest, TestLuceneMatchVersion, IndexSchemaRuntimeFieldTest, TestCursorMarkWithoutUniqueKey, SearchHandlerTest, TestDynamicFieldResource, ZkSolrClientTest, HardAutoCommitTest, DirectUpdateHandlerOptimizeTest, TestCollapseQParserPlugin, TestSchemaResource, TestUtils, DistributedQueryElevationComponentTest, TestSolrQueryParserDefaultOperatorResource, InfoHandlerTest, BlockDirectoryTest, TestSimpleQParserPlugin, URLClassifyProcessorTest, SchemaVersionSpecificBehaviorTest, ZkCLITest, DistributedDebugComponentTest, TestReversedWildcardFilterFactory, TermVectorComponentTest, DistributedSpellCheckComponentTest, TestPerFieldSimilarity, AddSchemaFieldsUpdateProcessorFactoryTest, TestUniqueKeyFieldResource, TestDistribDocBasedVersion, SOLR749Test, TestRTGBase, SolrIndexSplitterTest, UnloadDistributedZkTest, HdfsDirectoryTest, TestSuggestSpellingConverter, TestMergePolicyConfig, SolrInfoMBeanTest, TestFuzzyAnalyzedSuggestions, TestCodecSupport, TestRealTimeGet, MinimalSchemaTest, HdfsSyncSliceTest, SpellCheckComponentTest, ExternalFileFieldSortTest, BinaryUpdateRequestHandlerTest, TimeZoneUtilsTest, TestAddFieldRealTimeGet, ShowFileRequestHandlerTest, AssignTest, CurrencyFieldXmlFileTest, PrimitiveFieldTypeTest, CoreAdminCreateDiscoverTest, UUIDFieldTest, TriLevelCompositeIdRoutingTest, TestDFRSimilarityFactory, LoggingHandlerTest, TestSerializedLuceneMatchVersion, TestStressVersions, TestHashPartitioner, TestSolr4Spatial, SyncSliceTest, TestRandomFaceting, TestRandomDVFaceting, TestDistributedSearch, TestStressRecovery, ShardRoutingTest, TestGroupingSearch, OpenCloseCoreStressTest, OverseerTest, TestDistributedGrouping, TestFaceting, DeleteReplicaTest, ClusterStateUpdateTest, SolrCoreTest, DistributedTermsComponentTest, TestRangeQuery, SimpleFacetsTest, TestSolrXmlPersistence, CurrencyFieldOpenExchangeTest, LukeRequestHandlerTest, ZkControllerTest, BadIndexSchemaTest, CoreAdminHandlerTest, HighlighterTest, TestIndexSearcher, SolrCoreCheckLockOnStartupTest, TestMultiCoreConfBootstrap, SolrRequestParserTest, SuggesterTest, SuggesterTSTTest, WordBreakSolrSpellCheckerTest, SignatureUpdateProcessorFactoryTest, QueryEqualityTest, TermsComponentTest, TestSurroundQueryParser, DistanceFunctionTest, BJQParserTest, XsltUpdateRequestHandlerTest, JsonLoaderTest, TestFoldingMultitermQuery, TestCoreDiscovery, MoreLikeThisHandlerTest, QueryParsingTest, StandardRequestHandlerTest, FieldAnalysisRequestHandlerTest, DocumentAnalysisRequestHandlerTest, UpdateParamsTest, JSONWriterTest, RegexBoostProcessorTest, TestMaxScoreQueryParser, TestQuerySenderNoQuery, TestInfoStreamLogging, AlternateDirectoryTest, CopyFieldTest, SolrIndexConfigTest, TestFieldCollectionResource, TestSchemaNameResource, TestSchemaSimilarityResource, TestFieldTypeCollectionResource, TestSolrQueryParserResource, MultiTermTest, CoreContainerCoreInitFailuresTest, TestAnalyzeInfixSuggestions, SampleTest, TestCollationField, TestCharFilters, TestIBSimilarityFactory, EchoParamsTest, TestLMDirichletSimilarityFactory, TestBM25SimilarityFactory, TestClassNameShortening, TestShardHandlerFactory, SpellPossibilityIteratorTest, TestJmxMonitoredMap, TestSolrXMLSerializer, TestSystemIdResolver, QueryResultKeyTest, SpellingQueryConverterTest, SliceStateTest, FileUtilsTest, TestFreeTextSuggestions]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestFreeTextSuggestions -Dtests.seed=CB0AA5A193FA1857 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=de_CH -Dtests.timezone=America/Managua -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J0 | TestFreeTextSuggestions (suite) <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: o=-9223372036854775808
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([CB0AA5A193FA1857]:0)
   [junit4]    > 	at org.apache.lucene.util.fst.PositiveIntOutputs.valid(PositiveIntOutputs.java:104)
   [junit4]    > 	at org.apache.lucene.util.fst.PositiveIntOutputs.common(PositiveIntOutputs.java:47)
   [junit4]    > 	at org.apache.lucene.util.fst.PositiveIntOutputs.common(PositiveIntOutputs.java:32)
   [junit4]    > 	at org.apache.lucene.util.fst.Builder.add(Builder.java:422)
   [junit4]    > 	at org.apache.lucene.search.suggest.analyzing.FreeTextSuggester.build(FreeTextSuggester.java:359)
   [junit4]    > 	at org.apache.lucene.search.suggest.analyzing.FreeTextSuggester.build(FreeTextSuggester.java:278)
   [junit4]    > 	at org.apache.lucene.search.suggest.Lookup.build(Lookup.java:167)
   [junit4]    > 	at org.apache.solr.spelling.suggest.SolrSuggester.build(SolrSuggester.java:142)
   [junit4]    > 	at org.apache.solr.handler.component.SuggestComponent.prepare(SuggestComponent.java:163)
   [junit4]    > 	at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:193)
   [junit4]    > 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
   [junit4]    > 	at org.apache.solr.core.SolrCore.execute(SolrCore.java:1913)
   [junit4]    > 	at org.apache.solr.util.TestHarness.query(TestHarness.java:291)
   [junit4]    > 	at org.apache.solr.util.TestHarness.query(TestHarness.java:273)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:618)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:611)
   [junit4]    > 	at org.apache.solr.spelling.suggest.TestFreeTextSuggestions.beforeClass(TestFreeTextSuggestions.java:30)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:724)
   [junit4] Completed on J0 in 0.86s, 0 tests, 1 failure <<< FAILURES!

[...truncated 10 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:459: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:439: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:491: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1308: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:941: There were test failures: 353 suites, 1539 tests, 1 suite-level error, 34 ignored (6 assumptions)

Total time: 64 minutes 15 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



Re: [JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 1864 - Failure

Posted by Robert Muir <rc...@gmail.com>.
I committed a fix


On Thu, Jan 16, 2014 at 2:02 AM, Apache Jenkins Server <
jenkins@builds.apache.org> wrote:

> Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/1864/
>
> 1 tests failed.
> FAILED:
>  junit.framework.TestSuite.org.apache.solr.spelling.suggest.TestFreeTextSuggestions
>
> Error Message:
> o=-9223372036854775808
>
> Stack Trace:
> java.lang.AssertionError: o=-9223372036854775808
>         at __randomizedtesting.SeedInfo.seed([CB0AA5A193FA1857]:0)
>         at
> org.apache.lucene.util.fst.PositiveIntOutputs.valid(PositiveIntOutputs.java:104)
>         at
> org.apache.lucene.util.fst.PositiveIntOutputs.common(PositiveIntOutputs.java:47)
>         at
> org.apache.lucene.util.fst.PositiveIntOutputs.common(PositiveIntOutputs.java:32)
>         at org.apache.lucene.util.fst.Builder.add(Builder.java:422)
>         at
> org.apache.lucene.search.suggest.analyzing.FreeTextSuggester.build(FreeTextSuggester.java:359)
>         at
> org.apache.lucene.search.suggest.analyzing.FreeTextSuggester.build(FreeTextSuggester.java:278)
>         at org.apache.lucene.search.suggest.Lookup.build(Lookup.java:167)
>         at
> org.apache.solr.spelling.suggest.SolrSuggester.build(SolrSuggester.java:142)
>         at
> org.apache.solr.handler.component.SuggestComponent.prepare(SuggestComponent.java:163)
>         at
> org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:193)
>         at
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
>         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1913)
>         at org.apache.solr.util.TestHarness.query(TestHarness.java:291)
>         at org.apache.solr.util.TestHarness.query(TestHarness.java:273)
>         at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:618)
>         at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:611)
>         at
> org.apache.solr.spelling.suggest.TestFreeTextSuggestions.beforeClass(TestFreeTextSuggestions.java:30)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:606)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:677)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at java.lang.Thread.run(Thread.java:724)
>
>
>
>
> Build Log:
> [...truncated 11946 lines...]
>    [junit4] Suite: org.apache.solr.spelling.suggest.TestFreeTextSuggestions
>    [junit4]   2> 2287201 T5170 oas.SolrTestCaseJ4.initCore ####initCore
>    [junit4]   2> Creating dataDir:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-TestFreeTextSuggestions-1389855703745
>    [junit4]   2> 2287203 T5170 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/'
>    [junit4]   2> 2287204 T5170 oasc.SolrResourceLoader.replaceClassLoader
> Adding
> 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/lib/README'
> to classloader
>    [junit4]   2> 2287204 T5170 oasc.SolrResourceLoader.replaceClassLoader
> Adding
> 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/lib/classes/'
> to classloader
>    [junit4]   2> 2287310 T5170 oasc.SolrConfig.<init> Using Lucene
> MatchVersion: LUCENE_47
>    [junit4]   2> 2287392 T5170 oasc.SolrConfig.<init> Loaded SolrConfig:
> solrconfig-phrasesuggest.xml
>    [junit4]   2> 2287394 T5170 oass.IndexSchema.readSchema Reading Solr
> Schema from schema-phrasesuggest.xml
>    [junit4]   2> 2287402 T5170 oass.IndexSchema.readSchema [null] Schema
> name=test
>    [junit4]   2> 2287450 T5170 oass.IndexSchema.readSchema default search
> field in schema is text
>    [junit4]   2> 2287453 T5170 oass.IndexSchema.readSchema unique key
> field: id
>    [junit4]   2> 2287455 T5170 oasc.SolrResourceLoader.locateSolrHome JNDI
> not configured for solr (NoInitialContextEx)
>    [junit4]   2> 2287456 T5170 oasc.SolrResourceLoader.locateSolrHome
> using system property solr.solr.home:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr
>    [junit4]   2> 2287456 T5170 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/'
>    [junit4]   2> 2287494 T5170 oasc.SolrResourceLoader.locateSolrHome JNDI
> not configured for solr (NoInitialContextEx)
>    [junit4]   2> 2287495 T5170 oasc.SolrResourceLoader.locateSolrHome
> using system property solr.solr.home:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr
>    [junit4]   2> 2287495 T5170 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for deduced Solr Home:
> '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/'
>    [junit4]   2> 2287628 T5170 oasc.CoreContainer.<init> New CoreContainer
> 30535420
>    [junit4]   2> 2287629 T5170 oasc.CoreContainer.load Loading cores into
> CoreContainer
> [instanceDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/]
>    [junit4]   2> 2287631 T5170 oashc.HttpShardHandlerFactory.getParameter
> Setting socketTimeout to: 0
>    [junit4]   2> 2287631 T5170 oashc.HttpShardHandlerFactory.getParameter
> Setting urlScheme to: http://
>    [junit4]   2> 2287631 T5170 oashc.HttpShardHandlerFactory.getParameter
> Setting connTimeout to: 0
>    [junit4]   2> 2287632 T5170 oashc.HttpShardHandlerFactory.getParameter
> Setting maxConnectionsPerHost to: 20
>    [junit4]   2> 2287632 T5170 oashc.HttpShardHandlerFactory.getParameter
> Setting corePoolSize to: 0
>    [junit4]   2> 2287633 T5170 oashc.HttpShardHandlerFactory.getParameter
> Setting maximumPoolSize to: 2147483647
>    [junit4]   2> 2287633 T5170 oashc.HttpShardHandlerFactory.getParameter
> Setting maxThreadIdleTime to: 5
>    [junit4]   2> 2287634 T5170 oashc.HttpShardHandlerFactory.getParameter
> Setting sizeOfQueue to: -1
>    [junit4]   2> 2287634 T5170 oashc.HttpShardHandlerFactory.getParameter
> Setting fairnessPolicy to: false
>    [junit4]   2> 2287646 T5170 oasl.LogWatcher.createWatcher SLF4J impl is
> org.slf4j.impl.Log4jLoggerFactory
>    [junit4]   2> 2287646 T5170 oasl.LogWatcher.newRegisteredLogWatcher
> Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>    [junit4]   2> 2287647 T5170 oasc.CoreContainer.load Host Name:
>    [junit4]   2> 2287654 T5171 oasc.CoreContainer.create Creating SolrCore
> 'collection1' using instanceDir:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1
>    [junit4]   2> 2287655 T5171 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/'
>    [junit4]   2> 2287656 T5171 oasc.SolrResourceLoader.replaceClassLoader
> Adding
> 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/lib/README'
> to classloader
>    [junit4]   2> 2287657 T5171 oasc.SolrResourceLoader.replaceClassLoader
> Adding
> 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/lib/classes/'
> to classloader
>    [junit4]   2> 2287734 T5171 oasc.SolrConfig.<init> Using Lucene
> MatchVersion: LUCENE_47
>    [junit4]   2> 2287818 T5171 oasc.SolrConfig.<init> Loaded SolrConfig:
> solrconfig-phrasesuggest.xml
>    [junit4]   2> 2287819 T5171 oass.IndexSchema.readSchema Reading Solr
> Schema from schema-phrasesuggest.xml
>    [junit4]   2> 2287826 T5171 oass.IndexSchema.readSchema [collection1]
> Schema name=test
>    [junit4]   2> 2287869 T5171 oass.IndexSchema.readSchema default search
> field in schema is text
>    [junit4]   2> 2287872 T5171 oass.IndexSchema.readSchema unique key
> field: id
>    [junit4]   2> 2287874 T5171 oasc.SolrCore.initDirectoryFactory
> org.apache.solr.core.MockDirectoryFactory
>    [junit4]   2> 2287874 T5171 oasc.SolrCore.<init> [collection1] Opening
> new SolrCore at
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/,
> dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-TestFreeTextSuggestions-1389855703745/
>    [junit4]   2> 2287875 T5171 oasc.SolrCore.<init> JMX monitoring not
> detected for core: collection1
>    [junit4]   2> 2287876 T5171 oasc.CachingDirectoryFactory.get return new
> directory for
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-TestFreeTextSuggestions-1389855703745
>    [junit4]   2> 2287876 T5171 oasc.SolrCore.getNewIndexDir New index
> directory detected: old=null
> new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-TestFreeTextSuggestions-1389855703745/index/
>    [junit4]   2> 2287876 T5171 oasc.SolrCore.initIndex WARN [collection1]
> Solr index directory
> '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-TestFreeTextSuggestions-1389855703745/index'
> doesn't exist. Creating new index...
>    [junit4]   2> 2287877 T5171 oasc.CachingDirectoryFactory.get return new
> directory for
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-TestFreeTextSuggestions-1389855703745/index
>    [junit4]   2> 2287878 T5171 oasu.RandomMergePolicy.<init>
> RandomMergePolicy wrapping class
> org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy:
> minMergeSize=0, mergeFactor=10, maxMergeSize=1935836600,
> maxMergeSizeForForcedMerge=9223372036854775807,
> calibrateSizeByDeletes=true, maxMergeDocs=2147483647,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
>    [junit4]   2> 2287879 T5171 oasc.SolrDeletionPolicy.onCommit
> SolrDeletionPolicy.onCommit: commits: num=1
>    [junit4]   2>
>  commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@6e3a75b8lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@30776db0
> ),segFN=segments_1,generation=1}
>    [junit4]   2> 2287879 T5171 oasc.SolrDeletionPolicy.updateCommits
> newest commit generation = 1
>    [junit4]   2> 2287882 T5171 oasc.SolrCore.loadUpdateProcessorChains no
> updateRequestProcessorChain defined as default, creating implicit default
>    [junit4]   2> 2287882 T5171 oasc.RequestHandlers.initHandlersFromConfig
> created standard: solr.StandardRequestHandler
>    [junit4]   2> 2287883 T5171 oasc.RequestHandlers.initHandlersFromConfig
> created /suggest_wfst: org.apache.solr.handler.component.SearchHandler
>    [junit4]   2> 2287883 T5171 oasc.RequestHandlers.initHandlersFromConfig
> created /suggest_analyzing: org.apache.solr.handler.component.SearchHandler
>    [junit4]   2> 2287884 T5171 oasc.RequestHandlers.initHandlersFromConfig
> created /infix_suggest_analyzing:
> org.apache.solr.handler.component.SearchHandler
>    [junit4]   2> 2287884 T5171 oasc.RequestHandlers.initHandlersFromConfig
> created /fuzzy_suggest_analyzing_with_file_dict:
> org.apache.solr.handler.component.SearchHandler
>    [junit4]   2> 2287884 T5171 oasc.RequestHandlers.initHandlersFromConfig
> created /free_text_suggest: org.apache.solr.handler.component.SearchHandler
>    [junit4]   2> 2287885 T5171 oasc.RequestHandlers.initHandlersFromConfig
> created /fuzzy_suggest_analyzing_with_high_freq_dict:
> org.apache.solr.handler.component.SearchHandler
>    [junit4]   2> 2287885 T5171 oasc.RequestHandlers.initHandlersFromConfig
> created /fuzzy_suggest_analyzing:
> org.apache.solr.handler.component.SearchHandler
>    [junit4]   2> 2287885 T5171 oasc.RequestHandlers.initHandlersFromConfig
> created /fuzzy_suggest_analyzing_with_max_edit_2:
> org.apache.solr.handler.component.SearchHandler
>    [junit4]   2> 2287886 T5171 oasc.RequestHandlers.initHandlersFromConfig
> created /fuzzy_suggest_analyzing_with_non_fuzzy_prefix_4:
> org.apache.solr.handler.component.SearchHandler
>    [junit4]   2> 2287886 T5171 oasc.RequestHandlers.initHandlersFromConfig
> created /fuzzy_suggest_analyzing_with_min_fuzzy_length_2:
> org.apache.solr.handler.component.SearchHandler
>    [junit4]   2> 2287891 T5171 oasu.CommitTracker.<init> Hard AutoCommit:
> disabled
>    [junit4]   2> 2287891 T5171 oasu.CommitTracker.<init> Soft AutoCommit:
> disabled
>    [junit4]   2> 2287891 T5171 oasu.RandomMergePolicy.<init>
> RandomMergePolicy wrapping class
> org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy:
> minMergeSize=1677721, mergeFactor=33, maxMergeSize=2147483648,
> maxMergeSizeForForcedMerge=9223372036854775807,
> calibrateSizeByDeletes=true, maxMergeDocs=2147483647,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
>    [junit4]   2> 2287892 T5171 oasc.SolrDeletionPolicy.onInit
> SolrDeletionPolicy.onInit: commits: num=1
>    [junit4]   2>
>  commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@6e3a75b8lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@30776db0
> ),segFN=segments_1,generation=1}
>    [junit4]   2> 2287893 T5171 oasc.SolrDeletionPolicy.updateCommits
> newest commit generation = 1
>    [junit4]   2> 2287893 T5171 oass.SolrIndexSearcher.<init> Opening
> Searcher@5cdeb0b7 main
>    [junit4]   2> 2287893 T5171 oashc.SpellCheckComponent.inform
> Initializing spell checkers
>    [junit4]   2> 2287894 T5171 oasss.Suggester.init init:
> {name=suggest_wfst,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.WFSTLookupFactory,storeDir=suggest_wfst,buildOnCommit=false,exactMatchFirst=true,sourceLocation=phrasesuggest.txt}
>    [junit4]   2> 2287896 T5171 oashc.SpellCheckComponent.inform
> Initializing spell checkers
>    [junit4]   2> 2287896 T5171 oasss.Suggester.init init:
> {name=suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingLookupFactory,storeDir=suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=ja_suggest,preserveSep=false,sourceLocation=jasuggest.txt}
>    [junit4]   2> 2287898 T5171 oashc.SpellCheckComponent.inform
> Initializing spell checkers
>    [junit4]   2> 2287898 T5171 oasss.Suggester.init init:
> {name=infix_suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingInfixLookupFactory,buildOnCommit=false,suggestAnalyzerFieldType=text,sourceLocation=analyzingInfixSuggest.txt}
>    [junit4]   2> 2287905 T5171 oashc.SuggestComponent.inform Initializing
> SuggestComponent
>    [junit4]   2> 2287905 T5171 oasss.SolrSuggester.init init:
> {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
>    [junit4]   2> 2287907 T5171 oasss.SolrSuggester.init Dictionary loaded
> with params:
> {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
>    [junit4]   2> 2287907 T5171 oashc.SuggestComponent.inform Initializing
> SuggestComponent
>    [junit4]   2> 2287907 T5171 oasss.SolrSuggester.init init:
> {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator=
> ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
>    [junit4]   2> 2287909 T5171 oasss.SolrSuggester.init Dictionary loaded
> with params:
> {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator=
> ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
>    [junit4]   2> 2287909 T5171 oashc.SuggestComponent.inform Initializing
> SuggestComponent
>    [junit4]   2> 2287909 T5171 oasss.SolrSuggester.init init:
> {name=fuzzy_suggest_analyzing_with_file_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.FileDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,sourceLocation=fuzzysuggest.txt}
>    [junit4]   2> 2287910 T5171 oasss.SolrSuggester.init WARN Loading
> stored lookup data failed, possibly not cached yet
>    [junit4]   2> 2287911 T5171 oasss.SolrSuggester.init Dictionary loaded
> with params:
> {name=fuzzy_suggest_analyzing_with_file_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.FileDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,sourceLocation=fuzzysuggest.txt}
>    [junit4]   2> 2287911 T5171 oashc.SpellCheckComponent.inform
> Initializing spell checkers
>    [junit4]   2> 2287911 T5171 oasss.Suggester.init init:
> {name=fuzzy_suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,sourceLocation=fuzzysuggest.txt}
>    [junit4]   2> 2287912 T5171 oasss.Suggester.init WARN Loading stored
> lookup data failed java.io.FileNotFoundException:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-TestFreeTextSuggestions-1389855703745/fuzzy_suggest_analyzing/fwfsta.bin
> (No such file or directory)
>    [junit4]   2>        at java.io.FileInputStream.open(Native Method)
>    [junit4]   2>        at
> java.io.FileInputStream.<init>(FileInputStream.java:138)
>    [junit4]   2>        at
> org.apache.solr.spelling.suggest.Suggester.init(Suggester.java:116)
>    [junit4]   2>        at
> org.apache.solr.handler.component.SpellCheckComponent.inform(SpellCheckComponent.java:636)
>    [junit4]   2>        at
> org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:631)
>    [junit4]   2>        at
> org.apache.solr.core.SolrCore.<init>(SolrCore.java:832)
>    [junit4]   2>        at
> org.apache.solr.core.SolrCore.<init>(SolrCore.java:627)
>    [junit4]   2>        at
> org.apache.solr.core.CoreContainer.createFromLocal(CoreContainer.java:562)
>    [junit4]   2>        at
> org.apache.solr.core.CoreContainer.create(CoreContainer.java:597)
>    [junit4]   2>        at
> org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:258)
>    [junit4]   2>        at
> org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:250)
>    [junit4]   2>        at
> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>    [junit4]   2>        at
> java.util.concurrent.FutureTask.run(FutureTask.java:166)
>    [junit4]   2>        at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>    [junit4]   2>        at
> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>    [junit4]   2>        at
> java.util.concurrent.FutureTask.run(FutureTask.java:166)
>    [junit4]   2>        at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>    [junit4]   2>        at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>    [junit4]   2>        at java.lang.Thread.run(Thread.java:724)
>    [junit4]   2>
>    [junit4]   2> 2287913 T5171 oashc.SpellCheckComponent.inform
> Initializing spell checkers
>    [junit4]   2> 2287913 T5171 oasss.Suggester.init init:
> {name=fuzzy_suggest_analyzing_with_max_edit_2,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,storeDir=fuzzy_suggest_analyzing_with_max_edit_2,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,maxEdits=2,sourceLocation=fuzzysuggest.txt}
>    [junit4]   2> 2287915 T5171 oashc.SpellCheckComponent.inform
> Initializing spell checkers
>    [junit4]   2> 2287915 T5171 oasss.Suggester.init init:
> {name=fuzzy_suggest_analyzing_with_non_fuzzy_prefix_4,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,storeDir=fuzzy_suggest_analyzing_with_non_fuzzy_prefix_4,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,nonFuzzyPrefix=4,sourceLocation=fuzzysuggest.txt}
>    [junit4]   2> 2287916 T5171 oashc.SpellCheckComponent.inform
> Initializing spell checkers
>    [junit4]   2> 2287916 T5171 oasss.Suggester.init init:
> {name=fuzzy_suggest_analyzing_with_min_fuzzy_length_2,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,storeDir=fuzzy_suggest_analyzing_with_min_fuzzy_length_2,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,minFuzzyLength=2,sourceLocation=fuzzysuggest.txt}
>    [junit4]   2> 2287918 T5172 oasc.SolrCore.registerSearcher
> [collection1] Registered new searcher Searcher@5cdeb0b7main{StandardDirectoryReader(segments_1:1:nrt)}
>    [junit4]   2> 2287918 T5171 oasc.CoreContainer.registerCore registering
> core: collection1
>    [junit4]   2> 2287936 T5170 oas.SolrTestCaseJ4.initCore ####initCore end
>    [junit4]   2> ASYNC  NEW_CORE C906 name=collection1
> org.apache.solr.core.SolrCore@6a78ed21
>    [junit4]   2> 2287936 T5170 C906 oashc.SuggestComponent.prepare
> SuggestComponent prepare with :
> {params(q=&suggest.buildAll=true&qt=/free_text_suggest),defaults(suggest=true)}
>    [junit4]   2> 2287937 T5170 C906 oasss.SolrSuggester.build build()
>    [junit4]   2> 2288005 T5170 oas.SolrTestCaseJ4.deleteCore ###deleteCore
>    [junit4]   2> 2288006 T5170 oasc.CoreContainer.shutdown Shutting down
> CoreContainer instance=30535420
>    [junit4]   2> 2288006 T5170 oasc.SolrCore.close [collection1]  CLOSING
> SolrCore org.apache.solr.core.SolrCore@6a78ed21
>    [junit4]   2> 2288006 T5170 oasu.DirectUpdateHandler2.close closing
> DirectUpdateHandler2{commits=0,autocommits=0,soft
> autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
>    [junit4]   2> 2288007 T5170 oasu.SolrCoreState.decrefSolrCoreState
> Closing SolrCoreState
>    [junit4]   2> 2288007 T5170 oasu.DefaultSolrCoreState.closeIndexWriter
> SolrCoreState ref count has reached 0 - closing IndexWriter
>    [junit4]   2> 2288008 T5170 oasu.DefaultSolrCoreState.closeIndexWriter
> closing IndexWriter with IndexWriterCloser
>    [junit4]   2> 2288010 T5170 oasc.SolrCore.closeSearcher [collection1]
> Closing main searcher on request.
>    [junit4]   2> 2288010 T5170 oasc.CachingDirectoryFactory.close Closing
> MockDirectoryFactory - 2 directories currently being tracked
>    [junit4]   2> 2288011 T5170
> oasc.CachingDirectoryFactory.closeCacheValue looking to close
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-TestFreeTextSuggestions-1389855703745
> [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-TestFreeTextSuggestions-1389855703745;done=false>>]
>    [junit4]   2> 2288011 T5170 oasc.CachingDirectoryFactory.close Closing
> directory:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-TestFreeTextSuggestions-1389855703745
>    [junit4]   2> 2288012 T5170
> oasc.CachingDirectoryFactory.closeCacheValue looking to close
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-TestFreeTextSuggestions-1389855703745/index
> [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-TestFreeTextSuggestions-1389855703745/index;done=false>>]
>    [junit4]   2> 2288012 T5170 oasc.CachingDirectoryFactory.close Closing
> directory:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-TestFreeTextSuggestions-1389855703745/index
>    [junit4]   2> NOTE: test params are: codec=Lucene3x,
> sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {},
> locale=de_CH, timezone=America/Managua
>    [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation
> 1.7.0_25 (64-bit)/cpus=16,threads=1,free=274107536,total=454033408
>    [junit4]   2> NOTE: All tests run in this JVM: [TestSolrIndexConfig,
> TestReplicationHandler, TestCopyFieldCollectionResource, TestZkChroot,
> OverseerCollectionProcessorTest, TestDocumentBuilder,
> OpenExchangeRatesOrgProviderTest, BasicZkTest, AliasIntegrationTest,
> DisMaxRequestHandlerTest, SuggestComponentTest, SimplePostToolTest,
> ZkNodePropsTest, FieldMutatingUpdateProcessorTest, MBeansHandlerTest,
> PingRequestHandlerTest, TestFastWriter,
> StatelessScriptUpdateProcessorFactoryTest, TestConfig, DebugComponentTest,
> AddBlockUpdateTest, TestRecovery, DocumentBuilderTest,
> TestCSVResponseWriter, TestPartialUpdateDeduplication, OutputWriterTest,
> TestLuceneMatchVersion, IndexSchemaRuntimeFieldTest,
> TestCursorMarkWithoutUniqueKey, SearchHandlerTest,
> TestDynamicFieldResource, ZkSolrClientTest, HardAutoCommitTest,
> DirectUpdateHandlerOptimizeTest, TestCollapseQParserPlugin,
> TestSchemaResource, TestUtils, DistributedQueryElevationComponentTest,
> TestSolrQueryParserDefaultOperatorResource, InfoHandlerTest,
> BlockDirectoryTest, TestSimpleQParserPlugin, URLClassifyProcessorTest,
> SchemaVersionSpecificBehaviorTest, ZkCLITest,
> DistributedDebugComponentTest, TestReversedWildcardFilterFactory,
> TermVectorComponentTest, DistributedSpellCheckComponentTest,
> TestPerFieldSimilarity, AddSchemaFieldsUpdateProcessorFactoryTest,
> TestUniqueKeyFieldResource, TestDistribDocBasedVersion, SOLR749Test,
> TestRTGBase, SolrIndexSplitterTest, UnloadDistributedZkTest,
> HdfsDirectoryTest, TestSuggestSpellingConverter, TestMergePolicyConfig,
> SolrInfoMBeanTest, TestFuzzyAnalyzedSuggestions, TestCodecSupport,
> TestRealTimeGet, MinimalSchemaTest, HdfsSyncSliceTest,
> SpellCheckComponentTest, ExternalFileFieldSortTest,
> BinaryUpdateRequestHandlerTest, TimeZoneUtilsTest, TestAddFieldRealTimeGet,
> ShowFileRequestHandlerTest, AssignTest, CurrencyFieldXmlFileTest,
> PrimitiveFieldTypeTest, CoreAdminCreateDiscoverTest, UUIDFieldTest,
> TriLevelCompositeIdRoutingTest, TestDFRSimilarityFactory,
> LoggingHandlerTest, TestSerializedLuceneMatchVersion, TestStressVersions,
> TestHashPartitioner, TestSolr4Spatial, SyncSliceTest, TestRandomFaceting,
> TestRandomDVFaceting, TestDistributedSearch, TestStressRecovery,
> ShardRoutingTest, TestGroupingSearch, OpenCloseCoreStressTest,
> OverseerTest, TestDistributedGrouping, TestFaceting, DeleteReplicaTest,
> ClusterStateUpdateTest, SolrCoreTest, DistributedTermsComponentTest,
> TestRangeQuery, SimpleFacetsTest, TestSolrXmlPersistence,
> CurrencyFieldOpenExchangeTest, LukeRequestHandlerTest, ZkControllerTest,
> BadIndexSchemaTest, CoreAdminHandlerTest, HighlighterTest,
> TestIndexSearcher, SolrCoreCheckLockOnStartupTest,
> TestMultiCoreConfBootstrap, SolrRequestParserTest, SuggesterTest,
> SuggesterTSTTest, WordBreakSolrSpellCheckerTest,
> SignatureUpdateProcessorFactoryTest, QueryEqualityTest, TermsComponentTest,
> TestSurroundQueryParser, DistanceFunctionTest, BJQParserTest,
> XsltUpdateRequestHandlerTest, JsonLoaderTest, TestFoldingMultitermQuery,
> TestCoreDiscovery, MoreLikeThisHandlerTest, QueryParsingTest,
> StandardRequestHandlerTest, FieldAnalysisRequestHandlerTest,
> DocumentAnalysisRequestHandlerTest, UpdateParamsTest, JSONWriterTest,
> RegexBoostProcessorTest, TestMaxScoreQueryParser, TestQuerySenderNoQuery,
> TestInfoStreamLogging, AlternateDirectoryTest, CopyFieldTest,
> SolrIndexConfigTest, TestFieldCollectionResource, TestSchemaNameResource,
> TestSchemaSimilarityResource, TestFieldTypeCollectionResource,
> TestSolrQueryParserResource, MultiTermTest,
> CoreContainerCoreInitFailuresTest, TestAnalyzeInfixSuggestions, SampleTest,
> TestCollationField, TestCharFilters, TestIBSimilarityFactory,
> EchoParamsTest, TestLMDirichletSimilarityFactory,
> TestBM25SimilarityFactory, TestClassNameShortening,
> TestShardHandlerFactory, SpellPossibilityIteratorTest, TestJmxMonitoredMap,
> TestSolrXMLSerializer, TestSystemIdResolver, QueryResultKeyTest,
> SpellingQueryConverterTest, SliceStateTest, FileUtilsTest,
> TestFreeTextSuggestions]
>    [junit4]   2> NOTE: reproduce with: ant test
>  -Dtestcase=TestFreeTextSuggestions -Dtests.seed=CB0AA5A193FA1857
> -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=de_CH
> -Dtests.timezone=America/Managua -Dtests.file.encoding=UTF-8
>    [junit4] ERROR   0.00s J0 | TestFreeTextSuggestions (suite) <<<
>    [junit4]    > Throwable #1: java.lang.AssertionError:
> o=-9223372036854775808
>    [junit4]    >        at
> __randomizedtesting.SeedInfo.seed([CB0AA5A193FA1857]:0)
>    [junit4]    >        at
> org.apache.lucene.util.fst.PositiveIntOutputs.valid(PositiveIntOutputs.java:104)
>    [junit4]    >        at
> org.apache.lucene.util.fst.PositiveIntOutputs.common(PositiveIntOutputs.java:47)
>    [junit4]    >        at
> org.apache.lucene.util.fst.PositiveIntOutputs.common(PositiveIntOutputs.java:32)
>    [junit4]    >        at
> org.apache.lucene.util.fst.Builder.add(Builder.java:422)
>    [junit4]    >        at
> org.apache.lucene.search.suggest.analyzing.FreeTextSuggester.build(FreeTextSuggester.java:359)
>    [junit4]    >        at
> org.apache.lucene.search.suggest.analyzing.FreeTextSuggester.build(FreeTextSuggester.java:278)
>    [junit4]    >        at
> org.apache.lucene.search.suggest.Lookup.build(Lookup.java:167)
>    [junit4]    >        at
> org.apache.solr.spelling.suggest.SolrSuggester.build(SolrSuggester.java:142)
>    [junit4]    >        at
> org.apache.solr.handler.component.SuggestComponent.prepare(SuggestComponent.java:163)
>    [junit4]    >        at
> org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:193)
>    [junit4]    >        at
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
>    [junit4]    >        at
> org.apache.solr.core.SolrCore.execute(SolrCore.java:1913)
>    [junit4]    >        at
> org.apache.solr.util.TestHarness.query(TestHarness.java:291)
>    [junit4]    >        at
> org.apache.solr.util.TestHarness.query(TestHarness.java:273)
>    [junit4]    >        at
> org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:618)
>    [junit4]    >        at
> org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:611)
>    [junit4]    >        at
> org.apache.solr.spelling.suggest.TestFreeTextSuggestions.beforeClass(TestFreeTextSuggestions.java:30)
>    [junit4]    >        at java.lang.Thread.run(Thread.java:724)
>    [junit4] Completed on J0 in 0.86s, 0 tests, 1 failure <<< FAILURES!
>
> [...truncated 10 lines...]
> BUILD FAILED
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:459:
> The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:439:
> The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:39:
> The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/extra-targets.xml:37:
> The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:189:
> The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:491:
> The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1308:
> The following error occurred while executing this line:
> /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:941:
> There were test failures: 353 suites, 1539 tests, 1 suite-level error, 34
> ignored (6 assumptions)
>
> Total time: 64 minutes 15 seconds
> Build step 'Invoke Ant' marked build as failure
> Archiving artifacts
> Recording test results
> Email was triggered for: Failure
> Sending email for trigger: Failure
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>

[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 1868 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/1868/

2 tests failed.
FAILED:  org.apache.solr.morphlines.cell.SolrCellMorphlineTest.testSolrCellDocumentTypes2

Error Message:
key:ignored_creation_date expected:<[2007-10-01T16:13:56Z]> but was:<[२००७-१०-०१T१६:१३:५६Z]>

Stack Trace:
java.lang.AssertionError: key:ignored_creation_date expected:<[2007-10-01T16:13:56Z]> but was:<[२००७-१०-०१T१६:१३:५६Z]>
	at __randomizedtesting.SeedInfo.seed([472186306C3A6CA5:CCA13DD06BCCFF5B]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.apache.solr.morphlines.solr.AbstractSolrMorphlineTestBase.testDocumentTypesInternal(AbstractSolrMorphlineTestBase.java:165)
	at org.apache.solr.morphlines.cell.SolrCellMorphlineTest.testSolrCellDocumentTypes2(SolrCellMorphlineTest.java:255)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:724)


FAILED:  org.apache.solr.morphlines.cell.SolrCellMorphlineTest.testSolrCellDocumentTypes

Error Message:
key:ignored_creation_date expected:<[2011-09-02T10:11:00Z]> but was:<[२०११-०९-०२T१०:११:००Z]>

Stack Trace:
java.lang.AssertionError: key:ignored_creation_date expected:<[2011-09-02T10:11:00Z]> but was:<[२०११-०९-०२T१०:११:००Z]>
	at __randomizedtesting.SeedInfo.seed([472186306C3A6CA5:DDE225AE09E13270]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.apache.solr.morphlines.solr.AbstractSolrMorphlineTestBase.testDocumentTypesInternal(AbstractSolrMorphlineTestBase.java:165)
	at org.apache.solr.morphlines.cell.SolrCellMorphlineTest.testSolrCellDocumentTypes(SolrCellMorphlineTest.java:193)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:724)




Build Log:
[...truncated 18093 lines...]
   [junit4] Suite: org.apache.solr.morphlines.cell.SolrCellMorphlineTest
   [junit4]   1> 2014-01-19 04:55:11,165 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] solr.SolrTestCaseJ4 (SolrTestCaseJ4.java:initCore(454)) - ####initCore
   [junit4]   1> 2014-01-19 04:55:11,303 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] core.SolrResourceLoader (SolrResourceLoader.java:<init>(116)) - new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/'
   [junit4]   1> 2014-01-19 04:55:13,419 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] core.SolrConfig (SolrConfig.java:initLibs(529)) - Adding specified lib dirs to ClassLoader
   [junit4]   1> 2014-01-19 04:55:13,424 WARN  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../contrib/extraction/lib (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../contrib/extraction/lib).
   [junit4]   1> 2014-01-19 04:55:13,426 WARN  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../dist).
   [junit4]   1> 2014-01-19 04:55:13,427 WARN  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../contrib/clustering/lib/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../contrib/clustering/lib).
   [junit4]   1> 2014-01-19 04:55:13,428 WARN  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../dist).
   [junit4]   1> 2014-01-19 04:55:13,430 WARN  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../contrib/langid/lib/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../contrib/langid/lib).
   [junit4]   1> 2014-01-19 04:55:13,431 WARN  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../dist).
   [junit4]   1> 2014-01-19 04:55:13,432 WARN  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../contrib/velocity/lib (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../contrib/velocity/lib).
   [junit4]   1> 2014-01-19 04:55:13,433 WARN  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../dist).
   [junit4]   1> 2014-01-19 04:55:13,434 WARN  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: /non/existent/dir/yields/warning (resolved as: /non/existent/dir/yields/warning).
   [junit4]   1> 2014-01-19 04:55:13,678 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] core.SolrConfig (SolrConfig.java:<init>(170)) - Using Lucene MatchVersion: LUCENE_43
   [junit4]   1> 2014-01-19 04:55:14,064 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] core.Config (SolrConfig.java:<init>(288)) - Loaded SolrConfig: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/conf/solrconfig.xml
   [junit4]   1> 2014-01-19 04:55:14,105 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] schema.IndexSchema (IndexSchema.java:readSchema(424)) - Reading Solr Schema from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/conf/schema.xml
   [junit4]   1> 2014-01-19 04:55:14,269 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] schema.IndexSchema (IndexSchema.java:readSchema(452)) - [null] Schema name=example
   [junit4]   1> 2014-01-19 04:55:16,875 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] schema.IndexSchema (IndexSchema.java:readSchema(550)) - unique key field: id
   [junit4]   1> 2014-01-19 04:55:17,913 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] schema.FileExchangeRateProvider (CurrencyField.java:reload(787)) - Reloading exchange rates from file currency.xml
   [junit4]   1> 2014-01-19 04:55:17,959 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] schema.FileExchangeRateProvider (CurrencyField.java:reload(787)) - Reloading exchange rates from file currency.xml
   [junit4]   1> 2014-01-19 04:55:18,327 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] core.SolrResourceLoader (SolrResourceLoader.java:locateSolrHome(711)) - JNDI not configured for solr (NoInitialContextEx)
   [junit4]   1> 2014-01-19 04:55:18,328 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] core.SolrResourceLoader (SolrResourceLoader.java:locateSolrHome(723)) - using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr
   [junit4]   1> 2014-01-19 04:55:18,329 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] core.SolrResourceLoader (SolrResourceLoader.java:<init>(116)) - new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/'
   [junit4]   1> 2014-01-19 04:55:18,521 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] core.SolrResourceLoader (SolrResourceLoader.java:locateSolrHome(711)) - JNDI not configured for solr (NoInitialContextEx)
   [junit4]   1> 2014-01-19 04:55:18,522 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] core.SolrResourceLoader (SolrResourceLoader.java:locateSolrHome(723)) - using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr
   [junit4]   1> 2014-01-19 04:55:18,523 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] core.SolrResourceLoader (SolrResourceLoader.java:<init>(112)) - new SolrResourceLoader for deduced Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/'
   [junit4]   1> 2014-01-19 04:55:18,820 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] core.CoreContainer (CoreContainer.java:<init>(107)) - New CoreContainer 533248865
   [junit4]   1> 2014-01-19 04:55:18,821 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] core.CoreContainer (CoreContainer.java:load(187)) - Loading cores into CoreContainer [instanceDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/]
   [junit4]   1> 2014-01-19 04:55:18,900 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] component.HttpShardHandlerFactory (HttpShardHandlerFactory.java:getParameter(169)) - Setting socketTimeout to: 0
   [junit4]   1> 2014-01-19 04:55:18,901 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] component.HttpShardHandlerFactory (HttpShardHandlerFactory.java:getParameter(169)) - Setting urlScheme to: http://
   [junit4]   1> 2014-01-19 04:55:18,902 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] component.HttpShardHandlerFactory (HttpShardHandlerFactory.java:getParameter(169)) - Setting connTimeout to: 0
   [junit4]   1> 2014-01-19 04:55:18,902 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] component.HttpShardHandlerFactory (HttpShardHandlerFactory.java:getParameter(169)) - Setting maxConnectionsPerHost to: 20
   [junit4]   1> 2014-01-19 04:55:18,903 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] component.HttpShardHandlerFactory (HttpShardHandlerFactory.java:getParameter(169)) - Setting corePoolSize to: 0
   [junit4]   1> 2014-01-19 04:55:18,903 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] component.HttpShardHandlerFactory (HttpShardHandlerFactory.java:getParameter(169)) - Setting maximumPoolSize to: 2147483647
   [junit4]   1> 2014-01-19 04:55:18,904 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] component.HttpShardHandlerFactory (HttpShardHandlerFactory.java:getParameter(169)) - Setting maxThreadIdleTime to: 5
   [junit4]   1> 2014-01-19 04:55:18,905 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] component.HttpShardHandlerFactory (HttpShardHandlerFactory.java:getParameter(169)) - Setting sizeOfQueue to: -1
   [junit4]   1> 2014-01-19 04:55:18,905 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] component.HttpShardHandlerFactory (HttpShardHandlerFactory.java:getParameter(169)) - Setting fairnessPolicy to: false
   [junit4]   1> 2014-01-19 04:55:19,577 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] logging.LogWatcher (LogWatcher.java:createWatcher(153)) - SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   1> 2014-01-19 04:55:19,583 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] logging.LogWatcher (LogWatcher.java:newRegisteredLogWatcher(138)) - Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   1> 2014-01-19 04:55:19,591 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] core.CoreContainer (CoreContainer.java:load(213)) - Host Name: 
   [junit4]   1> 2014-01-19 04:55:20,046 INFO  [coreLoadExecutor-4-thread-1] core.CoreContainer (CoreContainer.java:create(589)) - Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1
   [junit4]   1> 2014-01-19 04:55:20,048 INFO  [coreLoadExecutor-4-thread-1] core.SolrResourceLoader (SolrResourceLoader.java:<init>(116)) - new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/'
   [junit4]   1> 2014-01-19 04:55:20,242 INFO  [coreLoadExecutor-4-thread-1] core.SolrConfig (SolrConfig.java:initLibs(529)) - Adding specified lib dirs to ClassLoader
   [junit4]   1> 2014-01-19 04:55:20,244 WARN  [coreLoadExecutor-4-thread-1] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../contrib/extraction/lib (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../contrib/extraction/lib).
   [junit4]   1> 2014-01-19 04:55:20,245 WARN  [coreLoadExecutor-4-thread-1] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../dist).
   [junit4]   1> 2014-01-19 04:55:20,247 WARN  [coreLoadExecutor-4-thread-1] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../contrib/clustering/lib/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../contrib/clustering/lib).
   [junit4]   1> 2014-01-19 04:55:20,248 WARN  [coreLoadExecutor-4-thread-1] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../dist).
   [junit4]   1> 2014-01-19 04:55:20,250 WARN  [coreLoadExecutor-4-thread-1] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../contrib/langid/lib/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../contrib/langid/lib).
   [junit4]   1> 2014-01-19 04:55:20,251 WARN  [coreLoadExecutor-4-thread-1] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../dist).
   [junit4]   1> 2014-01-19 04:55:20,252 WARN  [coreLoadExecutor-4-thread-1] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../contrib/velocity/lib (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../contrib/velocity/lib).
   [junit4]   1> 2014-01-19 04:55:20,253 WARN  [coreLoadExecutor-4-thread-1] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../dist).
   [junit4]   1> 2014-01-19 04:55:20,254 WARN  [coreLoadExecutor-4-thread-1] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: /non/existent/dir/yields/warning (resolved as: /non/existent/dir/yields/warning).
   [junit4]   1> 2014-01-19 04:55:20,361 INFO  [coreLoadExecutor-4-thread-1] core.SolrConfig (SolrConfig.java:<init>(170)) - Using Lucene MatchVersion: LUCENE_43
   [junit4]   1> 2014-01-19 04:55:20,532 INFO  [coreLoadExecutor-4-thread-1] core.Config (SolrConfig.java:<init>(288)) - Loaded SolrConfig: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/conf/solrconfig.xml
   [junit4]   1> 2014-01-19 04:55:20,535 INFO  [coreLoadExecutor-4-thread-1] schema.IndexSchema (IndexSchema.java:readSchema(424)) - Reading Solr Schema from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/conf/schema.xml
   [junit4]   1> 2014-01-19 04:55:20,630 INFO  [coreLoadExecutor-4-thread-1] schema.IndexSchema (IndexSchema.java:readSchema(452)) - [collection1] Schema name=example
   [junit4]   1> 2014-01-19 04:55:21,431 INFO  [coreLoadExecutor-4-thread-1] schema.IndexSchema (IndexSchema.java:readSchema(550)) - unique key field: id
   [junit4]   1> 2014-01-19 04:55:21,464 INFO  [coreLoadExecutor-4-thread-1] schema.FileExchangeRateProvider (CurrencyField.java:reload(787)) - Reloading exchange rates from file currency.xml
   [junit4]   1> 2014-01-19 04:55:21,474 INFO  [coreLoadExecutor-4-thread-1] schema.FileExchangeRateProvider (CurrencyField.java:reload(787)) - Reloading exchange rates from file currency.xml
   [junit4]   1> 2014-01-19 04:55:21,687 INFO  [coreLoadExecutor-4-thread-1] core.SolrCore (SolrCore.java:initDirectoryFactory(439)) - org.apache.solr.core.MockDirectoryFactory
   [junit4]   1> 2014-01-19 04:55:21,725 INFO  [coreLoadExecutor-4-thread-1] core.SolrCore (SolrCore.java:<init>(689)) - [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/contrib/solr-morphlines-cell/test/J0/./solrtest-SolrCellMorphlineTest-1390107311181/
   [junit4]   1> 2014-01-19 04:55:21,730 INFO  [coreLoadExecutor-4-thread-1] core.JmxMonitoredMap (JmxMonitoredMap.java:<init>(85)) - No JMX servers found, not exposing Solr information with JMX.
   [junit4]   1> 2014-01-19 04:55:21,784 INFO  [coreLoadExecutor-4-thread-1] core.SolrCore (SolrCore.java:initListeners(354)) - [collection1] Added SolrEventListener for newSearcher: org.apache.solr.core.QuerySenderListener{queries=[]}
   [junit4]   1> 2014-01-19 04:55:21,784 INFO  [coreLoadExecutor-4-thread-1] core.SolrCore (SolrCore.java:initListeners(350)) - [collection1] Added SolrEventListener for firstSearcher: org.apache.solr.core.QuerySenderListener{queries=[{q=static firstSearcher warming in solrconfig.xml}]}
   [junit4]   1> 2014-01-19 04:55:21,885 INFO  [coreLoadExecutor-4-thread-1] core.CachingDirectoryFactory (CachingDirectoryFactory.java:get(360)) - return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/contrib/solr-morphlines-cell/test/J0/./solrtest-SolrCellMorphlineTest-1390107311181
   [junit4]   1> 2014-01-19 04:55:21,886 INFO  [coreLoadExecutor-4-thread-1] core.SolrCore (SolrCore.java:getNewIndexDir(284)) - New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/contrib/solr-morphlines-cell/test/J0/./solrtest-SolrCellMorphlineTest-1390107311181/index/
   [junit4]   1> 2014-01-19 04:55:21,886 WARN  [coreLoadExecutor-4-thread-1] core.SolrCore (SolrCore.java:initIndex(505)) - [collection1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/contrib/solr-morphlines-cell/test/J0/./solrtest-SolrCellMorphlineTest-1390107311181/index' doesn't exist. Creating new index...
   [junit4]   1> 2014-01-19 04:55:21,925 INFO  [coreLoadExecutor-4-thread-1] core.CachingDirectoryFactory (CachingDirectoryFactory.java:get(360)) - return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/contrib/solr-morphlines-cell/test/J0/./solrtest-SolrCellMorphlineTest-1390107311181/index
   [junit4]   1> 2014-01-19 04:55:22,084 INFO  [coreLoadExecutor-4-thread-1] core.SolrCore (SolrDeletionPolicy.java:onCommit(98)) - SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   1> 	commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@77241c5e lockFactory=org.apache.lucene.store.NativeFSLockFactory@7ab57b3e),segFN=segments_1,generation=1}
   [junit4]   1> 2014-01-19 04:55:22,088 INFO  [coreLoadExecutor-4-thread-1] core.SolrCore (SolrDeletionPolicy.java:updateCommits(165)) - newest commit generation = 1
   [junit4]   1> 2014-01-19 04:55:22,191 INFO  [coreLoadExecutor-4-thread-1] core.SolrCore (SolrCore.java:initWriters(2033)) - created json: solr.JSONResponseWriter
   [junit4]   1> 2014-01-19 04:55:22,192 INFO  [coreLoadExecutor-4-thread-1] core.SolrCore (SolrCore.java:initWriters(2015)) - adding lazy queryResponseWriter: solr.VelocityResponseWriter
   [junit4]   1> 2014-01-19 04:55:22,196 INFO  [coreLoadExecutor-4-thread-1] core.SolrCore (SolrCore.java:initWriters(2033)) - created velocity: solr.VelocityResponseWriter
   [junit4]   1> 2014-01-19 04:55:22,244 INFO  [coreLoadExecutor-4-thread-1] core.SolrCore (SolrCore.java:initWriters(2033)) - created xslt: solr.XSLTResponseWriter
   [junit4]   1> 2014-01-19 04:55:22,245 INFO  [coreLoadExecutor-4-thread-1] response.XSLTResponseWriter (XSLTResponseWriter.java:init(63)) - xsltCacheLifetimeSeconds=5
   [junit4]   1> 2014-01-19 04:55:23,704 INFO  [coreLoadExecutor-4-thread-1] core.SolrCore (SolrCore.java:loadUpdateProcessorChains(928)) - no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   1> 2014-01-19 04:55:23,861 INFO  [coreLoadExecutor-4-thread-1] core.RequestHandlers (RequestHandlers.java:initHandlersFromConfig(165)) - created /select: solr.SearchHandler
   [junit4]   1> 2014-01-19 04:55:23,862 INFO  [coreLoadExecutor-4-thread-1] core.RequestHandlers (RequestHandlers.java:initHandlersFromConfig(165)) - created /query: solr.SearchHandler
   [junit4]   1> 2014-01-19 04:55:23,886 INFO  [coreLoadExecutor-4-thread-1] core.RequestHandlers (RequestHandlers.java:initHandlersFromConfig(165)) - created /get: solr.RealTimeGetHandler
   [junit4]   1> 2014-01-19 04:55:23,887 INFO  [coreLoadExecutor-4-thread-1] core.RequestHandlers (RequestHandlers.java:initHandlersFromConfig(165)) - created /browse: solr.SearchHandler
   [junit4]   1> 2014-01-19 04:55:23,922 INFO  [coreLoadExecutor-4-thread-1] core.RequestHandlers (RequestHandlers.java:initHandlersFromConfig(165)) - created /update: solr.UpdateRequestHandler
   [junit4]   1> 2014-01-19 04:55:23,947 WARN  [coreLoadExecutor-4-thread-1] core.SolrResourceLoader (SolrResourceLoader.java:findClass(486)) - Solr loaded a deprecated plugin/analysis class [solr.JsonUpdateRequestHandler]. Please consult documentation how to replace it accordingly.
   [junit4]   1> 2014-01-19 04:55:23,948 INFO  [coreLoadExecutor-4-thread-1] core.RequestHandlers (RequestHandlers.java:initHandlersFromConfig(165)) - created /update/json: solr.JsonUpdateRequestHandler
   [junit4]   1> 2014-01-19 04:55:23,972 WARN  [coreLoadExecutor-4-thread-1] core.SolrResourceLoader (SolrResourceLoader.java:findClass(486)) - Solr loaded a deprecated plugin/analysis class [solr.CSVRequestHandler]. Please consult documentation how to replace it accordingly.
   [junit4]   1> 2014-01-19 04:55:23,973 INFO  [coreLoadExecutor-4-thread-1] core.RequestHandlers (RequestHandlers.java:initHandlersFromConfig(165)) - created /update/csv: solr.CSVRequestHandler
   [junit4]   1> 2014-01-19 04:55:23,973 INFO  [coreLoadExecutor-4-thread-1] core.RequestHandlers (RequestHandlers.java:initHandlersFromConfig(147)) - adding lazy requestHandler: solr.FieldAnalysisRequestHandler
   [junit4]   1> 2014-01-19 04:55:23,977 INFO  [coreLoadExecutor-4-thread-1] core.RequestHandlers (RequestHandlers.java:initHandlersFromConfig(165)) - created /analysis/field: solr.FieldAnalysisRequestHandler
   [junit4]   1> 2014-01-19 04:55:23,978 INFO  [coreLoadExecutor-4-thread-1] core.RequestHandlers (RequestHandlers.java:initHandlersFromConfig(147)) - adding lazy requestHandler: solr.DocumentAnalysisRequestHandler
   [junit4]   1> 2014-01-19 04:55:23,978 INFO  [coreLoadExecutor-4-thread-1] core.RequestHandlers (RequestHandlers.java:initHandlersFromConfig(165)) - created /analysis/document: solr.DocumentAnalysisRequestHandler
   [junit4]   1> 2014-01-19 04:55:24,010 INFO  [coreLoadExecutor-4-thread-1] core.RequestHandlers (RequestHandlers.java:initHandlersFromConfig(165)) - created /admin/: solr.admin.AdminHandlers
   [junit4]   1> 2014-01-19 04:55:24,034 INFO  [coreLoadExecutor-4-thread-1] core.RequestHandlers (RequestHandlers.java:initHandlersFromConfig(165)) - created /admin/ping: solr.PingRequestHandler
   [junit4]   1> 2014-01-19 04:55:24,059 INFO  [coreLoadExecutor-4-thread-1] core.RequestHandlers (RequestHandlers.java:initHandlersFromConfig(165)) - created /debug/dump: solr.DumpRequestHandler
   [junit4]   1> 2014-01-19 04:55:24,106 INFO  [coreLoadExecutor-4-thread-1] core.RequestHandlers (RequestHandlers.java:initHandlersFromConfig(165)) - created /replication: solr.ReplicationHandler
   [junit4]   1> 2014-01-19 04:55:24,106 INFO  [coreLoadExecutor-4-thread-1] core.RequestHandlers (RequestHandlers.java:initHandlersFromConfig(147)) - adding lazy requestHandler: solr.SearchHandler
   [junit4]   1> 2014-01-19 04:55:24,107 INFO  [coreLoadExecutor-4-thread-1] core.RequestHandlers (RequestHandlers.java:initHandlersFromConfig(165)) - created /spell: solr.SearchHandler
   [junit4]   1> 2014-01-19 04:55:24,107 INFO  [coreLoadExecutor-4-thread-1] core.RequestHandlers (RequestHandlers.java:initHandlersFromConfig(147)) - adding lazy requestHandler: solr.SearchHandler
   [junit4]   1> 2014-01-19 04:55:24,108 INFO  [coreLoadExecutor-4-thread-1] core.RequestHandlers (RequestHandlers.java:initHandlersFromConfig(165)) - created /tvrh: solr.SearchHandler
   [junit4]   1> 2014-01-19 04:55:24,108 INFO  [coreLoadExecutor-4-thread-1] core.RequestHandlers (RequestHandlers.java:initHandlersFromConfig(147)) - adding lazy requestHandler: solr.SearchHandler
   [junit4]   1> 2014-01-19 04:55:24,109 INFO  [coreLoadExecutor-4-thread-1] core.RequestHandlers (RequestHandlers.java:initHandlersFromConfig(165)) - created /terms: solr.SearchHandler
   [junit4]   1> 2014-01-19 04:55:24,109 INFO  [coreLoadExecutor-4-thread-1] core.RequestHandlers (RequestHandlers.java:initHandlersFromConfig(147)) - adding lazy requestHandler: solr.SearchHandler
   [junit4]   1> 2014-01-19 04:55:24,110 INFO  [coreLoadExecutor-4-thread-1] core.RequestHandlers (RequestHandlers.java:initHandlersFromConfig(165)) - created /elevate: solr.SearchHandler
   [junit4]   1> 2014-01-19 04:55:24,255 INFO  [coreLoadExecutor-4-thread-1] loader.XMLLoader (XMLLoader.java:init(111)) - xsltCacheLifetimeSeconds=60
   [junit4]   1> 2014-01-19 04:55:24,283 INFO  [coreLoadExecutor-4-thread-1] loader.XMLLoader (XMLLoader.java:init(111)) - xsltCacheLifetimeSeconds=60
   [junit4]   1> 2014-01-19 04:55:24,285 INFO  [coreLoadExecutor-4-thread-1] loader.XMLLoader (XMLLoader.java:init(111)) - xsltCacheLifetimeSeconds=60
   [junit4]   1> 2014-01-19 04:55:24,384 INFO  [coreLoadExecutor-4-thread-1] core.SolrCore (CommitTracker.java:<init>(83)) - Hard AutoCommit: if uncommited for 60000ms; 
   [junit4]   1> 2014-01-19 04:55:24,385 INFO  [coreLoadExecutor-4-thread-1] core.SolrCore (CommitTracker.java:<init>(83)) - Soft AutoCommit: if uncommited for 1000ms; 
   [junit4]   1> 2014-01-19 04:55:24,388 INFO  [coreLoadExecutor-4-thread-1] core.SolrCore (SolrDeletionPolicy.java:onInit(85)) - SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   1> 	commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@77241c5e lockFactory=org.apache.lucene.store.NativeFSLockFactory@7ab57b3e),segFN=segments_1,generation=1}
   [junit4]   1> 2014-01-19 04:55:24,388 INFO  [coreLoadExecutor-4-thread-1] core.SolrCore (SolrDeletionPolicy.java:updateCommits(165)) - newest commit generation = 1
   [junit4]   1> 2014-01-19 04:55:24,443 INFO  [coreLoadExecutor-4-thread-1] search.SolrIndexSearcher (SolrIndexSearcher.java:<init>(199)) - Opening Searcher@71e7c512 main
   [junit4]   1> 2014-01-19 04:55:24,481 INFO  [coreLoadExecutor-4-thread-1] component.SpellCheckComponent (SpellCheckComponent.java:inform(623)) - Initializing spell checkers
   [junit4]   1> 2014-01-19 04:55:24,578 INFO  [coreLoadExecutor-4-thread-1] spelling.DirectSolrSpellChecker (DirectSolrSpellChecker.java:init(102)) - init: {name=default,field=name,classname=solr.DirectSolrSpellChecker,distanceMeasure=internal,accuracy=0.5,maxEdits=2,minPrefix=1,maxInspections=5,minQueryLength=4,maxQueryFrequency=0.01}
   [junit4]   1> 2014-01-19 04:55:24,670 INFO  [coreLoadExecutor-4-thread-1] component.SpellCheckComponent (SpellCheckComponent.java:inform(672)) - No queryConverter defined, using default converter
   [junit4]   1> 2014-01-19 04:55:24,688 INFO  [coreLoadExecutor-4-thread-1] component.QueryElevationComponent (QueryElevationComponent.java:inform(223)) - Loading QueryElevation from: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/conf/elevate.xml
   [junit4]   1> 2014-01-19 04:55:24,975 INFO  [coreLoadExecutor-4-thread-1] handler.ReplicationHandler (ReplicationHandler.java:inform(965)) - Commits will be reserved for  10000
   [junit4]   1> 2014-01-19 04:55:24,977 INFO  [searcherExecutor-5-thread-1] core.SolrCore (QuerySenderListener.java:newSearcher(44)) - QuerySenderListener sending requests to Searcher@71e7c512 main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   1> 2014-01-19 04:55:24,981 INFO  [coreLoadExecutor-4-thread-1] core.CoreContainer (CoreContainer.java:registerCore(489)) - registering core: collection1
   [junit4]   1> 2014-01-19 04:55:25,007 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] solr.SolrTestCaseJ4 (SolrTestCaseJ4.java:initCore(473)) - ####initCore end
   [junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/contrib/solr-morphlines-cell/test/J0/./solrtest-SolrCellMorphlineTest-1390107311181
   [junit4]   1> 2014-01-19 04:55:25,075 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] solr.SolrTestCaseJ4 (SolrTestCaseJ4.java:setUp(222)) - ###Starting testSolrCellXML
   [junit4]   1> 2014-01-19 04:55:25,851 INFO  [searcherExecutor-5-thread-1] core.SolrCore (SolrCore.java:execute(1917)) - [collection1] webapp=null path=null params={distrib=false&event=firstSearcher&q=static+firstSearcher+warming+in+solrconfig.xml} hits=0 status=0 QTime=837 
   [junit4]   1> 2014-01-19 04:55:25,860 INFO  [searcherExecutor-5-thread-1] core.SolrCore (QuerySenderListener.java:newSearcher(91)) - QuerySenderListener done.
   [junit4]   1> 2014-01-19 04:55:25,861 INFO  [searcherExecutor-5-thread-1] component.SpellCheckComponent (SpellCheckComponent.java:newSearcher(713)) - Loading spell index for spellchecker: default
   [junit4]   1> 2014-01-19 04:55:25,862 INFO  [searcherExecutor-5-thread-1] component.SpellCheckComponent (SpellCheckComponent.java:newSearcher(713)) - Loading spell index for spellchecker: wordbreak
   [junit4]   1> 2014-01-19 04:55:25,863 INFO  [searcherExecutor-5-thread-1] core.SolrCore (SolrCore.java:registerSearcher(1865)) - [collection1] Registered new searcher Searcher@71e7c512 main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   1> 2014-01-19 04:55:26,199 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] processor.LogUpdateProcessor (LogUpdateProcessorFactory.java:finish(198)) - [collection1] webapp=null path=/update params={} {deleteByQuery=*:* (-1457633179275886592)} 0 894
   [junit4]   1> 2014-01-19 04:55:26,206 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] update.UpdateHandler (DirectUpdateHandler2.java:commit(521)) - start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   1> 2014-01-19 04:55:26,206 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] update.UpdateHandler (DirectUpdateHandler2.java:commit(561)) - No uncommitted changes. Skipping IW.commit.
   [junit4]   1> 2014-01-19 04:55:26,208 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] search.SolrIndexSearcher (SolrIndexSearcher.java:<init>(199)) - Opening Searcher@7b085bce main
   [junit4]   1> 2014-01-19 04:55:26,219 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] update.UpdateHandler (DirectUpdateHandler2.java:commit(612)) - end_commit_flush
   [junit4]   1> 2014-01-19 04:55:26,220 INFO  [searcherExecutor-5-thread-1] core.SolrCore (QuerySenderListener.java:newSearcher(44)) - QuerySenderListener sending requests to Searcher@7b085bce main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   1> 2014-01-19 04:55:26,221 INFO  [searcherExecutor-5-thread-1] core.SolrCore (QuerySenderListener.java:newSearcher(91)) - QuerySenderListener done.
   [junit4]   1> 2014-01-19 04:55:26,222 INFO  [searcherExecutor-5-thread-1] core.SolrCore (SolrCore.java:registerSearcher(1865)) - [collection1] Registered new searcher Searcher@7b085bce main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   1> 2014-01-19 04:55:26,223 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] processor.LogUpdateProcessor (LogUpdateProcessorFactory.java:finish(198)) - [collection1] webapp=null path=/update params={commit=true&softCommit=false&waitSearcher=true} {commit=} 0 18
   [junit4]   1> 2014-01-19 04:55:27,204 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] api.MorphlineContext (MorphlineContext.java:importCommandBuilders(75)) - Importing commands
   [junit4]   1> 2014-01-19 04:55:31,834 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:<init>(116)) - new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/'
   [junit4]   1> 2014-01-19 04:55:31,945 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrConfig (SolrConfig.java:initLibs(529)) - Adding specified lib dirs to ClassLoader
   [junit4]   1> 2014-01-19 04:55:31,946 WARN  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../contrib/extraction/lib (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../contrib/extraction/lib).
   [junit4]   1> 2014-01-19 04:55:31,947 WARN  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../dist).
   [junit4]   1> 2014-01-19 04:55:31,948 WARN  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../contrib/clustering/lib/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../contrib/clustering/lib).
   [junit4]   1> 2014-01-19 04:55:31,949 WARN  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../dist).
   [junit4]   1> 2014-01-19 04:55:31,950 WARN  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../contrib/langid/lib/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../contrib/langid/lib).
   [junit4]   1> 2014-01-19 04:55:31,951 WARN  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../dist).
   [junit4]   1> 2014-01-19 04:55:31,952 WARN  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../contrib/velocity/lib (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../contrib/velocity/lib).
   [junit4]   1> 2014-01-19 04:55:31,953 WARN  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../dist).
   [junit4]   1> 2014-01-19 04:55:31,954 WARN  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: /non/existent/dir/yields/warning (resolved as: /non/existent/dir/yields/warning).
   [junit4]   1> 2014-01-19 04:55:32,006 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrConfig (SolrConfig.java:<init>(170)) - Using Lucene MatchVersion: LUCENE_43
   [junit4]   1> 2014-01-19 04:55:32,143 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.Config (SolrConfig.java:<init>(288)) - Loaded SolrConfig: solrconfig.xml
   [junit4]   1> 2014-01-19 04:55:32,145 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] schema.IndexSchema (IndexSchema.java:readSchema(424)) - Reading Solr Schema from schema.xml
   [junit4]   1> 2014-01-19 04:55:32,221 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] schema.IndexSchema (IndexSchema.java:readSchema(452)) - [null] Schema name=example
   [junit4]   1> 2014-01-19 04:55:33,269 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] schema.IndexSchema (IndexSchema.java:readSchema(550)) - unique key field: id
   [junit4]   1> 2014-01-19 04:55:33,317 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] schema.FileExchangeRateProvider (CurrencyField.java:reload(787)) - Reloading exchange rates from file currency.xml
   [junit4]   1> 2014-01-19 04:55:33,332 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] schema.FileExchangeRateProvider (CurrencyField.java:reload(787)) - Reloading exchange rates from file currency.xml
   [junit4]   1> 2014-01-19 04:55:33,626 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:<init>(116)) - new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/'
   [junit4]   1> 2014-01-19 04:55:33,793 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrConfig (SolrConfig.java:initLibs(529)) - Adding specified lib dirs to ClassLoader
   [junit4]   1> 2014-01-19 04:55:33,794 WARN  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../contrib/extraction/lib (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../contrib/extraction/lib).
   [junit4]   1> 2014-01-19 04:55:33,795 WARN  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../dist).
   [junit4]   1> 2014-01-19 04:55:33,796 WARN  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../contrib/clustering/lib/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../contrib/clustering/lib).
   [junit4]   1> 2014-01-19 04:55:33,797 WARN  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../dist).
   [junit4]   1> 2014-01-19 04:55:33,798 WARN  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../contrib/langid/lib/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../contrib/langid/lib).
   [junit4]   1> 2014-01-19 04:55:33,799 WARN  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../dist).
   [junit4]   1> 2014-01-19 04:55:33,800 WARN  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../contrib/velocity/lib (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../contrib/velocity/lib).
   [junit4]   1> 2014-01-19 04:55:33,801 WARN  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../dist).
   [junit4]   1> 2014-01-19 04:55:33,802 WARN  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: /non/existent/dir/yields/warning (resolved as: /non/existent/dir/yields/warning).
   [junit4]   1> 2014-01-19 04:55:33,854 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrConfig (SolrConfig.java:<init>(170)) - Using Lucene MatchVersion: LUCENE_43
   [junit4]   1> 2014-01-19 04:55:33,954 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.Config (SolrConfig.java:<init>(288)) - Loaded SolrConfig: solrconfig.xml
   [junit4]   1> 2014-01-19 04:55:33,956 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] schema.IndexSchema (IndexSchema.java:readSchema(424)) - Reading Solr Schema from schema.xml
   [junit4]   1> 2014-01-19 04:55:34,009 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] schema.IndexSchema (IndexSchema.java:readSchema(452)) - [null] Schema name=example
   [junit4]   1> 2014-01-19 04:55:34,904 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] schema.IndexSchema (IndexSchema.java:readSchema(550)) - unique key field: id
   [junit4]   1> 2014-01-19 04:55:34,949 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] schema.FileExchangeRateProvider (CurrencyField.java:reload(787)) - Reloading exchange rates from file currency.xml
   [junit4]   1> 2014-01-19 04:55:34,962 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] schema.FileExchangeRateProvider (CurrencyField.java:reload(787)) - Reloading exchange rates from file currency.xml
   [junit4]   1> 2014-01-19 04:55:35,054 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:<init>(116)) - new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/'
   [junit4]   1> 2014-01-19 04:55:35,200 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrConfig (SolrConfig.java:initLibs(529)) - Adding specified lib dirs to ClassLoader
   [junit4]   1> 2014-01-19 04:55:35,202 WARN  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../contrib/extraction/lib (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../contrib/extraction/lib).
   [junit4]   1> 2014-01-19 04:55:35,203 WARN  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../dist).
   [junit4]   1> 2014-01-19 04:55:35,205 WARN  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../contrib/clustering/lib/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../contrib/clustering/lib).
   [junit4]   1> 2014-01-19 04:55:35,206 WARN  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../dist).
   [junit4]   1> 2014-01-19 04:55:35,208 WARN  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../contrib/langid/lib/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../contrib/langid/lib).
   [junit4]   1> 2014-01-19 04:55:35,209 WARN  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../dist).
   [junit4]   1> 2014-01-19 04:55:35,211 WARN  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../contrib/velocity/lib (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../contrib/velocity/lib).
   [junit4]   1> 2014-01-19 04:55:35,212 WARN  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../dist).
   [junit4]   1> 2014-01-19 04:55:35,213 WARN  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: /non/existent/dir/yields/warning (resolved as: /non/existent/dir/yields/warning).
   [junit4]   1> 2014-01-19 04:55:35,295 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrConfig (SolrConfig.java:<init>(170)) - Using Lucene MatchVersion: LUCENE_43
   [junit4]   1> 2014-01-19 04:55:35,391 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.Config (SolrConfig.java:<init>(288)) - Loaded SolrConfig: solrconfig.xml
   [junit4]   1> 2014-01-19 04:55:35,392 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] schema.IndexSchema (IndexSchema.java:readSchema(424)) - Reading Solr Schema from schema.xml
   [junit4]   1> 2014-01-19 04:55:35,427 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] schema.IndexSchema (IndexSchema.java:readSchema(452)) - [null] Schema name=example
   [junit4]   1> 2014-01-19 04:55:36,416 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] schema.IndexSchema (IndexSchema.java:readSchema(550)) - unique key field: id
   [junit4]   1> 2014-01-19 04:55:36,455 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] schema.FileExchangeRateProvider (CurrencyField.java:reload(787)) - Reloading exchange rates from file currency.xml
   [junit4]   1> 2014-01-19 04:55:36,467 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] schema.FileExchangeRateProvider (CurrencyField.java:reload(787)) - Reloading exchange rates from file currency.xml
   [junit4]   1> 2014-01-19 04:55:36,572 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] processor.LogUpdateProcessor (LogUpdateProcessorFactory.java:finish(198)) - [collection1] webapp=null path=/update params={} {deleteByQuery=*:* (-1457633190551224320)} 0 2
   [junit4]   1> 2014-01-19 04:55:36,573 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] update.UpdateHandler (DirectUpdateHandler2.java:commit(521)) - start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   1> 2014-01-19 04:55:36,574 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] update.UpdateHandler (DirectUpdateHandler2.java:commit(561)) - No uncommitted changes. Skipping IW.commit.
   [junit4]   1> 2014-01-19 04:55:36,575 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] search.SolrIndexSearcher (SolrIndexSearcher.java:<init>(199)) - Opening Searcher@196a6469 main
   [junit4]   1> 2014-01-19 04:55:36,576 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] update.UpdateHandler (DirectUpdateHandler2.java:commit(612)) - end_commit_flush
   [junit4]   1> 2014-01-19 04:55:36,576 INFO  [searcherExecutor-5-thread-1] core.SolrCore (QuerySenderListener.java:newSearcher(44)) - QuerySenderListener sending requests to Searcher@196a6469 main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   1> 2014-01-19 04:55:36,578 INFO  [searcherExecutor-5-thread-1] core.SolrCore (QuerySenderListener.java:newSearcher(91)) - QuerySenderListener done.
   [junit4]   1> 2014-01-19 04:55:36,579 INFO  [searcherExecutor-5-thread-1] core.SolrCore (SolrCore.java:registerSearcher(1865)) - [collection1] Registered new searcher Searcher@196a6469 main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   1> 2014-01-19 04:55:36,580 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] processor.LogUpdateProcessor (LogUpdateProcessorFactory.java:finish(198)) - [collection1] webapp=null path=/update params={commit=true&softCommit=false&waitSearcher=true} {commit=} 0 6
   [junit4]   1> 2014-01-19 04:55:37,183 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] processor.LogUpdateProcessor (LogUpdateProcessorFactory.java:finish(198)) - [collection1] webapp=null path=/update params={} {add=[testXML2.xml#0 (1457633190962266112)]} 0 222
   [junit4]   1> 2014-01-19 04:55:37,195 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] update.UpdateHandler (DirectUpdateHandler2.java:commit(521)) - start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   1> 2014-01-19 04:55:37,431 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] search.SolrIndexSearcher (SolrIndexSearcher.java:<init>(199)) - Opening Searcher@3190e33f main
   [junit4]   1> 2014-01-19 04:55:37,432 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] update.UpdateHandler (DirectUpdateHandler2.java:commit(612)) - end_commit_flush
   [junit4]   1> 2014-01-19 04:55:37,432 INFO  [searcherExecutor-5-thread-1] core.SolrCore (QuerySenderListener.java:newSearcher(44)) - QuerySenderListener sending requests to Searcher@3190e33f main{StandardDirectoryReader(segments_1:3:nrt _0(4.7):C1)}
   [junit4]   1> 2014-01-19 04:55:37,434 INFO  [searcherExecutor-5-thread-1] core.SolrCore (QuerySenderListener.java:newSearcher(91)) - QuerySenderListener done.
   [junit4]   1> 2014-01-19 04:55:37,434 INFO  [searcherExecutor-5-thread-1] core.SolrCore (SolrCore.java:registerSearcher(1865)) - [collection1] Registered new searcher Searcher@3190e33f main{StandardDirectoryReader(segments_1:3:nrt _0(4.7):C1)}
   [junit4]   1> 2014-01-19 04:55:37,435 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] processor.LogUpdateProcessor (LogUpdateProcessorFactory.java:finish(198)) - [collection1] webapp=null path=/update params={commit=true&softCommit=true&waitSearcher=true} {commit=} 0 240
   [junit4]   1> 2014-01-19 04:55:37,482 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrCore (SolrCore.java:execute(1917)) - [collection1] webapp=null path=/select params={q=*%3A*&rows=2147483647} hits=1 status=0 QTime=37 
   [junit4]   1> 2014-01-19 04:55:37,501 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] update.UpdateHandler (DirectUpdateHandler2.java:commit(521)) - start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   1> 2014-01-19 04:55:37,502 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] search.SolrIndexSearcher (SolrIndexSearcher.java:<init>(199)) - Opening Searcher@1ed1fce7 main
   [junit4]   1> 2014-01-19 04:55:37,502 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] update.UpdateHandler (DirectUpdateHandler2.java:commit(612)) - end_commit_flush
   [junit4]   1> 2014-01-19 04:55:37,502 INFO  [searcherExecutor-5-thread-1] core.SolrCore (QuerySenderListener.java:newSearcher(44)) - QuerySenderListener sending requests to Searcher@1ed1fce7 main{StandardDirectoryReader(segments_1:3:nrt _0(4.7):C1)}
   [junit4]   1> 2014-01-19 04:55:37,504 INFO  [searcherExecutor-5-thread-1] core.SolrCore (QuerySenderListener.java:newSearcher(91)) - QuerySenderListener done.
   [junit4]   1> 2014-01-19 04:55:37,504 INFO  [searcherExecutor-5-thread-1] core.SolrCore (SolrCore.java:registerSearcher(1865)) - [collection1] Registered new searcher Searcher@1ed1fce7 main{StandardDirectoryReader(segments_1:3:nrt _0(4.7):C1)}
   [junit4]   1> 2014-01-19 04:55:37,505 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] processor.LogUpdateProcessor (LogUpdateProcessorFactory.java:finish(198)) - [collection1] webapp=null path=/update params={commit=true&softCommit=true&waitSearcher=true} {commit=} 0 4
   [junit4]   1> 2014-01-19 04:55:37,506 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] core.SolrCore (SolrCore.java:execute(1917)) - [collection1] webapp=null path=/select params={q=*%3A*&rows=2147483647} hits=1 status=0 QTime=0 
   [junit4]   1> 2014-01-19 04:55:37,507 INFO  [TEST-SolrCellMorphlineTest.testSolrCellXML-seed#[472186306C3A6CA5]] solr.SolrTestCaseJ4 (SolrTestCaseJ4.java:tearDown(227)) - ###Ending testSolrCellXML
   [junit4]   1> 2014-01-19 04:55:37,537 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] solr.SolrTestCaseJ4 (SolrTestCaseJ4.java:setUp(222)) - ###Starting testSolrCellDocumentTypes2
   [junit4]   1> 2014-01-19 04:55:37,731 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] search.SolrIndexSearcher (SolrIndexSearcher.java:<init>(199)) - Opening Searcher@7d2cd3e realtime
   [junit4]   1> 2014-01-19 04:55:37,732 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] processor.LogUpdateProcessor (LogUpdateProcessorFactory.java:finish(198)) - [collection1] webapp=null path=/update params={} {deleteByQuery=*:* (-1457633191566245888)} 0 194
   [junit4]   1> 2014-01-19 04:55:37,733 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] update.UpdateHandler (DirectUpdateHandler2.java:commit(521)) - start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   1> 2014-01-19 04:55:37,734 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrCore (SolrDeletionPolicy.java:onCommit(98)) - SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   1> 	commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@77241c5e lockFactory=org.apache.lucene.store.NativeFSLockFactory@7ab57b3e),segFN=segments_1,generation=1}
   [junit4]   1> 	commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@77241c5e lockFactory=org.apache.lucene.store.NativeFSLockFactory@7ab57b3e),segFN=segments_2,generation=2}
   [junit4]   1> 2014-01-19 04:55:37,735 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrCore (SolrDeletionPolicy.java:updateCommits(165)) - newest commit generation = 2
   [junit4]   1> 2014-01-19 04:55:37,736 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] search.SolrIndexSearcher (SolrIndexSearcher.java:<init>(199)) - Opening Searcher@6ecc926e main
   [junit4]   1> 2014-01-19 04:55:37,736 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] update.UpdateHandler (DirectUpdateHandler2.java:commit(612)) - end_commit_flush
   [junit4]   1> 2014-01-19 04:55:37,737 INFO  [searcherExecutor-5-thread-1] core.SolrCore (QuerySenderListener.java:newSearcher(44)) - QuerySenderListener sending requests to Searcher@6ecc926e main{StandardDirectoryReader(segments_1:5:nrt)}
   [junit4]   1> 2014-01-19 04:55:37,738 INFO  [searcherExecutor-5-thread-1] core.SolrCore (QuerySenderListener.java:newSearcher(91)) - QuerySenderListener done.
   [junit4]   1> 2014-01-19 04:55:37,739 INFO  [searcherExecutor-5-thread-1] core.SolrCore (SolrCore.java:registerSearcher(1865)) - [collection1] Registered new searcher Searcher@6ecc926e main{StandardDirectoryReader(segments_1:5:nrt)}
   [junit4]   1> 2014-01-19 04:55:37,740 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] processor.LogUpdateProcessor (LogUpdateProcessorFactory.java:finish(198)) - [collection1] webapp=null path=/update params={commit=true&softCommit=false&waitSearcher=true} {commit=} 0 7
   [junit4]   1> 2014-01-19 04:55:37,777 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] api.MorphlineContext (MorphlineContext.java:importCommandBuilders(75)) - Importing commands
   [junit4]   1> 2014-01-19 04:55:46,830 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:<init>(116)) - new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/'
   [junit4]   1> 2014-01-19 04:55:46,928 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrConfig (SolrConfig.java:initLibs(529)) - Adding specified lib dirs to ClassLoader
   [junit4]   1> 2014-01-19 04:55:46,930 WARN  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../contrib/extraction/lib (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../contrib/extraction/lib).
   [junit4]   1> 2014-01-19 04:55:46,932 WARN  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../dist).
   [junit4]   1> 2014-01-19 04:55:46,933 WARN  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../contrib/clustering/lib/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../contrib/clustering/lib).
   [junit4]   1> 2014-01-19 04:55:46,935 WARN  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../dist).
   [junit4]   1> 2014-01-19 04:55:46,937 WARN  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../contrib/langid/lib/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../contrib/langid/lib).
   [junit4]   1> 2014-01-19 04:55:46,938 WARN  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../dist).
   [junit4]   1> 2014-01-19 04:55:46,941 WARN  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../contrib/velocity/lib (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../contrib/velocity/lib).
   [junit4]   1> 2014-01-19 04:55:46,942 WARN  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../dist).
   [junit4]   1> 2014-01-19 04:55:46,944 WARN  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: /non/existent/dir/yields/warning (resolved as: /non/existent/dir/yields/warning).
   [junit4]   1> 2014-01-19 04:55:46,999 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrConfig (SolrConfig.java:<init>(170)) - Using Lucene MatchVersion: LUCENE_43
   [junit4]   1> 2014-01-19 04:55:47,114 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.Config (SolrConfig.java:<init>(288)) - Loaded SolrConfig: solrconfig.xml
   [junit4]   1> 2014-01-19 04:55:47,116 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] schema.IndexSchema (IndexSchema.java:readSchema(424)) - Reading Solr Schema from schema.xml
   [junit4]   1> 2014-01-19 04:55:47,149 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] schema.IndexSchema (IndexSchema.java:readSchema(452)) - [null] Schema name=example
   [junit4]   1> 2014-01-19 04:55:47,962 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] schema.IndexSchema (IndexSchema.java:readSchema(550)) - unique key field: id
   [junit4]   1> 2014-01-19 04:55:48,004 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] schema.FileExchangeRateProvider (CurrencyField.java:reload(787)) - Reloading exchange rates from file currency.xml
   [junit4]   1> 2014-01-19 04:55:48,016 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] schema.FileExchangeRateProvider (CurrencyField.java:reload(787)) - Reloading exchange rates from file currency.xml
   [junit4]   1> 2014-01-19 04:55:48,121 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:<init>(116)) - new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/'
   [junit4]   1> 2014-01-19 04:55:48,275 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrConfig (SolrConfig.java:initLibs(529)) - Adding specified lib dirs to ClassLoader
   [junit4]   1> 2014-01-19 04:55:48,278 WARN  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../contrib/extraction/lib (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../contrib/extraction/lib).
   [junit4]   1> 2014-01-19 04:55:48,280 WARN  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../dist).
   [junit4]   1> 2014-01-19 04:55:48,282 WARN  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../contrib/clustering/lib/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../contrib/clustering/lib).
   [junit4]   1> 2014-01-19 04:55:48,283 WARN  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../dist).
   [junit4]   1> 2014-01-19 04:55:48,285 WARN  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../contrib/langid/lib/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../contrib/langid/lib).
   [junit4]   1> 2014-01-19 04:55:48,287 WARN  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../dist).
   [junit4]   1> 2014-01-19 04:55:48,289 WARN  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../contrib/velocity/lib (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../contrib/velocity/lib).
   [junit4]   1> 2014-01-19 04:55:48,290 WARN  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../dist).
   [junit4]   1> 2014-01-19 04:55:48,291 WARN  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: /non/existent/dir/yields/warning (resolved as: /non/existent/dir/yields/warning).
   [junit4]   1> 2014-01-19 04:55:48,343 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrConfig (SolrConfig.java:<init>(170)) - Using Lucene MatchVersion: LUCENE_43
   [junit4]   1> 2014-01-19 04:55:48,445 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.Config (SolrConfig.java:<init>(288)) - Loaded SolrConfig: solrconfig.xml
   [junit4]   1> 2014-01-19 04:55:48,446 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] schema.IndexSchema (IndexSchema.java:readSchema(424)) - Reading Solr Schema from schema.xml
   [junit4]   1> 2014-01-19 04:55:48,469 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] schema.IndexSchema (IndexSchema.java:readSchema(452)) - [null] Schema name=example
   [junit4]   1> 2014-01-19 04:55:49,154 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] schema.IndexSchema (IndexSchema.java:readSchema(550)) - unique key field: id
   [junit4]   1> 2014-01-19 04:55:49,180 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] schema.FileExchangeRateProvider (CurrencyField.java:reload(787)) - Reloading exchange rates from file currency.xml
   [junit4]   1> 2014-01-19 04:55:49,187 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] schema.FileExchangeRateProvider (CurrencyField.java:reload(787)) - Reloading exchange rates from file currency.xml
   [junit4]   1> 2014-01-19 04:55:52,142 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:<init>(116)) - new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/'
   [junit4]   1> 2014-01-19 04:55:52,227 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrConfig (SolrConfig.java:initLibs(529)) - Adding specified lib dirs to ClassLoader
   [junit4]   1> 2014-01-19 04:55:52,228 WARN  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../contrib/extraction/lib (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../contrib/extraction/lib).
   [junit4]   1> 2014-01-19 04:55:52,229 WARN  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../dist).
   [junit4]   1> 2014-01-19 04:55:52,230 WARN  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../contrib/clustering/lib/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../contrib/clustering/lib).
   [junit4]   1> 2014-01-19 04:55:52,231 WARN  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../dist).
   [junit4]   1> 2014-01-19 04:55:52,232 WARN  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../contrib/langid/lib/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../contrib/langid/lib).
   [junit4]   1> 2014-01-19 04:55:52,233 WARN  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../dist).
   [junit4]   1> 2014-01-19 04:55:52,234 WARN  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../contrib/velocity/lib (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../contrib/velocity/lib).
   [junit4]   1> 2014-01-19 04:55:52,235 WARN  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../dist).
   [junit4]   1> 2014-01-19 04:55:52,235 WARN  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: /non/existent/dir/yields/warning (resolved as: /non/existent/dir/yields/warning).
   [junit4]   1> 2014-01-19 04:55:52,298 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrConfig (SolrConfig.java:<init>(170)) - Using Lucene MatchVersion: LUCENE_43
   [junit4]   1> 2014-01-19 04:55:52,412 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.Config (SolrConfig.java:<init>(288)) - Loaded SolrConfig: solrconfig.xml
   [junit4]   1> 2014-01-19 04:55:52,414 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] schema.IndexSchema (IndexSchema.java:readSchema(424)) - Reading Solr Schema from schema.xml
   [junit4]   1> 2014-01-19 04:55:52,445 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] schema.IndexSchema (IndexSchema.java:readSchema(452)) - [null] Schema name=example
   [junit4]   1> 2014-01-19 04:55:53,226 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] schema.IndexSchema (IndexSchema.java:readSchema(550)) - unique key field: id
   [junit4]   1> 2014-01-19 04:55:53,251 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] schema.FileExchangeRateProvider (CurrencyField.java:reload(787)) - Reloading exchange rates from file currency.xml
   [junit4]   1> 2014-01-19 04:55:53,258 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] schema.FileExchangeRateProvider (CurrencyField.java:reload(787)) - Reloading exchange rates from file currency.xml
   [junit4]   1> 2014-01-19 04:55:53,290 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:<init>(116)) - new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/'
   [junit4]   1> 2014-01-19 04:55:53,370 INFO  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrConfig (SolrConfig.java:initLibs(529)) - Adding specified lib dirs to ClassLoader
   [junit4]   1> 2014-01-19 04:55:53,372 WARN  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../contrib/extraction/lib (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../contrib/extraction/lib).
   [junit4]   1> 2014-01-19 04:55:53,373 WARN  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../dist).
   [junit4]   1> 2014-01-19 04:55:53,374 WARN  [TEST-SolrCellMorphlineTest.testSolrCellDocumentTypes2-seed#[472186306C3A6CA5]] core.SolrResourceLoader (SolrResourceLoader.java:addToClassLoader(170)) - Can't find (or read) directory to add to classloader: ../../../contrib/clustering/lib/ (resolved as: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/contrib/map-reduce/src/test-files/solr/collection1/../../../contrib/clustering/lib).
   [junit4]  

[...truncated too long message...]

ecutor-5-thread-1] core.SolrCore (SolrCore.java:registerSearcher(1865)) - [collection1] Registered new searcher Searcher@3f967d9f main{StandardDirectoryReader(segments_4:29:nrt _8(4.7):C1 _9(4.7):C1 _a(4.7):C1)}
   [junit4]   1> 2014-01-19 04:56:22,721 INFO  [TEST-SolrCellMorphlineTest.testSolrCellJPGCompressed-seed#[472186306C3A6CA5]] processor.LogUpdateProcessor (LogUpdateProcessorFactory.java:finish(198)) - [collection1] webapp=null path=/update params={commit=true&softCommit=true&waitSearcher=true} {commit=} 0 9
   [junit4]   1> 2014-01-19 04:56:22,723 INFO  [TEST-SolrCellMorphlineTest.testSolrCellJPGCompressed-seed#[472186306C3A6CA5]] core.SolrCore (SolrCore.java:execute(1917)) - [collection1] webapp=null path=/select params={q=*%3A*&rows=2147483647} hits=3 status=0 QTime=1 
   [junit4]   1> 2014-01-19 04:56:22,724 INFO  [TEST-SolrCellMorphlineTest.testSolrCellJPGCompressed-seed#[472186306C3A6CA5]] update.UpdateHandler (DirectUpdateHandler2.java:commit(521)) - start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   1> 2014-01-19 04:56:22,725 INFO  [TEST-SolrCellMorphlineTest.testSolrCellJPGCompressed-seed#[472186306C3A6CA5]] search.SolrIndexSearcher (SolrIndexSearcher.java:<init>(199)) - Opening Searcher@1fac6d04 main
   [junit4]   1> 2014-01-19 04:56:22,726 INFO  [TEST-SolrCellMorphlineTest.testSolrCellJPGCompressed-seed#[472186306C3A6CA5]] update.UpdateHandler (DirectUpdateHandler2.java:commit(612)) - end_commit_flush
   [junit4]   1> 2014-01-19 04:56:22,726 INFO  [searcherExecutor-5-thread-1] core.SolrCore (QuerySenderListener.java:newSearcher(44)) - QuerySenderListener sending requests to Searcher@1fac6d04 main{StandardDirectoryReader(segments_4:29:nrt _8(4.7):C1 _9(4.7):C1 _a(4.7):C1)}
   [junit4]   1> 2014-01-19 04:56:22,727 INFO  [searcherExecutor-5-thread-1] core.SolrCore (QuerySenderListener.java:newSearcher(91)) - QuerySenderListener done.
   [junit4]   1> 2014-01-19 04:56:22,728 INFO  [searcherExecutor-5-thread-1] core.SolrCore (SolrCore.java:registerSearcher(1865)) - [collection1] Registered new searcher Searcher@1fac6d04 main{StandardDirectoryReader(segments_4:29:nrt _8(4.7):C1 _9(4.7):C1 _a(4.7):C1)}
   [junit4]   1> 2014-01-19 04:56:22,729 INFO  [TEST-SolrCellMorphlineTest.testSolrCellJPGCompressed-seed#[472186306C3A6CA5]] processor.LogUpdateProcessor (LogUpdateProcessorFactory.java:finish(198)) - [collection1] webapp=null path=/update params={commit=true&softCommit=true&waitSearcher=true} {commit=} 0 5
   [junit4]   1> 2014-01-19 04:56:22,730 INFO  [TEST-SolrCellMorphlineTest.testSolrCellJPGCompressed-seed#[472186306C3A6CA5]] core.SolrCore (SolrCore.java:execute(1917)) - [collection1] webapp=null path=/select params={q=*%3A*&rows=2147483647} hits=3 status=0 QTime=0 
   [junit4]   1> 2014-01-19 04:56:22,731 INFO  [TEST-SolrCellMorphlineTest.testSolrCellJPGCompressed-seed#[472186306C3A6CA5]] solr.SolrTestCaseJ4 (SolrTestCaseJ4.java:tearDown(227)) - ###Ending testSolrCellJPGCompressed
   [junit4]   1> 2014-01-19 04:56:22,737 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] solr.SolrTestCaseJ4 (SolrTestCaseJ4.java:deleteCore(543)) - ###deleteCore
   [junit4]   1> 2014-01-19 04:56:22,738 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] core.CoreContainer (CoreContainer.java:shutdown(360)) - Shutting down CoreContainer instance=533248865
   [junit4]   1> 2014-01-19 04:56:22,738 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] core.SolrCore (SolrCore.java:close(1000)) - [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@7baf2b1
   [junit4]   1> 2014-01-19 04:56:22,742 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] update.UpdateHandler (DirectUpdateHandler2.java:close(687)) - closing DirectUpdateHandler2{commits=22,autocommit maxTime=60000ms,autocommits=0,soft autocommit maxTime=1000ms,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=3,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=11,cumulative_deletesById=0,cumulative_deletesByQuery=9,cumulative_errors=0,transaction_logs_total_size=21931,transaction_logs_total_number=9}
   [junit4]   1> 2014-01-19 04:56:22,743 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] update.SolrCoreState (SolrCoreState.java:decrefSolrCoreState(71)) - Closing SolrCoreState
   [junit4]   1> 2014-01-19 04:56:22,744 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] update.DefaultSolrCoreState (DefaultSolrCoreState.java:closeIndexWriter(65)) - SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   1> 2014-01-19 04:56:22,745 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] update.DefaultSolrCoreState (DefaultSolrCoreState.java:closeIndexWriter(67)) - closing IndexWriter with IndexWriterCloser
   [junit4]   1> 2014-01-19 04:56:22,759 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] core.SolrCore (SolrDeletionPolicy.java:onCommit(98)) - SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   1> 	commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@77241c5e lockFactory=org.apache.lucene.store.NativeFSLockFactory@7ab57b3e),segFN=segments_4,generation=4}
   [junit4]   1> 	commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@77241c5e lockFactory=org.apache.lucene.store.NativeFSLockFactory@7ab57b3e),segFN=segments_5,generation=5}
   [junit4]   1> 2014-01-19 04:56:22,760 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] core.SolrCore (SolrDeletionPolicy.java:updateCommits(165)) - newest commit generation = 5
   [junit4]   1> 2014-01-19 04:56:22,763 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] core.SolrCore (SolrCore.java:closeSearcher(1882)) - [collection1] Closing main searcher on request.
   [junit4]   1> 2014-01-19 04:56:22,765 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] core.CachingDirectoryFactory (CachingDirectoryFactory.java:close(168)) - Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   1> 2014-01-19 04:56:22,766 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] core.CachingDirectoryFactory (CachingDirectoryFactory.java:closeCacheValue(235)) - looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/contrib/solr-morphlines-cell/test/J0/./solrtest-SolrCellMorphlineTest-1390107311181 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/contrib/solr-morphlines-cell/test/J0/./solrtest-SolrCellMorphlineTest-1390107311181;done=false>>]
   [junit4]   1> 2014-01-19 04:56:22,767 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] core.CachingDirectoryFactory (CachingDirectoryFactory.java:close(304)) - Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/contrib/solr-morphlines-cell/test/J0/./solrtest-SolrCellMorphlineTest-1390107311181
   [junit4]   1> 2014-01-19 04:56:22,767 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] core.CachingDirectoryFactory (CachingDirectoryFactory.java:closeCacheValue(235)) - looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/contrib/solr-morphlines-cell/test/J0/./solrtest-SolrCellMorphlineTest-1390107311181/index [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/contrib/solr-morphlines-cell/test/J0/./solrtest-SolrCellMorphlineTest-1390107311181/index;done=false>>]
   [junit4]   1> 2014-01-19 04:56:22,768 INFO  [SUITE-SolrCellMorphlineTest-seed#[472186306C3A6CA5]-worker] core.CachingDirectoryFactory (CachingDirectoryFactory.java:close(304)) - Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/contrib/solr-morphlines-cell/test/J0/./solrtest-SolrCellMorphlineTest-1390107311181/index
   [junit4]   2> NOTE: test params are: codec=Lucene46: {}, docValues:{}, sim=DefaultSimilarity, locale=hi_IN, timezone=Pacific/Pago_Pago
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_25 (64-bit)/cpus=16,threads=1,free=54581440,total=106954752
   [junit4]   2> NOTE: All tests run in this JVM: [SolrCellMorphlineTest]
   [junit4] Completed in 75.20s, 5 tests, 2 failures <<< FAILURES!

[...truncated 10 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:459: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:439: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:209: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:441: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:491: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1308: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:941: There were test failures: 1 suite, 5 tests, 2 failures

Total time: 91 minutes 56 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 1867 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/1867/

1 tests failed.
REGRESSION:  org.apache.solr.cloud.OverseerTest.testOverseerFailure

Error Message:
KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1

Stack Trace:
org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
	at __randomizedtesting.SeedInfo.seed([54CEF8CD15CA6948:50C6773E076F8669]:0)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
	at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
	at org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:428)
	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:425)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:382)
	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:369)
	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:112)
	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:156)
	at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:289)
	at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:153)
	at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:584)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:724)




Build Log:
[...truncated 10498 lines...]
   [junit4] Suite: org.apache.solr.cloud.OverseerTest
   [junit4]   2> 2046503 T2854 oas.SolrTestCaseJ4.initCore ####initCore
   [junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-OverseerTest-1390037940600
   [junit4]   2> 2046504 T2854 oas.SolrTestCaseJ4.initCore ####initCore end
   [junit4]   2> 2046507 T2854 oas.SolrTestCaseJ4.setUp ###Starting testShardAssignmentBigger
   [junit4]   2> 2046507 T2854 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 2046508 T2855 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 2046609 T2854 oasc.ZkTestServer.run start zk server on port:40318
   [junit4]   2> 2046610 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046615 T2861 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7f201b7e name:ZooKeeperConnection Watcher:127.0.0.1:40318 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046615 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046617 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046632 T2863 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@36f7de68 name:ZooKeeperConnection Watcher:127.0.0.1:40318 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046633 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046633 T2854 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 2046637 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046638 T2865 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@693e6505 name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046638 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046639 T2854 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 2046641 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046642 T2867 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7060a5ad name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046642 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046643 T2854 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 2046645 T2854 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 2046648 T2854 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 2046650 T2854 oasc.Overseer.start Overseer (id=91097526475816963-127.0.0.1:40318_solr-n_0000000000) starting
   [junit4]   2> 2046651 T2854 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 2046654 T2854 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 2046656 T2854 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 2046658 T2869 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 2046659 T2854 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 2046659 T2868 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 2046659 T2869 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
   [junit4]   2> 2046660 T2854 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 2046662 T2854 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2046664 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046666 T2871 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@551420ce name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046666 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046667 T2854 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2046669 T2854 oascc.SolrZkClient.makePath makePath: /live_nodes/node0
   [junit4]   2> 2046671 T2871 oascc.ZkStateReader$3.process Updating live nodes... (1)
   [junit4]   2> 2046671 T2865 oascc.ZkStateReader$3.process Updating live nodes... (1)
   [junit4]   2> 2046671 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046673 T2873 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@56d93bdd name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046673 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046674 T2854 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2046676 T2854 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
   [junit4]   2> 2046678 T2871 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 2046678 T2865 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 2046678 T2873 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 2046678 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046679 T2875 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@69487417 name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046680 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046681 T2854 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2046682 T2854 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
   [junit4]   2> 2046684 T2865 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 2046685 T2875 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 2046685 T2871 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 2046685 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046685 T2873 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 2046686 T2877 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@608570bb name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046686 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046687 T2854 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2046689 T2854 oascc.SolrZkClient.makePath makePath: /live_nodes/node3
   [junit4]   2> 2046692 T2871 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 2046692 T2865 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 2046692 T2877 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 2046692 T2873 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 2046692 T2875 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 2046692 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046693 T2879 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@63dd2498 name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046694 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046695 T2854 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2046696 T2854 oascc.SolrZkClient.makePath makePath: /live_nodes/node4
   [junit4]   2> 2046698 T2875 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 2046698 T2873 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 2046698 T2879 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 2046699 T2865 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 2046698 T2877 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 2046698 T2871 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 2046699 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046700 T2881 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@795afcea name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046700 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046701 T2854 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2046703 T2854 oascc.SolrZkClient.makePath makePath: /live_nodes/node5
   [junit4]   2> 2046705 T2879 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 2046705 T2871 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 2046705 T2865 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 2046705 T2873 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 2046705 T2877 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 2046706 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046705 T2875 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 2046705 T2881 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 2046707 T2883 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a91fab4 name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046707 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046708 T2854 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2046710 T2854 oascc.SolrZkClient.makePath makePath: /live_nodes/node6
   [junit4]   2> 2046712 T2875 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 2046713 T2865 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 2046713 T2877 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 2046713 T2883 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 2046713 T2873 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 2046713 T2879 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 2046712 T2881 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 2046712 T2871 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 2046713 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046714 T2885 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@92cf1f4 name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046715 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046716 T2854 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2046717 T2854 oascc.SolrZkClient.makePath makePath: /live_nodes/node7
   [junit4]   2> 2046720 T2877 oascc.ZkStateReader$3.process Updating live nodes... (8)
   [junit4]   2> 2046720 T2875 oascc.ZkStateReader$3.process Updating live nodes... (8)
   [junit4]   2> 2046720 T2881 oascc.ZkStateReader$3.process Updating live nodes... (8)
   [junit4]   2> 2046720 T2883 oascc.ZkStateReader$3.process Updating live nodes... (8)
   [junit4]   2> 2046720 T2879 oascc.ZkStateReader$3.process Updating live nodes... (8)
   [junit4]   2> 2046720 T2871 oascc.ZkStateReader$3.process Updating live nodes... (8)
   [junit4]   2> 2046720 T2873 oascc.ZkStateReader$3.process Updating live nodes... (8)
   [junit4]   2> 2046720 T2885 oascc.ZkStateReader$3.process Updating live nodes... (8)
   [junit4]   2> 2046720 T2865 oascc.ZkStateReader$3.process Updating live nodes... (8)
   [junit4]   2> 2046720 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046722 T2887 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@57361e7f name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046722 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046723 T2854 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2046724 T2854 oascc.SolrZkClient.makePath makePath: /live_nodes/node8
   [junit4]   2> 2046727 T2877 oascc.ZkStateReader$3.process Updating live nodes... (9)
   [junit4]   2> 2046727 T2885 oascc.ZkStateReader$3.process Updating live nodes... (9)
   [junit4]   2> 2046727 T2873 oascc.ZkStateReader$3.process Updating live nodes... (9)
   [junit4]   2> 2046727 T2865 oascc.ZkStateReader$3.process Updating live nodes... (9)
   [junit4]   2> 2046727 T2871 oascc.ZkStateReader$3.process Updating live nodes... (9)
   [junit4]   2> 2046728 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046727 T2883 oascc.ZkStateReader$3.process Updating live nodes... (9)
   [junit4]   2> 2046727 T2887 oascc.ZkStateReader$3.process Updating live nodes... (9)
   [junit4]   2> 2046727 T2881 oascc.ZkStateReader$3.process Updating live nodes... (9)
   [junit4]   2> 2046727 T2875 oascc.ZkStateReader$3.process Updating live nodes... (9)
   [junit4]   2> 2046727 T2879 oascc.ZkStateReader$3.process Updating live nodes... (9)
   [junit4]   2> 2046729 T2889 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@76a0c450 name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046729 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046730 T2854 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2046732 T2854 oascc.SolrZkClient.makePath makePath: /live_nodes/node9
   [junit4]   2> 2046734 T2865 oascc.ZkStateReader$3.process Updating live nodes... (10)
   [junit4]   2> 2046734 T2875 oascc.ZkStateReader$3.process Updating live nodes... (10)
   [junit4]   2> 2046735 T2883 oascc.ZkStateReader$3.process Updating live nodes... (10)
   [junit4]   2> 2046735 T2881 oascc.ZkStateReader$3.process Updating live nodes... (10)
   [junit4]   2> 2046735 T2873 oascc.ZkStateReader$3.process Updating live nodes... (10)
   [junit4]   2> 2046735 T2889 oascc.ZkStateReader$3.process Updating live nodes... (10)
   [junit4]   2> 2046734 T2879 oascc.ZkStateReader$3.process Updating live nodes... (10)
   [junit4]   2> 2046734 T2887 oascc.ZkStateReader$3.process Updating live nodes... (10)
   [junit4]   2> 2046734 T2885 oascc.ZkStateReader$3.process Updating live nodes... (10)
   [junit4]   2> 2046734 T2871 oascc.ZkStateReader$3.process Updating live nodes... (10)
   [junit4]   2> 2046734 T2877 oascc.ZkStateReader$3.process Updating live nodes... (10)
   [junit4]   2> 2046735 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046736 T2891 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@444be146 name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046737 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046737 T2854 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2046739 T2854 oascc.SolrZkClient.makePath makePath: /live_nodes/node10
   [junit4]   2> 2046742 T2875 oascc.ZkStateReader$3.process Updating live nodes... (11)
   [junit4]   2> 2046742 T2891 oascc.ZkStateReader$3.process Updating live nodes... (11)
   [junit4]   2> 2046742 T2871 oascc.ZkStateReader$3.process Updating live nodes... (11)
   [junit4]   2> 2046742 T2873 oascc.ZkStateReader$3.process Updating live nodes... (11)
   [junit4]   2> 2046742 T2879 oascc.ZkStateReader$3.process Updating live nodes... (11)
   [junit4]   2> 2046742 T2877 oascc.ZkStateReader$3.process Updating live nodes... (11)
   [junit4]   2> 2046742 T2885 oascc.ZkStateReader$3.process Updating live nodes... (11)
   [junit4]   2> 2046742 T2887 oascc.ZkStateReader$3.process Updating live nodes... (11)
   [junit4]   2> 2046742 T2889 oascc.ZkStateReader$3.process Updating live nodes... (11)
   [junit4]   2> 2046742 T2865 oascc.ZkStateReader$3.process Updating live nodes... (11)
   [junit4]   2> 2046743 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046742 T2883 oascc.ZkStateReader$3.process Updating live nodes... (11)
   [junit4]   2> 2046742 T2881 oascc.ZkStateReader$3.process Updating live nodes... (11)
   [junit4]   2> 2046744 T2893 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@70e80c34 name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046745 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046746 T2854 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2046747 T2854 oascc.SolrZkClient.makePath makePath: /live_nodes/node11
   [junit4]   2> 2046750 T2877 oascc.ZkStateReader$3.process Updating live nodes... (12)
   [junit4]   2> 2046750 T2891 oascc.ZkStateReader$3.process Updating live nodes... (12)
   [junit4]   2> 2046750 T2887 oascc.ZkStateReader$3.process Updating live nodes... (12)
   [junit4]   2> 2046751 T2889 oascc.ZkStateReader$3.process Updating live nodes... (12)
   [junit4]   2> 2046751 T2873 oascc.ZkStateReader$3.process Updating live nodes... (12)
   [junit4]   2> 2046750 T2871 oascc.ZkStateReader$3.process Updating live nodes... (12)
   [junit4]   2> 2046750 T2865 oascc.ZkStateReader$3.process Updating live nodes... (12)
   [junit4]   2> 2046750 T2883 oascc.ZkStateReader$3.process Updating live nodes... (12)
   [junit4]   2> 2046750 T2893 oascc.ZkStateReader$3.process Updating live nodes... (12)
   [junit4]   2> 2046750 T2879 oascc.ZkStateReader$3.process Updating live nodes... (12)
   [junit4]   2> 2046750 T2885 oascc.ZkStateReader$3.process Updating live nodes... (12)
   [junit4]   2> 2046750 T2875 oascc.ZkStateReader$3.process Updating live nodes... (12)
   [junit4]   2> 2046751 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046753 T2895 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@68c6c3c name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046751 T2881 oascc.ZkStateReader$3.process Updating live nodes... (12)
   [junit4]   2> 2046753 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046754 T2854 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2046756 T2854 oascc.SolrZkClient.makePath makePath: /live_nodes/node12
   [junit4]   2> 2046759 T2893 oascc.ZkStateReader$3.process Updating live nodes... (13)
   [junit4]   2> 2046759 T2895 oascc.ZkStateReader$3.process Updating live nodes... (13)
   [junit4]   2> 2046759 T2887 oascc.ZkStateReader$3.process Updating live nodes... (13)
   [junit4]   2> 2046759 T2883 oascc.ZkStateReader$3.process Updating live nodes... (13)
   [junit4]   2> 2046760 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046759 T2891 oascc.ZkStateReader$3.process Updating live nodes... (13)
   [junit4]   2> 2046759 T2877 oascc.ZkStateReader$3.process Updating live nodes... (13)
   [junit4]   2> 2046759 T2865 oascc.ZkStateReader$3.process Updating live nodes... (13)
   [junit4]   2> 2046759 T2875 oascc.ZkStateReader$3.process Updating live nodes... (13)
   [junit4]   2> 2046759 T2879 oascc.ZkStateReader$3.process Updating live nodes... (13)
   [junit4]   2> 2046759 T2881 oascc.ZkStateReader$3.process Updating live nodes... (13)
   [junit4]   2> 2046759 T2871 oascc.ZkStateReader$3.process Updating live nodes... (13)
   [junit4]   2> 2046759 T2873 oascc.ZkStateReader$3.process Updating live nodes... (13)
   [junit4]   2> 2046759 T2885 oascc.ZkStateReader$3.process Updating live nodes... (13)
   [junit4]   2> 2046759 T2889 oascc.ZkStateReader$3.process Updating live nodes... (13)
   [junit4]   2> 2046761 T2897 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@61298e41 name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046762 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046763 T2854 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2046764 T2854 oascc.SolrZkClient.makePath makePath: /live_nodes/node13
   [junit4]   2> 2046767 T2887 oascc.ZkStateReader$3.process Updating live nodes... (14)
   [junit4]   2> 2046767 T2893 oascc.ZkStateReader$3.process Updating live nodes... (14)
   [junit4]   2> 2046768 T2895 oascc.ZkStateReader$3.process Updating live nodes... (14)
   [junit4]   2> 2046768 T2883 oascc.ZkStateReader$3.process Updating live nodes... (14)
   [junit4]   2> 2046768 T2891 oascc.ZkStateReader$3.process Updating live nodes... (14)
   [junit4]   2> 2046768 T2865 oascc.ZkStateReader$3.process Updating live nodes... (14)
   [junit4]   2> 2046768 T2873 oascc.ZkStateReader$3.process Updating live nodes... (14)
   [junit4]   2> 2046768 T2871 oascc.ZkStateReader$3.process Updating live nodes... (14)
   [junit4]   2> 2046767 T2897 oascc.ZkStateReader$3.process Updating live nodes... (14)
   [junit4]   2> 2046767 T2881 oascc.ZkStateReader$3.process Updating live nodes... (14)
   [junit4]   2> 2046767 T2875 oascc.ZkStateReader$3.process Updating live nodes... (14)
   [junit4]   2> 2046767 T2877 oascc.ZkStateReader$3.process Updating live nodes... (14)
   [junit4]   2> 2046767 T2879 oascc.ZkStateReader$3.process Updating live nodes... (14)
   [junit4]   2> 2046767 T2885 oascc.ZkStateReader$3.process Updating live nodes... (14)
   [junit4]   2> 2046767 T2889 oascc.ZkStateReader$3.process Updating live nodes... (14)
   [junit4]   2> 2046770 T2899 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@31bfd0fb name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046768 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046770 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046771 T2854 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2046773 T2854 oascc.SolrZkClient.makePath makePath: /live_nodes/node14
   [junit4]   2> 2046776 T2891 oascc.ZkStateReader$3.process Updating live nodes... (15)
   [junit4]   2> 2046776 T2873 oascc.ZkStateReader$3.process Updating live nodes... (15)
   [junit4]   2> 2046776 T2865 oascc.ZkStateReader$3.process Updating live nodes... (15)
   [junit4]   2> 2046777 T2895 oascc.ZkStateReader$3.process Updating live nodes... (15)
   [junit4]   2> 2046777 T2881 oascc.ZkStateReader$3.process Updating live nodes... (15)
   [junit4]   2> 2046776 T2877 oascc.ZkStateReader$3.process Updating live nodes... (15)
   [junit4]   2> 2046777 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046776 T2885 oascc.ZkStateReader$3.process Updating live nodes... (15)
   [junit4]   2> 2046776 T2899 oascc.ZkStateReader$3.process Updating live nodes... (15)
   [junit4]   2> 2046777 T2887 oascc.ZkStateReader$3.process Updating live nodes... (15)
   [junit4]   2> 2046777 T2889 oascc.ZkStateReader$3.process Updating live nodes... (15)
   [junit4]   2> 2046777 T2871 oascc.ZkStateReader$3.process Updating live nodes... (15)
   [junit4]   2> 2046777 T2879 oascc.ZkStateReader$3.process Updating live nodes... (15)
   [junit4]   2> 2046777 T2897 oascc.ZkStateReader$3.process Updating live nodes... (15)
   [junit4]   2> 2046776 T2875 oascc.ZkStateReader$3.process Updating live nodes... (15)
   [junit4]   2> 2046776 T2893 oascc.ZkStateReader$3.process Updating live nodes... (15)
   [junit4]   2> 2046776 T2883 oascc.ZkStateReader$3.process Updating live nodes... (15)
   [junit4]   2> 2046779 T2901 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@64d3e074 name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046780 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046780 T2854 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2046782 T2854 oascc.SolrZkClient.makePath makePath: /live_nodes/node15
   [junit4]   2> 2046785 T2889 oascc.ZkStateReader$3.process Updating live nodes... (16)
   [junit4]   2> 2046785 T2899 oascc.ZkStateReader$3.process Updating live nodes... (16)
   [junit4]   2> 2046786 T2873 oascc.ZkStateReader$3.process Updating live nodes... (16)
   [junit4]   2> 2046786 T2901 oascc.ZkStateReader$3.process Updating live nodes... (16)
   [junit4]   2> 2046786 T2881 oascc.ZkStateReader$3.process Updating live nodes... (16)
   [junit4]   2> 2046786 T2875 oascc.ZkStateReader$3.process Updating live nodes... (16)
   [junit4]   2> 2046786 T2871 oascc.ZkStateReader$3.process Updating live nodes... (16)
   [junit4]   2> 2046786 T2897 oascc.ZkStateReader$3.process Updating live nodes... (16)
   [junit4]   2> 2046786 T2865 oascc.ZkStateReader$3.process Updating live nodes... (16)
   [junit4]   2> 2046786 T2891 oascc.ZkStateReader$3.process Updating live nodes... (16)
   [junit4]   2> 2046785 T2879 oascc.ZkStateReader$3.process Updating live nodes... (16)
   [junit4]   2> 2046785 T2895 oascc.ZkStateReader$3.process Updating live nodes... (16)
   [junit4]   2> 2046785 T2885 oascc.ZkStateReader$3.process Updating live nodes... (16)
   [junit4]   2> 2046785 T2877 oascc.ZkStateReader$3.process Updating live nodes... (16)
   [junit4]   2> 2046788 T2903 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@63010413 name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046785 T2893 oascc.ZkStateReader$3.process Updating live nodes... (16)
   [junit4]   2> 2046786 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046786 T2883 oascc.ZkStateReader$3.process Updating live nodes... (16)
   [junit4]   2> 2046786 T2887 oascc.ZkStateReader$3.process Updating live nodes... (16)
   [junit4]   2> 2046788 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046790 T2854 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2046791 T2854 oascc.SolrZkClient.makePath makePath: /live_nodes/node16
   [junit4]   2> 2046795 T2877 oascc.ZkStateReader$3.process Updating live nodes... (17)
   [junit4]   2> 2046795 T2873 oascc.ZkStateReader$3.process Updating live nodes... (17)
   [junit4]   2> 2046795 T2871 oascc.ZkStateReader$3.process Updating live nodes... (17)
   [junit4]   2> 2046795 T2875 oascc.ZkStateReader$3.process Updating live nodes... (17)
   [junit4]   2> 2046795 T2879 oascc.ZkStateReader$3.process Updating live nodes... (17)
   [junit4]   2> 2046795 T2903 oascc.ZkStateReader$3.process Updating live nodes... (17)
   [junit4]   2> 2046795 T2891 oascc.ZkStateReader$3.process Updating live nodes... (17)
   [junit4]   2> 2046796 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046795 T2887 oascc.ZkStateReader$3.process Updating live nodes... (17)
   [junit4]   2> 2046795 T2897 oascc.ZkStateReader$3.process Updating live nodes... (17)
   [junit4]   2> 2046795 T2885 oascc.ZkStateReader$3.process Updating live nodes... (17)
   [junit4]   2> 2046795 T2865 oascc.ZkStateReader$3.process Updating live nodes... (17)
   [junit4]   2> 2046795 T2893 oascc.ZkStateReader$3.process Updating live nodes... (17)
   [junit4]   2> 2046795 T2889 oascc.ZkStateReader$3.process Updating live nodes... (17)
   [junit4]   2> 2046795 T2899 oascc.ZkStateReader$3.process Updating live nodes... (17)
   [junit4]   2> 2046797 T2905 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@255fa507 name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046796 T2883 oascc.ZkStateReader$3.process Updating live nodes... (17)
   [junit4]   2> 2046795 T2901 oascc.ZkStateReader$3.process Updating live nodes... (17)
   [junit4]   2> 2046795 T2881 oascc.ZkStateReader$3.process Updating live nodes... (17)
   [junit4]   2> 2046795 T2895 oascc.ZkStateReader$3.process Updating live nodes... (17)
   [junit4]   2> 2046798 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046799 T2854 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2046801 T2854 oascc.SolrZkClient.makePath makePath: /live_nodes/node17
   [junit4]   2> 2046804 T2903 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2046804 T2879 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2046804 T2889 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2046805 T2899 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2046804 T2893 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2046805 T2883 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2046804 T2871 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2046804 T2897 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2046804 T2887 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2046804 T2905 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2046805 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046805 T2877 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2046805 T2881 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2046805 T2885 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2046805 T2901 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2046805 T2891 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2046805 T2873 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2046805 T2865 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2046805 T2875 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2046805 T2895 oascc.ZkStateReader$3.process Updating live nodes... (18)
   [junit4]   2> 2046807 T2907 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5e71c16 name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046808 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046809 T2854 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2046811 T2854 oascc.SolrZkClient.makePath makePath: /live_nodes/node18
   [junit4]   2> 2046814 T2893 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2046814 T2901 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2046815 T2881 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2046815 T2877 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2046815 T2907 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2046815 T2899 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2046815 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046814 T2891 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2046815 T2879 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2046815 T2889 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2046815 T2871 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2046815 T2903 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2046815 T2897 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2046815 T2883 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2046814 T2873 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2046814 T2865 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2046814 T2885 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2046814 T2895 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2046814 T2875 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2046814 T2887 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2046814 T2905 oascc.ZkStateReader$3.process Updating live nodes... (19)
   [junit4]   2> 2046817 T2909 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7690fa04 name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046818 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046819 T2854 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2046821 T2854 oascc.SolrZkClient.makePath makePath: /live_nodes/node19
   [junit4]   2> 2046824 T2893 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2046824 T2899 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2046824 T2875 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2046825 T2897 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2046825 T2865 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2046825 T2879 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2046825 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046824 T2877 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2046825 T2901 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2046825 T2895 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2046825 T2883 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2046825 T2891 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2046825 T2881 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2046825 T2873 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2046825 T2909 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2046825 T2885 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2046825 T2905 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2046825 T2887 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2046825 T2903 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2046824 T2907 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2046824 T2871 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2046824 T2889 oascc.ZkStateReader$3.process Updating live nodes... (20)
   [junit4]   2> 2046827 T2911 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@43469279 name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046828 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046829 T2854 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2046831 T2854 oascc.SolrZkClient.makePath makePath: /live_nodes/node20
   [junit4]   2> 2046834 T2885 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2046834 T2893 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2046835 T2871 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2046835 T2901 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2046835 T2905 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2046835 T2889 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2046834 T2909 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2046834 T2899 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2046835 T2865 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2046836 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046835 T2873 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2046835 T2881 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2046835 T2911 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2046835 T2891 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2046835 T2907 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2046835 T2883 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2046835 T2903 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2046835 T2897 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2046835 T2887 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2046835 T2877 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2046835 T2895 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2046835 T2875 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2046835 T2879 oascc.ZkStateReader$3.process Updating live nodes... (21)
   [junit4]   2> 2046837 T2913 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@93b7570 name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046839 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046840 T2854 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2046842 T2854 oascc.SolrZkClient.makePath makePath: /live_nodes/node21
   [junit4]   2> 2046845 T2893 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2046845 T2865 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2046845 T2899 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2046845 T2873 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2046846 T2895 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2046846 T2913 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2046846 T2897 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2046846 T2881 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2046846 T2883 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2046846 T2911 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2046847 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046846 T2879 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2046846 T2891 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2046846 T2907 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2046846 T2871 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2046846 T2885 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2046846 T2875 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2046846 T2903 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2046846 T2909 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2046845 T2905 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2046845 T2889 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2046845 T2901 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2046848 T2915 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d83c522 name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046846 T2877 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2046846 T2887 oascc.ZkStateReader$3.process Updating live nodes... (22)
   [junit4]   2> 2046849 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046851 T2854 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2046852 T2854 oascc.SolrZkClient.makePath makePath: /live_nodes/node22
   [junit4]   2> 2046855 T2887 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2046856 T2875 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2046856 T2897 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2046856 T2873 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2046856 T2901 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2046856 T2883 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2046856 T2895 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2046856 T2865 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2046856 T2911 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2046855 T2881 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2046857 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046857 T2913 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2046857 T2877 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2046857 T2885 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2046857 T2915 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2046857 T2903 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2046857 T2907 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2046857 T2899 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2046857 T2889 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2046857 T2893 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2046857 T2871 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2046857 T2891 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2046856 T2905 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2046856 T2909 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2046856 T2879 oascc.ZkStateReader$3.process Updating live nodes... (23)
   [junit4]   2> 2046859 T2917 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2d486c91 name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046861 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046862 T2854 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2046864 T2854 oascc.SolrZkClient.makePath makePath: /live_nodes/node23
   [junit4]   2> 2046867 T2915 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2046868 T2875 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2046868 T2907 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2046868 T2897 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2046868 T2865 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2046867 T2871 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2046867 T2885 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2046867 T2887 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2046867 T2913 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2046869 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046869 T2903 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2046869 T2879 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2046868 T2877 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2046868 T2917 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2046868 T2891 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2046868 T2893 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2046868 T2883 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2046868 T2909 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2046868 T2911 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2046868 T2895 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2046868 T2889 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2046868 T2899 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2046868 T2881 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2046868 T2901 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2046868 T2905 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2046868 T2873 oascc.ZkStateReader$3.process Updating live nodes... (24)
   [junit4]   2> 2046870 T2919 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@929c3f5 name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046873 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046874 T2854 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2046875 T2854 oascc.SolrZkClient.makePath makePath: /live_nodes/node24
   [junit4]   2> 2046879 T2905 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2046879 T2873 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2046879 T2875 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2046879 T2871 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2046880 T2901 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2046880 T2899 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2046880 T2897 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2046880 T2891 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2046881 T2865 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2046881 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046879 T2885 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2046879 T2915 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2046879 T2889 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2046879 T2903 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2046879 T2893 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2046879 T2881 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2046881 T2909 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2046882 T2921 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7f032c3d name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046881 T2913 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2046880 T2907 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2046880 T2917 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2046880 T2911 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2046880 T2887 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2046880 T2883 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2046880 T2879 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2046880 T2919 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2046880 T2895 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2046880 T2877 oascc.ZkStateReader$3.process Updating live nodes... (25)
   [junit4]   2> 2046882 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046885 T2854 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2046887 T2854 oascc.SolrZkClient.makePath makePath: /live_nodes/node25
   [junit4]   2> 2046890 T2917 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2046890 T2897 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2046891 T2883 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2046891 T2909 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2046891 T2919 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2046891 T2899 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2046892 T2865 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2046891 T2893 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2046891 T2873 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2046891 T2915 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2046890 T2903 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2046890 T2889 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2046890 T2887 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2046890 T2879 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2046892 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046892 T2913 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2046892 T2881 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2046894 T2923 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4ba91842 name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046892 T2895 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2046892 T2911 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2046892 T2885 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2046892 T2901 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2046892 T2921 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2046892 T2891 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2046892 T2871 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2046891 T2877 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2046891 T2907 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2046891 T2875 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2046891 T2905 oascc.ZkStateReader$3.process Updating live nodes... (26)
   [junit4]   2> 2046894 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046897 T2854 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2046899 T2854 oascc.SolrZkClient.makePath makePath: /live_nodes/node26
   [junit4]   2> 2046903 T2881 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2046904 T2893 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2046904 T2885 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2046903 T2921 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2046905 T2919 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2046905 T2897 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2046905 T2899 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2046905 T2865 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2046905 T2879 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2046905 T2923 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2046905 T2915 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2046905 T2877 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2046905 T2913 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2046905 T2909 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2046905 T2903 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2046905 T2873 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2046905 T2875 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2046904 T2889 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2046904 T2911 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2046904 T2901 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2046904 T2883 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2046904 T2905 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2046904 T2907 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2046904 T2917 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2046904 T2871 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2046904 T2887 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2046904 T2895 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2046903 T2891 oascc.ZkStateReader$3.process Updating live nodes... (27)
   [junit4]   2> 2046907 T2925 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b2f6e45 name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046905 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046909 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046910 T2854 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2046912 T2854 oascc.SolrZkClient.makePath makePath: /live_nodes/node27
   [junit4]   2> 2046916 T2921 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2046916 T2891 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2046917 T2915 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2046917 T2887 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2046917 T2879 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2046918 T2925 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2046917 T2871 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2046917 T2905 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2046919 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046917 T2917 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2046916 T2901 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2046918 T2919 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2046918 T2883 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2046918 T2885 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2046918 T2899 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2046918 T2907 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2046918 T2889 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2046918 T2903 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2046918 T2865 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2046918 T2897 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2046918 T2895 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2046918 T2877 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2046918 T2909 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2046918 T2875 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2046918 T2913 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2046918 T2893 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2046917 T2923 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2046917 T2881 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2046917 T2911 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2046917 T2873 oascc.ZkStateReader$3.process Updating live nodes... (28)
   [junit4]   2> 2046920 T2927 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@24384e8c name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046923 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046924 T2854 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2046926 T2854 oascc.SolrZkClient.makePath makePath: /live_nodes/node28
   [junit4]   2> 2046929 T2913 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2046930 T2907 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2046929 T2885 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2046930 T2873 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2046931 T2927 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2046930 T2877 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2046930 T2889 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2046931 T2899 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2046931 T2881 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2046931 T2903 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2046931 T2865 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2046931 T2897 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2046931 T2911 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2046931 T2895 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2046931 T2923 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2046931 T2909 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2046931 T2871 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2046933 T2929 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@38aeb2ed name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046931 T2917 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2046931 T2883 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2046930 T2915 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2046930 T2919 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2046930 T2875 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2046930 T2921 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2046930 T2901 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2046930 T2879 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2046930 T2925 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2046930 T2891 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2046930 T2905 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2046930 T2893 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2046930 T2887 oascc.ZkStateReader$3.process Updating live nodes... (29)
   [junit4]   2> 2046932 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046936 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046937 T2854 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2046939 T2854 oascc.SolrZkClient.makePath makePath: /live_nodes/node29
   [junit4]   2> 2046942 T2889 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2046943 T2871 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2046944 T2873 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2046944 T2877 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2046944 T2881 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2046944 T2909 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2046943 T2905 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2046943 T2911 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2046943 T2895 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2046943 T2885 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2046943 T2899 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2046943 T2901 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2046943 T2907 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2046943 T2915 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2046943 T2921 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2046943 T2891 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2046943 T2917 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2046946 T2931 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2ce3c5a8 name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046945 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046944 T2925 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2046944 T2875 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2046944 T2883 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2046944 T2923 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2046944 T2919 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2046944 T2887 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2046944 T2927 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2046944 T2913 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2046944 T2865 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2046944 T2903 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2046944 T2879 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2046944 T2897 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2046944 T2929 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2046944 T2893 oascc.ZkStateReader$3.process Updating live nodes... (30)
   [junit4]   2> 2046947 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046950 T2854 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2046952 T2854 oascc.SolrZkClient.makePath makePath: /live_nodes/node30
   [junit4]   2> 2046956 T2877 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2046957 T2889 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2046957 T2885 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2046957 T2899 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2046956 T2907 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2046958 T2917 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2046958 T2909 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2046958 T2927 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2046958 T2895 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2046958 T2903 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2046958 T2921 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2046958 T2893 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2046958 T2919 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2046958 T2929 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2046958 T2911 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2046957 T2883 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2046957 T2923 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2046960 T2933 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@62083f66 name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046957 T2897 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2046957 T2865 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2046957 T2875 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2046957 T2879 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2046957 T2931 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2046957 T2913 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2046957 T2881 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2046957 T2925 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2046957 T2905 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2046957 T2901 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2046957 T2915 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2046956 T2891 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2046956 T2871 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2046956 T2873 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2046958 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046958 T2887 oascc.ZkStateReader$3.process Updating live nodes... (31)
   [junit4]   2> 2046963 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046964 T2854 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2046966 T2854 oascc.SolrZkClient.makePath makePath: /live_nodes/node31
   [junit4]   2> 2046970 T2877 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2046970 T2885 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2046971 T2887 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2046971 T2919 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2046971 T2907 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2046971 T2921 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2046971 T2909 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2046971 T2873 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2046971 T2927 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2046971 T2911 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2046971 T2881 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2046970 T2871 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2046970 T2925 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2046970 T2901 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2046972 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046972 T2895 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2046972 T2883 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2046972 T2879 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2046972 T2897 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2046972 T2889 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2046972 T2933 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2046972 T2917 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2046972 T2905 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2046972 T2875 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2046972 T2931 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2046971 T2929 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2046971 T2891 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2046971 T2899 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2046971 T2915 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2046971 T2903 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2046971 T2923 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2046971 T2913 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2046971 T2893 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2046971 T2865 oascc.ZkStateReader$3.process Updating live nodes... (32)
   [junit4]   2> 2046974 T2935 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7e754c90 name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046977 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046978 T2854 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2046980 T2854 oascc.SolrZkClient.makePath makePath: /live_nodes/node32
   [junit4]   2> 2046985 T2927 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2046985 T2907 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2046985 T2915 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2046986 T2929 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2046986 T2923 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2046986 T2871 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2046987 T2935 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2046986 T2899 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2046986 T2897 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2046987 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046986 T2903 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2046986 T2913 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2046986 T2917 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2046986 T2875 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2046986 T2877 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2046986 T2881 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2046985 T2921 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2046985 T2891 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2046989 T2937 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3c05fb55 name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046985 T2865 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2046985 T2901 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2046985 T2873 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2046985 T2883 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2046985 T2931 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2046985 T2885 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2046985 T2933 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2046989 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2046987 T2909 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2046987 T2919 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2046987 T2895 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2046987 T2889 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2046987 T2925 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2046991 T2854 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2046987 T2905 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2046986 T2887 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2046986 T2879 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2046986 T2893 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2046986 T2911 oascc.ZkStateReader$3.process Updating live nodes... (33)
   [junit4]   2> 2046993 T2854 oascc.SolrZkClient.makePath makePath: /live_nodes/node33
   [junit4]   2> 2046997 T2889 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2046997 T2871 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2046997 T2899 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2046998 T2883 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2046999 T2881 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2046999 T2893 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2046999 T2919 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2046999 T2891 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2046999 T2917 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2046999 T2925 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2046999 T2901 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2046999 T2865 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2046999 T2923 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2046999 T2887 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2046999 T2931 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2046998 T2911 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2047001 T2939 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@261a9544 name:ZooKeeperConnection Watcher:127.0.0.1:40318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2046998 T2915 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2046998 T2907 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2046998 T2909 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2046998 T2903 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2046998 T2929 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2046998 T2921 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2046998 T2873 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2046998 T2905 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2046998 T2895 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2046998 T2897 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2046998 T2933 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2046998 T2927 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2046997 T2937 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2046997 T2885 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2046997 T2877 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2046999 T2854 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2046999 T2879 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2046999 T2875 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2046999 T2913 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2046999 T2935 oascc.ZkStateReader$3.process Updating live nodes... (34)
   [junit4]   2> 2047004 T2854 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2047006 T2854 oa

[...truncated too long message...]

loud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
   [junit4]   2> 
   [junit4]   2> 2071008 T3311 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 2071008 T3311 oasc.LeaderElector$1.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:253)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:253)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
   [junit4]   2> 
   [junit4]   2> 2071009 T3311 oasc.LeaderElector$1.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:253)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:253)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
   [junit4]   2> 
   [junit4]   2> 2071494 T3319 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 2071494 T3319 oasc.LeaderElector$1.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:253)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:253)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
   [junit4]   2> 
   [junit4]   2> 2071495 T3319 oasc.LeaderElector$1.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:253)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:253)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
   [junit4]   2> 
   [junit4]   2> 2073389 T2854 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: test params are: codec=Lucene46: {}, docValues:{}, sim=DefaultSimilarity, locale=th_TH, timezone=America/Boise
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_25 (64-bit)/cpus=16,threads=1,free=101923872,total=445644800
   [junit4]   2> NOTE: All tests run in this JVM: [TestStressReorder, TestFileDictionaryLookup, RecoveryZkTest, TestCoreDiscovery, ConvertedLegacyTest, TermVectorComponentDistributedTest, TestRandomFaceting, TestSolrIndexConfig, DOMUtilTest, TestCustomSort, TestConfig, BasicZkTest, TestQueryUtils, TestRangeQuery, PreAnalyzedUpdateProcessorTest, SolrTestCaseJ4Test, XmlUpdateRequestHandlerTest, TestInfoStreamLogging, FieldAnalysisRequestHandlerTest, ZkNodePropsTest, TestManagedSchemaFieldResource, SpellCheckCollatorTest, DistributedQueryComponentCustomSortTest, SynonymTokenizerTest, SuggesterWFSTTest, StatsComponentTest, TestSolr4Spatial, TestDocumentBuilder, TestCSVLoader, TestJmxIntegration, TestStressUserVersions, LeaderElectionTest, PeerSyncTest, TermsComponentTest, SampleTest, EnumFieldTest, TestSolrXml, PingRequestHandlerTest, TestClassNameShortening, LegacyHTMLStripCharFilterTest, TestZkChroot, TestSolrXmlPersistence, TestFieldTypeCollectionResource, AliasIntegrationTest, TestArbitraryIndexDir, DocumentAnalysisRequestHandlerTest, IndexSchemaTest, TestUtils, TestAtomicUpdateErrorCases, TestLRUCache, DebugComponentTest, TestAddFieldRealTimeGet, HdfsBasicDistributedZkTest, TestExtendedDismaxParser, TestDistributedMissingSort, TestPartialUpdateDeduplication, FileBasedSpellCheckerTest, DocValuesMissingTest, TestSearchPerf, TestNumberUtils, SyncSliceTest, TestAnalyzeInfixSuggestions, ParsingFieldUpdateProcessorsTest, TestMergePolicyConfig, AssignTest, TestMaxScoreQueryParser, SuggestComponentTest, DistributedSpellCheckComponentTest, ZkSolrClientTest, TestCSVResponseWriter, TestFuzzyAnalyzedSuggestions, TestFieldTypeResource, TestSimpleQParserPlugin, ResponseLogComponentTest, TestImplicitCoreProperties, TestWordDelimiterFilterFactory, RAMDirectoryFactoryTest, DateFieldTest, TestSystemIdResolver, MinimalSchemaTest, TestRecovery, ReturnFieldsTest, TestXIncludeConfig, BasicDistributedZk2Test, TestRandomDVFaceting, TestDistributedSearch, TestJoin, TestStressRecovery, LeaderElectionIntegrationTest, TestCloudManagedSchema, TestFiltering, OpenCloseCoreStressTest, OverseerTest]
   [junit4] Completed on J0 in 26.92s, 8 tests, 1 error <<< FAILURES!

[...truncated 475 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:459: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:439: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:491: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1308: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:941: There were test failures: 354 suites, 1541 tests, 1 error, 34 ignored (6 assumptions)

Total time: 64 minutes 29 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 1866 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/1866/

2 tests failed.
REGRESSION:  org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch

Error Message:
shard2 is not consistent.  Got 139 from http://127.0.0.1:53652/collection1lastClient and got 138 from http://127.0.0.1:20281/collection1

Stack Trace:
java.lang.AssertionError: shard2 is not consistent.  Got 139 from http://127.0.0.1:53652/collection1lastClient and got 138 from http://127.0.0.1:20281/collection1
	at __randomizedtesting.SeedInfo.seed([838A68A806E93A42:26CE6B071B65A7E]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1152)
	at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.doTest(ChaosMonkeySafeLeaderTest.java:149)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:724)


REGRESSION:  org.apache.solr.cloud.OverseerRolesTest.testDistribSearch

Error Message:
could not set the new overseer

Stack Trace:
java.lang.AssertionError: could not set the new overseer
	at __randomizedtesting.SeedInfo.seed([838A68A806E93A42:26CE6B071B65A7E]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.OverseerRolesTest.addOverseerRole2ExistingNodes(OverseerRolesTest.java:120)
	at org.apache.solr.cloud.OverseerRolesTest.doTest(OverseerRolesTest.java:86)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:724)




Build Log:
[...truncated 10202 lines...]
   [junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
   [junit4]   2> 475196 T1543 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 475203 T1543 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./solrtest-ChaosMonkeySafeLeaderTest-1389984297393
   [junit4]   2> 475205 T1543 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 475206 T1544 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 475307 T1543 oasc.ZkTestServer.run start zk server on port:36238
   [junit4]   2> 475308 T1543 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 475318 T1550 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e4a616a name:ZooKeeperConnection Watcher:127.0.0.1:36238 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 475319 T1543 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 475319 T1543 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 475332 T1543 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 475334 T1552 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4a4013df name:ZooKeeperConnection Watcher:127.0.0.1:36238/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 475334 T1543 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 475335 T1543 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 475344 T1543 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 475348 T1543 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 475351 T1543 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 475359 T1543 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 475360 T1543 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 475374 T1543 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
   [junit4]   2> 475375 T1543 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 475481 T1543 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 475482 T1543 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 475496 T1543 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 475497 T1543 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 475501 T1543 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 475502 T1543 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 475506 T1543 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 475506 T1543 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 475510 T1543 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 475511 T1543 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 475515 T1543 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 475515 T1543 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 475519 T1543 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 475520 T1543 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 475524 T1543 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 475524 T1543 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 475528 T1543 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 475529 T1543 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 475841 T1543 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 475846 T1543 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:44858
   [junit4]   2> 475847 T1543 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 475848 T1543 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 475848 T1543 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1389984297722
   [junit4]   2> 475849 T1543 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1389984297722/'
   [junit4]   2> 475890 T1543 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1389984297722/solr.xml
   [junit4]   2> 475997 T1543 oasc.CoreContainer.<init> New CoreContainer 1308039716
   [junit4]   2> 475998 T1543 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1389984297722/]
   [junit4]   2> 476000 T1543 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 476000 T1543 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 476001 T1543 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 476001 T1543 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 476002 T1543 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 476002 T1543 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 476003 T1543 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 476003 T1543 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 476004 T1543 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 476017 T1543 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 476018 T1543 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 476018 T1543 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 476019 T1543 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:36238/solr
   [junit4]   2> 476020 T1543 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 476021 T1543 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 476027 T1563 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19d55979 name:ZooKeeperConnection Watcher:127.0.0.1:36238 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 476028 T1543 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 476031 T1543 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 476039 T1565 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13ab0e5a name:ZooKeeperConnection Watcher:127.0.0.1:36238/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 476039 T1543 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 476041 T1543 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 476052 T1543 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 476056 T1543 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 476059 T1543 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44858_
   [junit4]   2> 476066 T1543 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:44858_
   [junit4]   2> 476070 T1543 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 476073 T1543 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 476084 T1543 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 476087 T1543 oasc.Overseer.start Overseer (id=91094010914471939-127.0.0.1:44858_-n_0000000000) starting
   [junit4]   2> 476098 T1543 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 476109 T1567 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 476110 T1543 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 476111 T1567 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
   [junit4]   2> 476114 T1543 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 476116 T1543 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 476120 T1566 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 476126 T1568 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 476127 T1568 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 476128 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 476129 T1568 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 476130 T1566 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 476131 T1566 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:44858",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:44858_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 476132 T1566 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 476132 T1566 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 476135 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 476145 T1565 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 477130 T1568 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 477130 T1568 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1389984297722/collection1
   [junit4]   2> 477131 T1568 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 477132 T1568 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 477132 T1568 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 477133 T1568 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1389984297722/collection1/'
   [junit4]   2> 477135 T1568 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1389984297722/collection1/lib/classes/' to classloader
   [junit4]   2> 477136 T1568 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1389984297722/collection1/lib/README' to classloader
   [junit4]   2> 477207 T1568 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 477283 T1568 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 477384 T1568 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 477395 T1568 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 478070 T1568 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 478075 T1568 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 478077 T1568 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 478083 T1568 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 478113 T1568 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 478173 T1568 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1389984297722/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1389984297393/control/data/
   [junit4]   2> 478174 T1568 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6bd900be
   [junit4]   2> 478176 T1568 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1389984297393/control/data
   [junit4]   2> 478177 T1568 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1389984297393/control/data/index/
   [junit4]   2> 478178 T1568 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1389984297393/control/data/index' doesn't exist. Creating new index...
   [junit4]   2> 478179 T1568 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1389984297393/control/data/index
   [junit4]   2> 478180 T1568 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=34, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 478185 T1568 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1389984297393/control/data/index,segFN=segments_1,generation=1}
   [junit4]   2> 478186 T1568 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 478190 T1568 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 478190 T1568 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 478191 T1568 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 478191 T1568 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 478192 T1568 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 478192 T1568 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 478193 T1568 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 478193 T1568 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 478193 T1568 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 478194 T1568 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 478195 T1568 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 478195 T1568 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 478195 T1568 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 478196 T1568 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 478196 T1568 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 478197 T1568 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 478217 T1568 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 478222 T1568 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 478223 T1568 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 478224 T1568 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=47, maxMergeAtOnceExplicit=27, maxMergedSegmentMB=1.326171875, floorSegmentMB=1.1474609375, forceMergeDeletesPctAllowed=27.60164655463454, segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7822638639712676
   [junit4]   2> 478226 T1568 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1389984297393/control/data/index,segFN=segments_1,generation=1}
   [junit4]   2> 478226 T1568 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 478226 T1568 oass.SolrIndexSearcher.<init> Opening Searcher@298df11e main
   [junit4]   2> 478230 T1569 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@298df11e main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 478232 T1568 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 478233 T1543 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
   [junit4]   2> 478233 T1543 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 478233 T1572 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:44858 collection:control_collection shard:shard1
   [junit4]   2> 478235 T1543 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 478244 T1574 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@79f4a60c name:ZooKeeperConnection Watcher:127.0.0.1:36238/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 478245 T1543 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 478246 T1572 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 478247 T1543 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 478250 T1543 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 478270 T1572 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 478278 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 478279 T1572 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 478279 T1572 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C392 name=collection1 org.apache.solr.core.SolrCore@604d7e8d url=http://127.0.0.1:44858/collection1 node=127.0.0.1:44858_ C392_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:44858, core=collection1, node_name=127.0.0.1:44858_}
   [junit4]   2> 478279 T1572 C392 P44858 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:44858/collection1/
   [junit4]   2> 478280 T1572 C392 P44858 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 478280 T1566 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 478280 T1572 C392 P44858 oasc.SyncStrategy.syncToMe http://127.0.0.1:44858/collection1/ has no replicas
   [junit4]   2> 478281 T1572 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:44858/collection1/ shard1
   [junit4]   2> 478281 T1572 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 478285 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 478296 T1574 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 478296 T1565 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 478312 T1566 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 478317 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 478422 T1565 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 478422 T1574 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 478465 T1572 oasc.ZkController.register We are http://127.0.0.1:44858/collection1/ and leader is http://127.0.0.1:44858/collection1/
   [junit4]   2> 478465 T1572 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:44858
   [junit4]   2> 478465 T1572 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 478466 T1572 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 478466 T1572 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 478473 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 478473 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 478474 T1572 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 478474 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 478475 T1566 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 478476 T1566 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:44858",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:44858_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 478484 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 478550 T1543 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 478553 T1543 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:40918
   [junit4]   2> 478554 T1543 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 478555 T1543 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 478555 T1543 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1389984300440
   [junit4]   2> 478556 T1543 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1389984300440/'
   [junit4]   2> 478588 T1565 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 478588 T1574 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 478594 T1543 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1389984300440/solr.xml
   [junit4]   2> 478690 T1543 oasc.CoreContainer.<init> New CoreContainer 1664203020
   [junit4]   2> 478690 T1543 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1389984300440/]
   [junit4]   2> 478692 T1543 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 478693 T1543 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 478693 T1543 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 478694 T1543 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 478694 T1543 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 478695 T1543 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 478695 T1543 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 478696 T1543 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 478696 T1543 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 478708 T1543 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 478708 T1543 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 478709 T1543 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 478709 T1543 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:36238/solr
   [junit4]   2> 478710 T1543 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 478711 T1543 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 478713 T1585 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@556bf5b4 name:ZooKeeperConnection Watcher:127.0.0.1:36238 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 478714 T1543 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 478716 T1543 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 478724 T1587 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19402db0 name:ZooKeeperConnection Watcher:127.0.0.1:36238/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 478724 T1543 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 478729 T1543 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 479732 T1543 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40918_
   [junit4]   2> 479769 T1543 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40918_
   [junit4]   2> 479786 T1587 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 479786 T1574 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 479786 T1565 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 479801 T1588 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 479801 T1588 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 479803 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 479803 T1588 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 479803 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 479803 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 479805 T1566 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 479805 T1566 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:40918",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:40918_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 479806 T1566 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
   [junit4]   2> 479806 T1566 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
   [junit4]   2> 479808 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 479941 T1565 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 479941 T1574 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 479941 T1587 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 480804 T1588 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 480804 T1588 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1389984300440/collection1
   [junit4]   2> 480805 T1588 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 480806 T1588 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 480806 T1588 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 480807 T1588 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1389984300440/collection1/'
   [junit4]   2> 480809 T1588 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1389984300440/collection1/lib/classes/' to classloader
   [junit4]   2> 480810 T1588 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1389984300440/collection1/lib/README' to classloader
   [junit4]   2> 480905 T1588 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 480981 T1588 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 481082 T1588 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 481098 T1588 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 481704 T1588 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 481707 T1588 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 481709 T1588 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 481713 T1588 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 481734 T1588 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 481734 T1588 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1389984300440/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1389984297393/jetty1/
   [junit4]   2> 481734 T1588 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6bd900be
   [junit4]   2> 481735 T1588 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1389984297393/jetty1
   [junit4]   2> 481736 T1588 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1389984297393/jetty1/index/
   [junit4]   2> 481737 T1588 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1389984297393/jetty1/index' doesn't exist. Creating new index...
   [junit4]   2> 481738 T1588 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1389984297393/jetty1/index
   [junit4]   2> 481739 T1588 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=34, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 481780 T1588 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1389984297393/jetty1/index,segFN=segments_1,generation=1}
   [junit4]   2> 481781 T1588 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 481785 T1588 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 481785 T1588 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 481786 T1588 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 481786 T1588 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 481786 T1588 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 481786 T1588 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 481787 T1588 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 481787 T1588 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 481787 T1588 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 481788 T1588 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 481789 T1588 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 481789 T1588 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 481789 T1588 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 481790 T1588 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 481790 T1588 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 481790 T1588 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 481803 T1588 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 481806 T1588 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 481806 T1588 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 481807 T1588 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=47, maxMergeAtOnceExplicit=27, maxMergedSegmentMB=1.326171875, floorSegmentMB=1.1474609375, forceMergeDeletesPctAllowed=27.60164655463454, segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7822638639712676
   [junit4]   2> 481808 T1588 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1389984297393/jetty1/index,segFN=segments_1,generation=1}
   [junit4]   2> 481809 T1588 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 481809 T1588 oass.SolrIndexSearcher.<init> Opening Searcher@41c4b5ba main
   [junit4]   2> 481812 T1589 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@41c4b5ba main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 481814 T1588 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 481815 T1543 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
   [junit4]   2> 481816 T1543 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 481815 T1592 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:40918 collection:collection1 shard:shard3
   [junit4]   2> 481817 T1592 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
   [junit4]   2> 481839 T1592 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
   [junit4]   2> 481850 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 481850 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 481851 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 481851 T1592 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 481851 T1592 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C393 name=collection1 org.apache.solr.core.SolrCore@198ad933 url=http://127.0.0.1:40918/collection1 node=127.0.0.1:40918_ C393_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:40918, core=collection1, node_name=127.0.0.1:40918_}
   [junit4]   2> 481851 T1592 C393 P40918 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:40918/collection1/
   [junit4]   2> 481851 T1592 C393 P40918 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 481852 T1592 C393 P40918 oasc.SyncStrategy.syncToMe http://127.0.0.1:40918/collection1/ has no replicas
   [junit4]   2> 481852 T1592 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:40918/collection1/ shard3
   [junit4]   2> 481852 T1566 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 481852 T1592 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
   [junit4]   2> 481860 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 481871 T1587 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 481871 T1574 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 481871 T1565 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 481880 T1566 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 481884 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 481987 T1565 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 481987 T1587 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 481987 T1574 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 482028 T1543 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 482031 T1543 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:40172
   [junit4]   2> 482031 T1543 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 482032 T1592 oasc.ZkController.register We are http://127.0.0.1:40918/collection1/ and leader is http://127.0.0.1:40918/collection1/
   [junit4]   2> 482032 T1543 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 482032 T1592 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40918
   [junit4]   2> 482033 T1592 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 482033 T1543 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1389984304005
   [junit4]   2> 482033 T1592 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 482033 T1592 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 482033 T1543 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1389984304005/'
   [junit4]   2> 482035 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 482035 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 482035 T1592 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 482035 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 482037 T1566 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 482038 T1566 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:40918",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:40918_",
   [junit4]   2> 	  "shard":"shard3",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 482046 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 482064 T1543 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1389984304005/solr.xml
   [junit4]   2> 482135 T1543 oasc.CoreContainer.<init> New CoreContainer 1739829946
   [junit4]   2> 482135 T1543 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1389984304005/]
   [junit4]   2> 482137 T1543 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 482137 T1543 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 482137 T1543 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 482138 T1543 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 482138 T1543 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 482138 T1543 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 482139 T1543 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 482139 T1543 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 482139 T1543 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 482147 T1543 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 482147 T1543 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 482148 T1543 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 482148 T1543 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:36238/solr
   [junit4]   2> 482149 T1587 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 482149 T1543 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 482149 T1574 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 482148 T1565 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 482150 T1543 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 482182 T1603 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@72dd76dd name:ZooKeeperConnection Watcher:127.0.0.1:36238 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 482182 T1543 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 482185 T1543 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 482192 T1605 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1896b58d name:ZooKeeperConnection Watcher:127.0.0.1:36238/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 482193 T1543 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 482197 T1543 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 483200 T1543 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40172_
   [junit4]   2> 483217 T1543 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40172_
   [junit4]   2> 483221 T1565 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 483221 T1574 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 483222 T1605 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 483221 T1587 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 483232 T1606 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 483232 T1606 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 483234 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 483234 T1606 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 483234 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 483234 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 483236 T1566 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 483237 T1566 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:40172",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:40172_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 483237 T1566 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
   [junit4]   2> 483237 T1566 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 483241 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 483344 T1565 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 483344 T1605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 483344 T1574 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 483344 T1587 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 484235 T1606 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 484235 T1606 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1389984304005/collection1
   [junit4]   2> 484236 T1606 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 484237 T1606 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 484237 T1606 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 484238 T1606 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1389984304005/collection1/'
   [junit4]   2> 484240 T1606 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1389984304005/collection1/lib/README' to classloader
   [junit4]   2> 484241 T1606 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1389984304005/collection1/lib/classes/' to classloader
   [junit4]   2> 484310 T1606 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 484384 T1606 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 484486 T1606 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 484498 T1606 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 485136 T1606 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 485140 T1606 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 485142 T1606 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 485148 T1606 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 485176 T1606 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 485176 T1606 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1389984304005/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1389984297393/jetty2/
   [junit4]   2> 485176 T1606 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6bd900be
   [junit4]   2> 485178 T1606 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1389984297393/jetty2
   [junit4]   2> 485179 T1606 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1389984297393/jetty2/index/
   [junit4]   2> 485179 T1606 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1389984297393/jetty2/index' doesn't exist. Creating new index...
   [junit4]   2> 485181 T1606 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1389984297393/jetty2/index
   [junit4]   2> 485182 T1606 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=34, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 485186 T1606 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1389984297393/jetty2/index,segFN=segments_1,generation=1}
   [junit4]   2> 485186 T1606 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 485191 T1606 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 485192 T1606 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 485192 T1606 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 485192 T1606 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 485193 T1606 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 485193 T1606 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 485194 T1606 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 485194 T1606 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 485194 T1606 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 485195 T1606 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 485196 T1606 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 485196 T1606 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 485197 T1606 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 485197 T1606 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 485198 T1606 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 485199 T1606 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 485214 T1606 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 485218 T1606 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 485219 T1606 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 485220 T1606 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=47, maxMergeAtOnceExplicit=27, maxMergedSegmentMB=1.326171875, floorSegmentMB=1.1474609375, forceMergeDeletesPctAllowed=27.60164655463454, segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7822638639712676
   [junit4]   2> 485222 T1606 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1389984297393/jetty2/index,segFN=segments_1,generation=1}
   [junit4]   2> 485222 T1606 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 485222 T1606 oass.SolrIndexSearcher.<init> Opening Searcher@27b0ceac main
   [junit4]   2> 485227 T1607 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@27b0ceac main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 485230 T1606 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 485231 T1543 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0
   [junit4]   2> 485231 T1543 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 485231 T1610 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:40172 collection:collection1 shard:shard1
   [junit4]   2> 485233 T1610 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 485249 T1610 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 485260 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 485261 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 485261 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 485261 T1610 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 485261 T1610 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C394 name=collection1 org.apache.solr.core.SolrCore@4030986f url=http://127.0.0.1:40172/collection1 node=127.0.0.1:40172_ C394_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:40172, core=collection1, node_name=127.0.0.1:40172_}
   [junit4]   2> 485262 T1610 C394 P40172 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:40172/collection1/
   [junit4]   2> 485262 T1610 C394 P40172 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 485262 T1566 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 485262 T1610 C394 P40172 oasc.SyncStrategy.syncToMe http://127.0.0.1:40172/collection1/ has no replicas
   [junit4]   2> 485263 T1610 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:40172/collection1/ shard1
   [junit4]   2> 485263 T1610 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 485266 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 485267 T1565 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 485267 T1574 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 485267 T1605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 485267 T1587 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 485273 T1566 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 485276 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 485380 T1605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 485380 T1574 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 485380 T1587 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 485380 T1565 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 485425 T1610 oasc.ZkController.register We are http://127.0.0.1:40172/collection1/ and leader is http://127.0.0.1:40172/collection1/
   [junit4]   2> 485425 T1610 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40172
   [junit4]   2> 485425 T1610 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 485426 T1610 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 485426 T1610 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 485428 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 485428 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 485428 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 485428 T1610 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 485445 T1566 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 485446 T1566 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:40172",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:40172_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node2"}
   [junit4]   2> 485450 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 485540 T1543 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 485543 T1543 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:43684
   [junit4]   2> 485543 T1543 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 485544 T1543 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 485544 T1543 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1389984307421
   [junit4]   2> 485545 T1543 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1389984307421/'
   [junit4]   2> 485556 T1587 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 485556 T1605 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 485556 T1565 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 485556 T1574 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 485587 T1543 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1389984307421/solr.xml
   [junit4]   2> 485690 T1543 oasc.CoreContainer.<init> New CoreContainer 384593287
   [junit4]   2> 485691 T1543 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1389984307421/]
   [junit4]   2> 485693 T1543 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 485694 T1543 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 485694 T1543 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 485695 T1543 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 485695 T1543 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 485696 T1543 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 485696 T1543 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 485697 T1543 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 485697 T1543 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 485710 T1543 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 485710 T1543 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 485711 T1543 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 485712 T1543 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:36238/solr
   [junit4]   2> 485712 T1543 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 485713 T1543 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 485716 T1621 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7c0ac5d2 name:ZooKeeperConnection Watcher:127.0.0.1:36238 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 485717 T1543 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 485720 T1543 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 485722 T1623 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17bc3b20 name:ZooKeeperConnection Watcher:127.0.0.1:36238/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 485723 T1543 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 485733 T1543 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 486737 T1543 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43684_
   [junit4]   2> 486776 T1543 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:43684_
   [junit4]   2> 486781 T1565 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 486781 T1623 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 486781 T1574 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 486781 T1587 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 486781 T1605 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 486796 T1624 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 486796 T1624 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 486798 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 486798 T1624 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 486798 T1565 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 486798 T1565 oasc.Distribute

[...truncated too long message...]

6 T2222 oasc.SolrCore.close [testOverseerCol_shard3_replica2]  CLOSING SolrCore org.apache.solr.core.SolrCore@65ebc7ea
   [junit4]   2> 818657 T2383 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 818658 T2383 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:39958",
   [junit4]   2> 	  "core":"testOverseerCol_shard3_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:39958_",
   [junit4]   2> 	  "shard":"shard3",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"testOverseerCol",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":"core_node5"}
   [junit4]   2> 818661 T2332 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 818662 T2332 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 818662 T2337 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 818668 T2222 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
   [junit4]   2> 818669 T2222 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 818669 T2222 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 818669 T2222 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 818670 T2222 oasc.SolrCore.closeSearcher [testOverseerCol_shard3_replica2] Closing main searcher on request.
   [junit4]   2> 818671 T2222 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 818671 T2222 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.OverseerRolesTest-jetty6-1389984620672/testOverseerCol_shard3_replica2/data [CachedDir<<refCount=0;path=./org.apache.solr.cloud.OverseerRolesTest-jetty6-1389984620672/testOverseerCol_shard3_replica2/data;done=false>>]
   [junit4]   2> 818672 T2222 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.OverseerRolesTest-jetty6-1389984620672/testOverseerCol_shard3_replica2/data
   [junit4]   2> 818672 T2222 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.OverseerRolesTest-jetty6-1389984620672/testOverseerCol_shard3_replica2/data/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.OverseerRolesTest-jetty6-1389984620672/testOverseerCol_shard3_replica2/data/index;done=false>>]
   [junit4]   2> 818673 T2222 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.OverseerRolesTest-jetty6-1389984620672/testOverseerCol_shard3_replica2/data/index
   [junit4]   2> 818676 T2222 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
   [junit4]   2> 818676 T2337 oascc.ZkStateReader$3.process Updating live nodes... (0)
   [junit4]   2> 818734 T2222 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
   [junit4]   2> 818736 T2222 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:39928 39928
   [junit4]   2> 818899 T2337 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f567217 name:ZooKeeperConnection Watcher:127.0.0.1:39928/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
   [junit4]   2> 818899 T2337 oascc.ConnectionManager.process Client->ZooKeeper status change trigger but we are already closed
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=OverseerRolesTest -Dtests.method=testDistribSearch -Dtests.seed=838A68A806E93A42 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar_MA -Dtests.timezone=Asia/Vladivostok -Dtests.file.encoding=US-ASCII
   [junit4] FAILURE 30.4s J1 | OverseerRolesTest.testDistribSearch <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: could not set the new overseer
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([838A68A806E93A42:26CE6B071B65A7E]:0)
   [junit4]    > 	at org.apache.solr.cloud.OverseerRolesTest.addOverseerRole2ExistingNodes(OverseerRolesTest.java:120)
   [junit4]    > 	at org.apache.solr.cloud.OverseerRolesTest.doTest(OverseerRolesTest.java:86)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:724)
   [junit4]   2> 818912 T2222 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 30365 T2221 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 9 leaked thread(s).
   [junit4]   2> 819672 T2244 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 819764 T2262 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 819837 T2276 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 819934 T2290 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 820010 T2304 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 820102 T2318 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 820177 T2332 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> NOTE: test params are: codec=Lucene41, sim=DefaultSimilarity, locale=ar_MA, timezone=Asia/Vladivostok
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_25 (64-bit)/cpus=16,threads=1,free=302708616,total=473956352
   [junit4]   2> NOTE: All tests run in this JVM: [SliceStateTest, ConnectionManagerTest, TestWordDelimiterFilterFactory, AutoCommitTest, TestHashPartitioner, UpdateRequestProcessorFactoryTest, TestFieldTypeCollectionResource, TestCustomSort, TestSolr4Spatial, TestStressReorder, TestNRTOpen, NumericFieldsTest, TestBinaryField, SuggesterFSTTest, TestSolrIndexConfig, CursorMarkTest, TestValueSourceCache, TestOmitPositions, TermVectorComponentTest, DistributedDebugComponentTest, TestPerFieldSimilarity, TriLevelCompositeIdRoutingTest, TestSchemaNameResource, TestFastWriter, MoreLikeThisHandlerTest, TestDistribDocBasedVersion, CurrencyFieldXmlFileTest, TestElisionMultitermQuery, TestUpdate, TestSerializedLuceneMatchVersion, TestPseudoReturnFields, ResponseLogComponentTest, ConvertedLegacyTest, TestFieldResource, DefaultValueUpdateProcessorTest, JSONWriterTest, CursorPagingTest, DOMUtilTest, TestNoOpRegenerator, IndexBasedSpellCheckerTest, JsonLoaderTest, SpellCheckCollatorTest, TestManagedSchema, CoreAdminHandlerTest, TestQuerySenderListener, TestCSVLoader, IndexSchemaTest, QueryParsingTest, TestReversedWildcardFilterFactory, ZkCLITest, ExternalFileFieldSortTest, TestAtomicUpdateErrorCases, AddBlockUpdateTest, ShardSplitTest, BadComponentTest, HdfsRecoveryZkTest, ZkControllerTest, BJQParserTest, SolrXmlInZkTest, ShardRoutingCustomTest, TermVectorComponentDistributedTest, TestFaceting, PathHierarchyTokenizerFactoryTest, TestSolrQueryParserResource, PluginInfoTest, DirectUpdateHandlerOptimizeTest, TestSolrXml, DocValuesMultiTest, PreAnalyzedUpdateProcessorTest, TestQueryTypes, TestCollationKeyRangeQueries, TestFastLRUCache, DocumentBuilderTest, SuggesterWFSTTest, StatsComponentTest, TestFieldCollectionResource, OverseerCollectionProcessorTest, TestPhraseSuggestions, DirectSolrConnectionTest, DistributedQueryComponentCustomSortTest, TestDefaultSimilarityFactory, OverseerRolesTest]
   [junit4] Completed on J1 in 31.66s, 1 test, 1 failure <<< FAILURES!

[...truncated 583 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:459: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:439: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:491: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:1308: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/common-build.xml:941: There were test failures: 354 suites, 1541 tests, 2 failures, 34 ignored (6 assumptions)

Total time: 71 minutes 54 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-Tests-4.x-Java7 - Build # 1865 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-4.x-Java7/1865/

All tests passed

Build Log:
[...truncated 30668 lines...]
-check-forbidden-base:
[forbidden-apis] Reading bundled API signatures: jdk-unsafe-1.6
[forbidden-apis] Reading bundled API signatures: jdk-deprecated-1.6
[forbidden-apis] Reading bundled API signatures: commons-io-unsafe-2.1
[forbidden-apis] Reading API signatures: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/tools/forbiddenApis/base.txt
[forbidden-apis] Reading API signatures: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/lucene/tools/forbiddenApis/servlet-api.txt
[forbidden-apis] Loading classes to check...
[forbidden-apis] Scanning for API signatures and dependencies...
[forbidden-apis] Forbidden method invocation: java.lang.String#toLowerCase() [Uses default locale]
[forbidden-apis]   in org.apache.solr.cloud.OverseerRolesTest (OverseerRolesTest.java:160)
[forbidden-apis] Scanned 1906 (and 1314 related) class file(s) for forbidden API invocations (in 1.71s), 1 error(s).

BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:459: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/build.xml:64: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/build.xml:271: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-4.x-Java7/solr/common-build.xml:474: Check for forbidden API calls failed, see log.

Total time: 97 minutes 20 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure