You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/12/20 16:18:38 UTC

[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.8.0) - Build # 2006 - Still Failing!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/2006/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC (asserts: true)

1 tests failed.
FAILED:  org.apache.solr.core.TestNonNRTOpen.testReaderIsNotNRT

Error Message:
SOLR-5815? : wrong maxDoc: core=org.apache.solr.core.SolrCore@727a96f3 searcher=Searcher@b964093[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_4(6.0.0):c1) Uninverting(_5(6.0.0):c1)))} expected:<3> but was:<2>

Stack Trace:
java.lang.AssertionError: SOLR-5815? : wrong maxDoc: core=org.apache.solr.core.SolrCore@727a96f3 searcher=Searcher@b964093[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_4(6.0.0):c1) Uninverting(_5(6.0.0):c1)))} expected:<3> but was:<2>
	at __randomizedtesting.SeedInfo.seed([58CCD45428F40E1F:ED4AB5D39735BCEB]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.apache.solr.core.TestNonNRTOpen.assertNotNRT(TestNonNRTOpen.java:142)
	at org.apache.solr.core.TestNonNRTOpen.testReaderIsNotNRT(TestNonNRTOpen.java:100)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 8819 lines...]
   [junit4] Suite: org.apache.solr.core.TestNonNRTOpen
   [junit4]   2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001
   [junit4]   2> 1647196 T6107 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
   [junit4]   2> 1647198 T6107 oas.SolrTestCaseJ4.initCore ####initCore
   [junit4]   2> 1647198 T6107 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/'
   [junit4]   2> 1647199 T6107 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
   [junit4]   2> 1647199 T6107 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 1647200 T6107 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 1647242 T6107 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1647253 T6107 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-basic.xml
   [junit4]   2> 1647259 T6107 oass.IndexSchema.readSchema Reading Solr Schema from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema-minimal.xml
   [junit4]   2> 1647262 T6107 oass.IndexSchema.readSchema [null] Schema name=minimal
   [junit4]   2> 1647266 T6107 oass.IndexSchema.readSchema WARN no uniqueKey specified in schema.
   [junit4]   2> 1647269 T6107 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1647270 T6107 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr
   [junit4]   2> 1647270 T6107 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/'
   [junit4]   2> 1647313 T6107 oasc.CoreContainer.<init> New CoreContainer 1300988130
   [junit4]   2> 1647317 T6107 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/]
   [junit4]   2> 1647319 T6107 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 1647320 T6107 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 1647321 T6107 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 1647321 T6107 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1647323 T6107 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 1647324 T6107 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1647325 T6107 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1647327 T6107 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1647328 T6107 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1647329 T6107 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1647333 T6107 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=30000&connTimeout=30000&retry=false
   [junit4]   2> 1647334 T6107 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1647334 T6107 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1647334 T6107 oasc.CoreContainer.load Host Name: 
   [junit4]   2> 1647340 T6108 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/'
   [junit4]   2> 1647342 T6108 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
   [junit4]   2> 1647343 T6108 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 1647343 T6108 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 1647398 T6108 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1647411 T6108 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-basic.xml
   [junit4]   2> 1647411 T6108 oass.IndexSchema.readSchema Reading Solr Schema from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema-minimal.xml
   [junit4]   2> 1647414 T6108 oass.IndexSchema.readSchema [collection1] Schema name=minimal
   [junit4]   2> 1647416 T6108 oass.IndexSchema.readSchema WARN no uniqueKey specified in schema.
   [junit4]   2> 1647416 T6108 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/
   [junit4]   2> 1647417 T6108 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 1647418 T6108 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/, dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/
   [junit4]   2> 1647418 T6108 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 1647418 T6108 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001
   [junit4]   2> 1647419 T6108 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/index/
   [junit4]   2> 1647419 T6108 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/index' doesn't exist. Creating new index...
   [junit4]   2> 1647420 T6108 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/index
   [junit4]   2> 1647440 T6108 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/index,segFN=segments_1,generation=1}
   [junit4]   2> 1647440 T6108 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1647442 T6108 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1647442 T6108 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1647442 T6108 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1647442 T6108 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1647443 T6108 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
   [junit4]   2> 1647443 T6108 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
   [junit4]   2> 1647443 T6108 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
   [junit4]   2> 1647444 T6108 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
   [junit4]   2> 1647444 T6108 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
   [junit4]   2> 1647446 T6108 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
   [junit4]   2> 1647446 T6108 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
   [junit4]   2> 1647447 T6108 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
   [junit4]   2> 1647447 T6108 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
   [junit4]   2> 1647447 T6108 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
   [junit4]   2> 1647447 T6108 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
   [junit4]   2> 1647448 T6108 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: org.apache.solr.handler.admin.ShowFileRequestHandler
   [junit4]   2> 1647449 T6108 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
   [junit4]   2> 1647450 T6108 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1647450 T6108 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1647452 T6108 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1647454 T6108 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1647456 T6108 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1647457 T6108 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1647458 T6108 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1647458 T6108 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1647463 T6108 oass.SolrIndexSearcher.<init> Opening Searcher@189f04d8[collection1] main
   [junit4]   2> 1647463 T6108 oasr.ManagedResourceStorage.newStorageIO WARN Cannot write to config directory /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
   [junit4]   2> 1647463 T6108 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1647463 T6108 oasr.ManagedResourceStorage.load Reading _rest_managed.json using InMemoryStorage
   [junit4]   2> 1647464 T6108 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
   [junit4]   2> 1647464 T6108 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using InMemoryStorage
   [junit4]   2> 1647464 T6108 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1647464 T6108 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 1647465 T6109 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@189f04d8[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1647465 T6108 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1647467 T6107 oas.SolrTestCaseJ4.initCore ####initCore end
   [junit4]   2> ASYNC  NEW_CORE C3833 name=collection1 org.apache.solr.core.SolrCore@18eb205e
   [junit4]   2> 1647470 T6107 C3833 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/index,segFN=segments_1,generation=1}
   [junit4]   2> 1647472 T6107 C3833 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1647474 T6107 C3833 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[(null)]} 0 6
   [junit4]   2> 1647476 T6107 C3833 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1647512 T6107 C3833 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/index,segFN=segments_1,generation=1}
   [junit4]   2> 		commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/index,segFN=segments_2,generation=2}
   [junit4]   2> 1647513 T6107 C3833 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
   [junit4]   2> 1647530 T6107 C3833 oass.SolrIndexSearcher.<init> Opening Searcher@37f4bd89[collection1] main
   [junit4]   2> 1647531 T6109 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@37f4bd89[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):c1)))}
   [junit4]   2> 1647531 T6107 C3833 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 1647532 T6107 C3833 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 56
   [junit4]   2> 1647532 T6107 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 1647533 T6107 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1300988130
   [junit4]   2> 1647534 T6107 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@18eb205e
   [junit4]   2> 1647534 T6107 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=1,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 1647535 T6107 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 1647535 T6107 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 1647535 T6107 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 1647537 T6107 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 1647537 T6107 oasc.CachingDirectoryFactory.close Closing StandardDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 1647537 T6107 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/index [CachedDir<<refCount=0;path=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/index;done=false>>]
   [junit4]   2> 1647538 T6107 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/index
   [junit4]   2> 1647538 T6107 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001 [CachedDir<<refCount=0;path=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001;done=false>>]
   [junit4]   2> 1647538 T6107 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001
   [junit4]   2> 1647539 T6107 oas.SolrTestCaseJ4.initCore ####initCore
   [junit4]   2> 1647539 T6107 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/'
   [junit4]   2> 1647540 T6107 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
   [junit4]   2> 1647540 T6107 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 1647541 T6107 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 1647577 T6107 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1647588 T6107 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-basic.xml
   [junit4]   2> 1647593 T6107 oass.IndexSchema.readSchema Reading Solr Schema from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema-minimal.xml
   [junit4]   2> 1647607 T6107 oass.IndexSchema.readSchema [null] Schema name=minimal
   [junit4]   2> 1647608 T6107 oass.IndexSchema.readSchema WARN no uniqueKey specified in schema.
   [junit4]   2> 1647612 T6107 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1647612 T6107 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr
   [junit4]   2> 1647612 T6107 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/'
   [junit4]   2> 1647636 T6107 oasc.CoreContainer.<init> New CoreContainer 1144670506
   [junit4]   2> 1647637 T6107 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/]
   [junit4]   2> 1647642 T6107 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 1647642 T6107 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 1647642 T6107 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 1647643 T6107 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1647643 T6107 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 1647643 T6107 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1647643 T6107 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1647643 T6107 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1647644 T6107 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1647644 T6107 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1647646 T6107 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=30000&connTimeout=30000&retry=false
   [junit4]   2> 1647648 T6107 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1647648 T6107 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1647648 T6107 oasc.CoreContainer.load Host Name: 
   [junit4]   2> 1647652 T6111 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/'
   [junit4]   2> 1647654 T6111 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
   [junit4]   2> 1647654 T6111 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 1647654 T6111 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 1647708 T6111 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1647713 T6111 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-basic.xml
   [junit4]   2> 1647715 T6111 oass.IndexSchema.readSchema Reading Solr Schema from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema-minimal.xml
   [junit4]   2> 1647717 T6111 oass.IndexSchema.readSchema [collection1] Schema name=minimal
   [junit4]   2> 1647719 T6111 oass.IndexSchema.readSchema WARN no uniqueKey specified in schema.
   [junit4]   2> 1647720 T6111 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/
   [junit4]   2> 1647720 T6111 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 1647721 T6111 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/, dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/
   [junit4]   2> 1647721 T6111 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 1647722 T6111 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001
   [junit4]   2> 1647722 T6111 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/index/
   [junit4]   2> 1647725 T6111 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1647725 T6111 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1647725 T6111 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1647726 T6111 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1647726 T6111 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
   [junit4]   2> 1647726 T6111 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
   [junit4]   2> 1647727 T6111 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
   [junit4]   2> 1647727 T6111 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
   [junit4]   2> 1647727 T6111 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
   [junit4]   2> 1647728 T6111 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
   [junit4]   2> 1647729 T6111 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
   [junit4]   2> 1647729 T6111 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
   [junit4]   2> 1647729 T6111 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
   [junit4]   2> 1647730 T6111 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
   [junit4]   2> 1647730 T6111 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
   [junit4]   2> 1647730 T6111 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: org.apache.solr.handler.admin.ShowFileRequestHandler
   [junit4]   2> 1647731 T6111 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
   [junit4]   2> 1647731 T6111 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1647731 T6111 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1647733 T6111 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1647734 T6111 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1647736 T6111 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1647737 T6111 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1647759 T6111 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1647761 T6111 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1647765 T6111 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/index
   [junit4]   2> 1647776 T6111 oass.SolrIndexSearcher.<init> Opening Searcher@2ca8fa11[collection1] main
   [junit4]   2> 1647776 T6111 oasr.ManagedResourceStorage.newStorageIO WARN Cannot write to config directory /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
   [junit4]   2> 1647777 T6111 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1647777 T6111 oasr.ManagedResourceStorage.load Reading _rest_managed.json using InMemoryStorage
   [junit4]   2> 1647780 T6111 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
   [junit4]   2> 1647781 T6111 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using InMemoryStorage
   [junit4]   2> 1647781 T6111 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1647781 T6111 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 1647782 T6111 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1647782 T6112 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2ca8fa11[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):c1)))}
   [junit4]   2> 1647805 T6107 oas.SolrTestCaseJ4.initCore ####initCore end
   [junit4]   2> 1647806 T6107 oasc.TestNonNRTOpen.assertNotNRT Checking notNRT & maxDoc=1 of core=org.apache.solr.core.SolrCore@17d59dbd
   [junit4]   2> 1647810 T6107 oas.SolrTestCaseJ4.setUp ###Starting testSharedCores
   [junit4]   2> ASYNC  NEW_CORE C3834 name=collection1 org.apache.solr.core.SolrCore@17d59dbd
   [junit4]   2> 1647810 T6107 C3834 oasu.DirectUpdateHandler2.deleteAll [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 1647841 T6107 C3834 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/index,segFN=segments_2,generation=2}
   [junit4]   2> 1647841 T6107 C3834 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
   [junit4]   2> 1647842 T6107 C3834 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {deleteByQuery=*:*} 0 31
   [junit4]   2> 1647851 T6107 C3834 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[(null)]} 0 9
   [junit4]   2> 1647853 T6107 C3834 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1647892 T6107 C3834 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/index,segFN=segments_2,generation=2}
   [junit4]   2> 		commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/index,segFN=segments_3,generation=3}
   [junit4]   2> 1647893 T6107 C3834 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
   [junit4]   2> 1647899 T6107 C3834 oass.SolrIndexSearcher.<init> Opening Searcher@579540c8[collection1] main
   [junit4]   2> 1647900 T6112 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@579540c8[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_1(6.0.0):c1)))}
   [junit4]   2> 1647900 T6107 C3834 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 1647901 T6107 C3834 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 48
   [junit4]   2> 1647901 T6107 C3834 oasu.DirectUpdateHandler2.commit start commit{,optimize=true,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1647909 T6107 C3834 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 1647911 T6107 C3834 oasc.SolrCore.openNewSearcher SolrIndexSearcher has not changed - not re-opening: org.apache.solr.search.SolrIndexSearcher
   [junit4]   2> 1647911 T6107 C3834 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 1647912 T6107 C3834 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {optimize=} 0 11
   [junit4]   2> 1647915 T6107 C3834 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[(null)]} 0 2
   [junit4]   2> 1647916 T6107 C3834 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1647942 T6107 C3834 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/index,segFN=segments_3,generation=3}
   [junit4]   2> 		commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/index,segFN=segments_4,generation=4}
   [junit4]   2> 1647942 T6107 C3834 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
   [junit4]   2> 1647949 T6107 C3834 oass.SolrIndexSearcher.<init> Opening Searcher@4827fb49[collection1] main
   [junit4]   2> 1647949 T6107 C3834 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 1647949 T6112 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4827fb49[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_1(6.0.0):c1) Uninverting(_2(6.0.0):c1)))}
   [junit4]   2> 1647951 T6107 C3834 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 36
   [junit4]   2> 1647954 T6107 C3834 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[(null)]} 0 2
   [junit4]   2> 1647960 T6107 C3834 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[(null)]} 0 6
   [junit4]   2> 1647961 T6107 C3834 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1647992 T6107 C3834 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/index,segFN=segments_4,generation=4}
   [junit4]   2> 		commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/index,segFN=segments_5,generation=5}
   [junit4]   2> 1647992 T6107 C3834 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
   [junit4]   2> 1648000 T6107 C3834 oass.SolrIndexSearcher.<init> Opening Searcher@73001f1f[collection1] main
   [junit4]   2> 1648001 T6107 C3834 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 1648001 T6112 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@73001f1f[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_1(6.0.0):c1) Uninverting(_2(6.0.0):c1) Uninverting(_3(6.0.0):c2)))}
   [junit4]   2> 1648002 T6107 C3834 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 42
   [junit4]   2> 1648003 T6107 C3834 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {deleteByQuery=foo2:doc} 0 1
   [junit4]   2> 1648004 T6107 C3834 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1648015 T6107 C3834 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/index,segFN=segments_5,generation=5}
   [junit4]   2> 		commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/index,segFN=segments_6,generation=6}
   [junit4]   2> 1648015 T6107 C3834 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 6
   [junit4]   2> 1648026 T6107 C3834 oass.SolrIndexSearcher.<init> Opening Searcher@1ea7a713[collection1] main
   [junit4]   2> 1648027 T6112 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1ea7a713[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_1(6.0.0):c1) Uninverting(_2(6.0.0):c1) Uninverting(_3(6.0.0):c2/1:delGen=1)))}
   [junit4]   2> 1648027 T6107 C3834 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 1648027 T6107 C3834 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 23
   [junit4]   2> 1648029 T6107 oas.SolrTestCaseJ4.tearDown ###Ending testSharedCores
   [junit4]   2> 1648039 T6107 oas.SolrTestCaseJ4.setUp ###Starting testReaderIsNotNRT
   [junit4]   2> 1648040 T6107 C3834 oasu.DirectUpdateHandler2.deleteAll [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 1648040 T6107 C3834 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {deleteByQuery=*:*} 0 1
   [junit4]   2> 1648042 T6107 C3834 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[(null)]} 0 2
   [junit4]   2> 1648043 T6107 C3834 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1648082 T6107 C3834 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/index,segFN=segments_6,generation=6}
   [junit4]   2> 		commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/index,segFN=segments_7,generation=7}
   [junit4]   2> 1648082 T6107 C3834 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 7
   [junit4]   2> 1648088 T6107 C3834 oass.SolrIndexSearcher.<init> Opening Searcher@27e6815b[collection1] main
   [junit4]   2> 1648089 T6107 C3834 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 1648089 T6112 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@27e6815b[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_4(6.0.0):c1)))}
   [junit4]   2> 1648092 T6107 C3834 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 49
   [junit4]   2> 1648092 T6107 oasc.TestNonNRTOpen.assertNotNRT Checking notNRT & maxDoc=1 of core=org.apache.solr.core.SolrCore@17d59dbd
   [junit4]   2> 1648093 T6107 oasc.TestNonNRTOpen.testReaderIsNotNRT Reloading core: org.apache.solr.core.SolrCore@17d59dbd
   [junit4]   2> 1648093 T6107 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/'
   [junit4]   2> 1648095 T6107 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
   [junit4]   2> 1648095 T6107 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 1648096 T6107 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 1648199 T6107 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1648204 T6107 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-basic.xml
   [junit4]   2> 1648205 T6107 oass.IndexSchema.readSchema Reading Solr Schema from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema-minimal.xml
   [junit4]   2> 1648208 T6107 oass.IndexSchema.readSchema [collection1] Schema name=minimal
   [junit4]   2> 1648216 T6107 oass.IndexSchema.readSchema WARN no uniqueKey specified in schema.
   [junit4]   2> 1648219 T6107 oasc.CoreContainer.reload Reloading SolrCore 'collection1' using configuration from instancedir /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/
   [junit4]   2> 1648220 T6107 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/, dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/
   [junit4]   2> 1648221 T6107 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 1648221 T6107 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/index/
   [junit4]   2> 1648222 T6107 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1648223 T6107 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1648223 T6107 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1648227 T6107 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1648228 T6107 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
   [junit4]   2> 1648230 T6107 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
   [junit4]   2> 1648230 T6107 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
   [junit4]   2> 1648231 T6107 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
   [junit4]   2> 1648232 T6107 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
   [junit4]   2> 1648233 T6107 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
   [junit4]   2> 1648233 T6107 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
   [junit4]   2> 1648233 T6107 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
   [junit4]   2> 1648234 T6107 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
   [junit4]   2> 1648237 T6107 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
   [junit4]   2> 1648239 T6107 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
   [junit4]   2> 1648240 T6107 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: org.apache.solr.handler.admin.ShowFileRequestHandler
   [junit4]   2> 1648241 T6107 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
   [junit4]   2> 1648241 T6107 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1648242 T6107 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1648255 T6107 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1648259 T6107 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1648264 T6107 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1648265 T6107 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1648268 T6107 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1648271 T6107 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1648274 T6107 oass.SolrIndexSearcher.<init> Opening Searcher@d43d8cb[collection1] main
   [junit4]   2> 1648275 T6107 oasr.ManagedResourceStorage.newStorageIO WARN Cannot write to config directory /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
   [junit4]   2> 1648275 T6107 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1648278 T6107 oasr.ManagedResourceStorage.load Reading _rest_managed.json using InMemoryStorage
   [junit4]   2> 1648280 T6107 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
   [junit4]   2> 1648281 T6107 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using InMemoryStorage
   [junit4]   2> 1648282 T6107 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1648284 T6107 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 1648284 T6114 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@d43d8cb[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_4(6.0.0):c1)))}
   [junit4]   2> 1648285 T6107 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
   [junit4]   2> 1648285 T6107 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
   [junit4]   2> 1648285 T6107 oasu.DefaultSolrCoreState.newIndexWriter Closing old IndexWriter... core=collection1
   [junit4]   2> 1648291 T6107 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/index,segFN=segments_7,generation=7}
   [junit4]   2> 1648291 T6107 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 7
   [junit4]   2> 1648291 T6107 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
   [junit4]   2> 1648294 T6107 oasc.SolrCore.openNewSearcher SolrIndexSearcher has not changed - not re-opening: org.apache.solr.search.SolrIndexSearcher
   [junit4]   2> 1648294 T6107 oasc.CoreContainer.registerCore replacing core: collection1
   [junit4]   2> 1648295 T6107 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@17d59dbd
   [junit4]   2> 1648295 T6107 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=5,autocommits=0,soft autocommits=0,optimizes=1,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=5,cumulative_deletesById=0,cumulative_deletesByQuery=3,cumulative_errors=0}
   [junit4]   2> 1648296 T6107 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 1648296 T6107 oasc.TestNonNRTOpen.assertNotNRT Checking notNRT & maxDoc=1 of core=org.apache.solr.core.SolrCore@5036a3dc
   [junit4]   2> ASYNC  NEW_CORE C3835 name=collection1 org.apache.solr.core.SolrCore@5036a3dc
   [junit4]   2> 1648298 T6107 C3835 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[(null)]} 0 2
   [junit4]   2> 1648299 T6107 C3835 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1648330 T6107 C3835 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/index,segFN=segments_7,generation=7}
   [junit4]   2> 		commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/index,segFN=segments_8,generation=8}
   [junit4]   2> 1648331 T6107 C3835 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 8
   [junit4]   2> 1648338 T6107 C3835 oass.SolrIndexSearcher.<init> Opening Searcher@10e14914[collection1] main
   [junit4]   2> 1648339 T6107 C3835 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 1648339 T6114 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@10e14914[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_4(6.0.0):c1) Uninverting(_5(6.0.0):c1)))}
   [junit4]   2> 1648339 T6107 C3835 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {commit=} 0 40
   [junit4]   2> 1648340 T6107 oasc.TestNonNRTOpen.assertNotNRT Checking notNRT & maxDoc=2 of core=org.apache.solr.core.SolrCore@5036a3dc
   [junit4]   2> 1648341 T6107 C3835 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {add=[(null)]} 0 1
   [junit4]   2> 1648342 T6107 oasc.TestNonNRTOpen.testReaderIsNotNRT Reloading core: org.apache.solr.core.SolrCore@5036a3dc
   [junit4]   2> 1648343 T6107 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/'
   [junit4]   2> 1648343 T6107 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
   [junit4]   2> 1648344 T6107 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 1648344 T6107 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 1648382 T6107 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1648386 T6107 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-basic.xml
   [junit4]   2> 1648393 T6107 oass.IndexSchema.readSchema Reading Solr Schema from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema-minimal.xml
   [junit4]   2> 1648396 T6107 oass.IndexSchema.readSchema [collection1] Schema name=minimal
   [junit4]   2> 1648403 T6107 oass.IndexSchema.readSchema WARN no uniqueKey specified in schema.
   [junit4]   2> 1648405 T6107 oasc.CoreContainer.reload Reloading SolrCore 'collection1' using configuration from instancedir /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/
   [junit4]   2> 1648408 T6107 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/, dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/
   [junit4]   2> 1648410 T6107 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 1648413 T6107 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/index/
   [junit4]   2> 1648414 T6107 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1648414 T6107 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1648415 T6107 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1648415 T6107 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1648415 T6107 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
   [junit4]   2> 1648416 T6107 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
   [junit4]   2> 1648417 T6107 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
   [junit4]   2> 1648417 T6107 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
   [junit4]   2> 1648417 T6107 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
   [junit4]   2> 1649372 T6107 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
   [junit4]   2> 1649373 T6107 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
   [junit4]   2> 1649375 T6107 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
   [junit4]   2> 1649376 T6107 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
   [junit4]   2> 1649376 T6107 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
   [junit4]   2> 1649377 T6107 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
   [junit4]   2> 1649378 T6107 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: org.apache.solr.handler.admin.ShowFileRequestHandler
   [junit4]   2> 1649379 T6107 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
   [junit4]   2> 1649380 T6107 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1649382 T6107 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1649385 T6107 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1649389 T6107 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1649395 T6107 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1649400 T6107 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1649402 T6107 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1649402 T6107 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1649407 T6107 oass.SolrIndexSearcher.<init> Opening Searcher@b964093[collection1] main
   [junit4]   2> 1649407 T6107 oasr.ManagedResourceStorage.newStorageIO WARN Cannot write to config directory /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
   [junit4]   2> 1649407 T6107 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1649408 T6107 oasr.ManagedResourceStorage.load Reading _rest_managed.json using InMemoryStorage
   [junit4]   2> 1649409 T6107 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
   [junit4]   2> 1649409 T6107 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using InMemoryStorage
   [junit4]   2> 1649409 T6107 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1649410 T6107 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 1649411 T6107 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
   [junit4]   2> 1649412 T6107 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
   [junit4]   2> 1649412 T6107 oasu.DefaultSolrCoreState.newIndexWriter Closing old IndexWriter... core=collection1
   [junit4]   2> 1649411 T6115 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@b964093[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_4(6.0.0):c1) Uninverting(_5(6.0.0):c1)))}
   [junit4]   2> 1649440 T6107 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/index,segFN=segments_8,generation=8}
   [junit4]   2> 		commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/index,segFN=segments_9,generation=9}
   [junit4]   2> 1649441 T6107 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 9
   [junit4]   2> 1649450 T6107 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/index,segFN=segments_9,generation=9}
   [junit4]   2> 1649451 T6107 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 9
   [junit4]   2> 1649451 T6107 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
   [junit4]   2> 1649458 T6107 oass.SolrIndexSearcher.<init> Opening Searcher@68cffbdd[collection1] main
   [junit4]   2> 1649459 T6107 oasc.CoreContainer.registerCore replacing core: collection1
   [junit4]   2> 1649459 T6107 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@5036a3dc
   [junit4]   2> 1649460 T6107 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=1,adds=1,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=2,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 1649460 T6107 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 1649461 T6107 oasc.TestNonNRTOpen.assertNotNRT Checking notNRT & maxDoc=3 of core=org.apache.solr.core.SolrCore@727a96f3
   [junit4]   2> 1649461 T6115 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@68cffbdd[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_4(6.0.0):c1) Uninverting(_5(6.0.0):c1) Uninverting(_6(6.0.0):c1)))}
   [junit4]   2> 1649462 T6107 oas.SolrTestCaseJ4.tearDown ###Ending testReaderIsNotNRT
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestNonNRTOpen -Dtests.method=testReaderIsNotNRT -Dtests.seed=58CCD45428F40E1F -Dtests.slow=true -Dtests.locale=es_US -Dtests.timezone=Europe/San_Marino -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] FAILURE 1.44s | TestNonNRTOpen.testReaderIsNotNRT <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: SOLR-5815? : wrong maxDoc: core=org.apache.solr.core.SolrCore@727a96f3 searcher=Searcher@b964093[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_4(6.0.0):c1) Uninverting(_5(6.0.0):c1)))} expected:<3> but was:<2>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([58CCD45428F40E1F:ED4AB5D39735BCEB]:0)
   [junit4]    > 	at org.apache.solr.core.TestNonNRTOpen.assertNotNRT(TestNonNRTOpen.java:142)
   [junit4]    > 	at org.apache.solr.core.TestNonNRTOpen.testReaderIsNotNRT(TestNonNRTOpen.java:100)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1649473 T6107 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 1649474 T6107 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1144670506
   [junit4]   2> 1649474 T6107 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@727a96f3
   [junit4]   2> 1649475 T6107 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 1649475 T6107 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 1649475 T6107 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 1649476 T6107 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 1649477 T6107 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 1649478 T6107 oasc.CachingDirectoryFactory.close Closing StandardDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 1649478 T6107 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001 [CachedDir<<refCount=0;path=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001;done=false>>]
   [junit4]   2> 1649478 T6107 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001
   [junit4]   2> 1649479 T6107 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/index [CachedDir<<refCount=0;path=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/index;done=false>>]
   [junit4]   2> 1649479 T6107 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001/init-core-data-001/index
   [junit4]   2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestNonNRTOpen-58CCD45428F40E1F-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene50): {bazz=BlockTreeOrds(blocksize=128), foo=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), baz=BlockTreeOrds(blocksize=128), foo2=PostingsFormat(name=Direct)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=es_US, timezone=Europe/San_Marino
   [junit4]   2> NOTE: Mac OS X 10.8.5 x86_64/Oracle Corporation 1.8.0_20 (64-bit)/cpus=2,threads=1,free=39685936,total=173592576
   [junit4]   2> NOTE: All tests run in this JVM: [TestLFUCache, LegacyHTMLStripCharFilterTest, BlockCacheTest, SpellingQueryConverterTest, DistanceFunctionTest, TestSolrIndexConfig, TestZkChroot, TestFastLRUCache, TestSolrQueryParser, XmlUpdateRequestHandlerTest, MultiTermTest, TestDynamicFieldCollectionResource, DeleteInactiveReplicaTest, CachingDirectoryFactoryTest, SimpleMLTQParserTest, TestStressVersions, DistributedSpellCheckComponentTest, TestCloudManagedSchemaConcurrent, DistributedIntervalFacetingTest, TestReloadAndDeleteDocs, TestSchemaVersionResource, TestSolrXmlPersistor, TestFreeTextSuggestions, TestSolrDeletionPolicy1, TestLazyCores, TestManagedStopFilterFactory, TestPseudoReturnFields, ChaosMonkeySafeLeaderTest, ResourceLoaderTest, SystemInfoHandlerTest, CursorPagingTest, TestManagedSchemaFieldTypeResource, TestTrie, SpellCheckCollatorTest, TestReRankQParserPlugin, TestPHPSerializedResponseWriter, TestManagedResourceStorage, MergeStrategyTest, HdfsRecoveryZkTest, TestFaceting, TestComponentsName, TestWriterPerf, QueryResultKeyTest, TestDocumentBuilder, DocValuesMultiTest, TestBulkSchemaConcurrent, TestIntervalFaceting, TestRestManager, PeerSyncTest, DistributedFacetPivotSmallTest, TestRecoveryHdfs, UnloadDistributedZkTest, TestCharFilters, PrimitiveFieldTypeTest, DistributedSuggestComponentTest, AutoCommitTest, MoreLikeThisHandlerTest, TestReload, TestNonNRTOpen]
   [junit4] Completed in 2.32s, 2 tests, 1 failure <<< FAILURES!

[...truncated 1231 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:519: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:467: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:61: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/extra-targets.xml:39: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:187: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:510: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1349: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:956: There were test failures: 453 suites, 1850 tests, 1 failure, 37 ignored (21 assumptions)

Total time: 173 minutes 46 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC (asserts: true)
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



Re: [JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.8.0) - Build # 2008 - Still Failing!

Posted by Noble Paul <no...@gmail.com>.
Yeah it is.

The data propagation is taking time. I need to fix the tests

On Sun, Dec 21, 2014 at 10:15 PM, Shalin Shekhar Mangar <
shalinmangar@gmail.com> wrote:
>
> This is probably related to SOLR-6787
>
> On Sun, Dec 21, 2014 at 4:23 PM, Policeman Jenkins Server <
> jenkins@thetaphi.de> wrote:
>
>> Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/2008/
>> Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseParallelGC (asserts:
>> true)
>>
>> 1 tests failed.
>> FAILED:  org.apache.solr.core.TestDynamicLoading.testDistribSearch
>>
>> Error Message:
>> {   "responseHeader":{     "status":404,     "QTime":14},   "error":{
>>  "msg":"no such blob or version available: test/1",     "code":404}}
>> expected:<org.apache.solr.core.BlobStoreTestRequestHandler> but was:<null>
>>
>> Stack Trace:
>> java.lang.AssertionError: {
>>   "responseHeader":{
>>     "status":404,
>>     "QTime":14},
>>   "error":{
>>     "msg":"no such blob or version available: test/1",
>>     "code":404}}
>> expected:<org.apache.solr.core.BlobStoreTestRequestHandler> but was:<null>
>>         at
>> __randomizedtesting.SeedInfo.seed([CC8AD89B44D0A93D:4D6C5683338FC901]:0)
>>         at org.junit.Assert.fail(Assert.java:93)
>>         at org.junit.Assert.failNotEquals(Assert.java:647)
>>         at org.junit.Assert.assertEquals(Assert.java:128)
>>         at
>> org.apache.solr.core.TestDynamicLoading.dynamicLoading(TestDynamicLoading.java:101)
>>         at
>> org.apache.solr.core.TestDynamicLoading.doTest(TestDynamicLoading.java:64)
>>         at
>> org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
>>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>         at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>>         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>         at java.lang.reflect.Method.invoke(Method.java:483)
>>         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
>>         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
>>         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
>>         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
>>         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>>         at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>>         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>>         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>>         at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
>>         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
>>         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>>         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>>         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
>>         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
>>         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
>>         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
>>         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
>>         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
>>         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
>>         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>>         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>>         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>>         at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>>         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>>         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>>         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>>         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>>         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>>         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>>         at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
>>         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>>         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
>>         at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>>         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>>         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
>>         at java.lang.Thread.run(Thread.java:745)
>>
>>
>>
>>
>> Build Log:
>> [...truncated 8743 lines...]
>>    [junit4] Suite: org.apache.solr.core.TestDynamicLoading
>>    [junit4]   2> Creating dataDir:
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/init-core-data-001
>>    [junit4]   2> 837229 T2316 oas.SolrTestCaseJ4.buildSSLConfig
>> Randomized ssl (false) and clientAuth (false)
>>    [junit4]   2> 837230 T2316
>> oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext
>> system property: /
>>    [junit4]   2> 837237 T2316 oas.SolrTestCaseJ4.setUp ###Starting
>> testDistribSearch
>>    [junit4]   2> 837239 T2316 oasc.ZkTestServer.run STARTING ZK TEST
>> SERVER
>>    [junit4]   1> client port:0.0.0.0/0.0.0.0:0
>>    [junit4]   2> 837240 T2317
>> oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
>>    [junit4]   2> 837341 T2316 oasc.ZkTestServer.run start zk server on
>> port:49854
>>    [junit4]   2> 837345 T2316
>> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
>> ZkCredentialsProvider
>>    [junit4]   2> 837348 T2316 oascc.ConnectionManager.waitForConnected
>> Waiting for client to connect to ZooKeeper
>>    [junit4]   2> 837355 T2324 oascc.ConnectionManager.process Watcher
>> org.apache.solr.common.cloud.ConnectionManager@6e4d3d31
>> name:ZooKeeperConnection Watcher:127.0.0.1:49854 got event WatchedEvent
>> state:SyncConnected type:None path:null path:null type:None
>>    [junit4]   2> 837355 T2316 oascc.ConnectionManager.waitForConnected
>> Client is connected to ZooKeeper
>>    [junit4]   2> 837355 T2316 oascc.SolrZkClient.createZkACLProvider
>> Using default ZkACLProvider
>>    [junit4]   2> 837356 T2316 oascc.SolrZkClient.makePath makePath: /solr
>>    [junit4]   2> 837365 T2316
>> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
>> ZkCredentialsProvider
>>    [junit4]   2> 837366 T2316 oascc.ConnectionManager.waitForConnected
>> Waiting for client to connect to ZooKeeper
>>    [junit4]   2> 837370 T2327 oascc.ConnectionManager.process Watcher
>> org.apache.solr.common.cloud.ConnectionManager@36723d68
>> name:ZooKeeperConnection Watcher:127.0.0.1:49854/solr got event
>> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>>    [junit4]   2> 837370 T2316 oascc.ConnectionManager.waitForConnected
>> Client is connected to ZooKeeper
>>    [junit4]   2> 837370 T2316 oascc.SolrZkClient.createZkACLProvider
>> Using default ZkACLProvider
>>    [junit4]   2> 837371 T2316 oascc.SolrZkClient.makePath makePath:
>> /collections/collection1
>>    [junit4]   2> 837378 T2316 oascc.SolrZkClient.makePath makePath:
>> /collections/collection1/shards
>>    [junit4]   2> 837385 T2316 oascc.SolrZkClient.makePath makePath:
>> /collections/control_collection
>>    [junit4]   2> 837389 T2316 oascc.SolrZkClient.makePath makePath:
>> /collections/control_collection/shards
>>    [junit4]   2> 837396 T2316 oasc.AbstractZkTestCase.putConfig put
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
>> to /configs/conf1/solrconfig.xml
>>    [junit4]   2> 837397 T2316 oascc.SolrZkClient.makePath makePath:
>> /configs/conf1/solrconfig.xml
>>    [junit4]   2> 837404 T2316 oasc.AbstractZkTestCase.putConfig put
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema.xml
>> to /configs/conf1/schema.xml
>>    [junit4]   2> 837405 T2316 oascc.SolrZkClient.makePath makePath:
>> /configs/conf1/schema.xml
>>    [junit4]   2> 837412 T2316 oasc.AbstractZkTestCase.putConfig put
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
>> to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
>>    [junit4]   2> 837413 T2316 oascc.SolrZkClient.makePath makePath:
>> /configs/conf1/solrconfig.snippet.randomindexconfig.xml
>>    [junit4]   2> 837423 T2316 oasc.AbstractZkTestCase.putConfig put
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
>> to /configs/conf1/stopwords.txt
>>    [junit4]   2> 837423 T2316 oascc.SolrZkClient.makePath makePath:
>> /configs/conf1/stopwords.txt
>>    [junit4]   2> 837429 T2316 oasc.AbstractZkTestCase.putConfig put
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt
>> to /configs/conf1/protwords.txt
>>    [junit4]   2> 837430 T2316 oascc.SolrZkClient.makePath makePath:
>> /configs/conf1/protwords.txt
>>    [junit4]   2> 837436 T2316 oasc.AbstractZkTestCase.putConfig put
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml
>> to /configs/conf1/currency.xml
>>    [junit4]   2> 837437 T2316 oascc.SolrZkClient.makePath makePath:
>> /configs/conf1/currency.xml
>>    [junit4]   2> 837443 T2316 oasc.AbstractZkTestCase.putConfig put
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
>> to /configs/conf1/enumsConfig.xml
>>    [junit4]   2> 837444 T2316 oascc.SolrZkClient.makePath makePath:
>> /configs/conf1/enumsConfig.xml
>>    [junit4]   2> 837450 T2316 oasc.AbstractZkTestCase.putConfig put
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
>> to /configs/conf1/open-exchange-rates.json
>>    [junit4]   2> 837451 T2316 oascc.SolrZkClient.makePath makePath:
>> /configs/conf1/open-exchange-rates.json
>>    [junit4]   2> 837457 T2316 oasc.AbstractZkTestCase.putConfig put
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
>> to /configs/conf1/mapping-ISOLatin1Accent.txt
>>    [junit4]   2> 837458 T2316 oascc.SolrZkClient.makePath makePath:
>> /configs/conf1/mapping-ISOLatin1Accent.txt
>>    [junit4]   2> 837463 T2316 oasc.AbstractZkTestCase.putConfig put
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
>> to /configs/conf1/old_synonyms.txt
>>    [junit4]   2> 837463 T2316 oascc.SolrZkClient.makePath makePath:
>> /configs/conf1/old_synonyms.txt
>>    [junit4]   2> 837469 T2316 oasc.AbstractZkTestCase.putConfig put
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
>> to /configs/conf1/synonyms.txt
>>    [junit4]   2> 837469 T2316 oascc.SolrZkClient.makePath makePath:
>> /configs/conf1/synonyms.txt
>>    [junit4]   2> 839165 T2316 oejs.Server.doStart jetty-8.1.10.v20130312
>>    [junit4]   2> 839174 T2316 oejs.AbstractConnector.doStart Started
>> SelectChannelConnector@127.0.0.1:49857
>>    [junit4]   2> 839175 T2316 oass.SolrDispatchFilter.init
>> SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
>>    [junit4]   2> 839176 T2316 oasc.SolrResourceLoader.locateSolrHome JNDI
>> not configured for solr (NoInitialContextEx)
>>    [junit4]   2> 839176 T2316 oasc.SolrResourceLoader.locateSolrHome
>> using system property solr.solr.home:
>> ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002
>>    [junit4]   2> 839177 T2316 oasc.SolrResourceLoader.<init> new
>> SolrResourceLoader for directory:
>> '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/'
>>    [junit4]   2> 839217 T2316 oasc.ConfigSolr.fromFile Loading container
>> configuration from
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/solr.xml
>>    [junit4]   2> 839240 T2316 oasc.CoreContainer.<init> New CoreContainer
>> 1028334353
>>    [junit4]   2> 839240 T2316 oasc.CoreContainer.load Loading cores into
>> CoreContainer
>> [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/]
>>    [junit4]   2> 839241 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting socketTimeout to: 90000
>>    [junit4]   2> 839241 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting urlScheme to:
>>    [junit4]   2> 839241 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting connTimeout to: 15000
>>    [junit4]   2> 839241 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting maxConnectionsPerHost to: 20
>>    [junit4]   2> 839242 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting maxConnections to: 10000
>>    [junit4]   2> 839242 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting corePoolSize to: 0
>>    [junit4]   2> 839242 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting maximumPoolSize to: 2147483647
>>    [junit4]   2> 839243 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting maxThreadIdleTime to: 5
>>    [junit4]   2> 839243 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting sizeOfQueue to: -1
>>    [junit4]   2> 839243 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting fairnessPolicy to: false
>>    [junit4]   2> 839243 T2316 oasu.UpdateShardHandler.<init> Creating
>> UpdateShardHandler HTTP client with params:
>> socketTimeout=340000&connTimeout=45000&retry=false
>>    [junit4]   2> 839244 T2316 oasl.LogWatcher.createWatcher SLF4J impl is
>> org.slf4j.impl.Log4jLoggerFactory
>>    [junit4]   2> 839245 T2316 oasl.LogWatcher.newRegisteredLogWatcher
>> Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>>    [junit4]   2> 839245 T2316 oasc.CoreContainer.load Host Name: 127.0.0.1
>>    [junit4]   2> 839245 T2316 oasc.ZkContainer.initZooKeeper Zookeeper
>> client=127.0.0.1:49854/solr
>>    [junit4]   2> 839246 T2316 oasc.ZkController.checkChrootPath zkHost
>> includes chroot
>>    [junit4]   2> 839246 T2316
>> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
>> ZkCredentialsProvider
>>    [junit4]   2> 839248 T2316 oascc.ConnectionManager.waitForConnected
>> Waiting for client to connect to ZooKeeper
>>    [junit4]   2> 839253 T2339 oascc.ConnectionManager.process Watcher
>> org.apache.solr.common.cloud.ConnectionManager@12e5b223
>> name:ZooKeeperConnection Watcher:127.0.0.1:49854 got event WatchedEvent
>> state:SyncConnected type:None path:null path:null type:None
>>    [junit4]   2> 839254 T2316 oascc.ConnectionManager.waitForConnected
>> Client is connected to ZooKeeper
>>    [junit4]   2> 839255 T2316 oascc.SolrZkClient.createZkACLProvider
>> Using default ZkACLProvider
>>    [junit4]   2> 839260 T2316 oascc.ConnectionManager.waitForConnected
>> Waiting for client to connect to ZooKeeper
>>    [junit4]   2> 839263 T2342 oascc.ConnectionManager.process Watcher
>> org.apache.solr.common.cloud.ConnectionManager@6406c22
>> name:ZooKeeperConnection Watcher:127.0.0.1:49854/solr got event
>> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>>    [junit4]   2> 839264 T2316 oascc.ConnectionManager.waitForConnected
>> Client is connected to ZooKeeper
>>    [junit4]   2> 839265 T2316 oascc.SolrZkClient.makePath makePath:
>> /overseer/queue
>>    [junit4]   2> 839273 T2316 oascc.SolrZkClient.makePath makePath:
>> /overseer/collection-queue-work
>>    [junit4]   2> 839280 T2316 oascc.SolrZkClient.makePath makePath:
>> /overseer/collection-map-running
>>    [junit4]   2> 839288 T2316 oascc.SolrZkClient.makePath makePath:
>> /overseer/collection-map-completed
>>    [junit4]   2> 839294 T2316 oascc.SolrZkClient.makePath makePath:
>> /overseer/collection-map-failure
>>    [junit4]   2> 839302 T2316 oascc.SolrZkClient.makePath makePath:
>> /live_nodes
>>    [junit4]   2> 839304 T2316 oasc.ZkController.createEphemeralLiveNode
>> Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49857_
>>    [junit4]   2> 839305 T2316 oascc.SolrZkClient.makePath makePath:
>> /live_nodes/127.0.0.1:49857_
>>    [junit4]   2> 839311 T2316 oascc.SolrZkClient.makePath makePath:
>> /overseer_elect
>>    [junit4]   2> 839313 T2316 oascc.SolrZkClient.makePath makePath:
>> /overseer_elect/election
>>    [junit4]   2> 839317 T2316 oasc.Overseer.close Overseer (id=null)
>> closing
>>    [junit4]   2> 839322 T2316
>> oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader
>> 127.0.0.1:49857_
>>    [junit4]   2> 839323 T2316 oascc.SolrZkClient.makePath makePath:
>> /overseer_elect/leader
>>    [junit4]   2> 839328 T2316 oasc.Overseer.start Overseer
>> (id=93006854147866627-127.0.0.1:49857_-n_0000000000) starting
>>    [junit4]   2> 839332 T2316 oascc.SolrZkClient.makePath makePath:
>> /overseer/queue-work
>>    [junit4]   2> 839351 T2316
>> oasc.OverseerAutoReplicaFailoverThread.<init> Starting
>> OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000
>> autoReplicaFailoverWaitAfterExpiration=30000
>> autoReplicaFailoverBadNodeExpiration=60000
>>    [junit4]   2> 839353 T2344 oasc.OverseerCollectionProcessor.run
>> Process current queue of collection creations
>>    [junit4]   2> 839355 T2316 oascc.SolrZkClient.makePath makePath:
>> /clusterstate.json
>>    [junit4]   2> 839361 T2316 oascc.SolrZkClient.makePath makePath:
>> /aliases.json
>>    [junit4]   2> 839364 T2316
>> oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster
>> state from ZooKeeper...
>>    [junit4]   2> 839375 T2343 oasc.Overseer$ClusterStateUpdater.run
>> Starting to work on the main queue
>>    [junit4]   2> 839383 T2346 oasc.ZkController.publish publishing
>> core=collection1 state=down collection=control_collection
>>    [junit4]   2> 839383 T2346 oasc.ZkController.publish numShards not
>> found on descriptor - reading it from system property
>>    [junit4]   2> 839385 T2346 oasc.ZkController.waitForCoreNodeName look
>> for our core node name
>>    [junit4]   2> 839385 T2342 oasc.DistributedQueue$LatchWatcher.process
>> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>>    [junit4]   2> 839392 T2343 oasc.Overseer$ClusterStateUpdater.run
>> processMessage: queueSize: 0, message = {
>>    [junit4]   2>          "core":"collection1",
>>    [junit4]   2>          "roles":null,
>>    [junit4]   2>          "base_url":"http://127.0.0.1:49857",
>>    [junit4]   2>          "node_name":"127.0.0.1:49857_",
>>    [junit4]   2>          "numShards":"1",
>>    [junit4]   2>          "state":"down",
>>    [junit4]   2>          "shard":null,
>>    [junit4]   2>          "collection":"control_collection",
>>    [junit4]   2>          "operation":"state"} current state version: 0
>>    [junit4]   2> 839393 T2343 oasco.ReplicaMutator.updateState Update
>> state numShards=1 message={
>>    [junit4]   2>          "core":"collection1",
>>    [junit4]   2>          "roles":null,
>>    [junit4]   2>          "base_url":"http://127.0.0.1:49857",
>>    [junit4]   2>          "node_name":"127.0.0.1:49857_",
>>    [junit4]   2>          "numShards":"1",
>>    [junit4]   2>          "state":"down",
>>    [junit4]   2>          "shard":null,
>>    [junit4]   2>          "collection":"control_collection",
>>    [junit4]   2>          "operation":"state"}
>>    [junit4]   2> 839393 T2343 oasco.ClusterStateMutator.createCollection
>> building a new cName: control_collection
>>    [junit4]   2> 839394 T2343 oasco.ReplicaMutator.updateState Assigning
>> new node to shard shard=shard1
>>    [junit4]   2> 839395 T2342 oascc.ZkStateReader$2.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>>    [junit4]   2> 840387 T2346 oasc.ZkController.waitForShardId waiting to
>> find shard id in clusterstate for collection1
>>    [junit4]   2> 840387 T2346 oasc.ZkController.createCollectionZkNode
>> Check for collection zkNode:control_collection
>>    [junit4]   2> 840389 T2346 oasc.ZkController.createCollectionZkNode
>> Collection zkNode exists
>>    [junit4]   2> 840389 T2346 oascc.ZkStateReader.readConfigName Load
>> collection config from:/collections/control_collection
>>    [junit4]   2> 840395 T2346 oascc.ZkStateReader.readConfigName
>> path=/collections/control_collection configName=conf1 specified config
>> exists in ZooKeeper
>>    [junit4]   2> 840395 T2346 oasc.SolrResourceLoader.<init> new
>> SolrResourceLoader for directory:
>> '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/collection1/'
>>    [junit4]   2> 840397 T2346 oasc.SolrResourceLoader.replaceClassLoader
>> Adding
>> 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/collection1/lib/.svn/'
>> to classloader
>>    [junit4]   2> 840398 T2346 oasc.SolrResourceLoader.replaceClassLoader
>> Adding
>> 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/collection1/lib/classes/'
>> to classloader
>>    [junit4]   2> 840399 T2346 oasc.SolrResourceLoader.replaceClassLoader
>> Adding
>> 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/collection1/lib/README'
>> to classloader
>>    [junit4]   2> 840444 T2346 oasc.ZkController.watchZKConfDir watch
>> zkdir /configs/conf1
>>    [junit4]   2> 840450 T2346 oasc.Config.<init> loaded config
>> solrconfig.xml with version 0
>>    [junit4]   2> 840469 T2346 oasc.SolrConfig.<init> Using Lucene
>> MatchVersion: 6.0.0
>>    [junit4]   2> 840481 T2346 oasc.SolrConfig.<init> Loaded SolrConfig:
>> solrconfig.xml
>>    [junit4]   2> 840486 T2346 oass.IndexSchema.readSchema Reading Solr
>> Schema from /configs/conf1/schema.xml
>>    [junit4]   2> 840494 T2346 oass.IndexSchema.readSchema [collection1]
>> Schema name=test
>>    [junit4]   2> 840630 T2346 oass.OpenExchangeRatesOrgProvider.init
>> Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
>>    [junit4]   2> 840644 T2346 oass.IndexSchema.readSchema default search
>> field in schema is text
>>    [junit4]   2> 840647 T2346 oass.IndexSchema.readSchema unique key
>> field: id
>>    [junit4]   2> 840690 T2346 oass.FileExchangeRateProvider.reload
>> Reloading exchange rates from file currency.xml
>>    [junit4]   2> 840694 T2346 oass.FileExchangeRateProvider.reload
>> Reloading exchange rates from file currency.xml
>>    [junit4]   2> 840699 T2346 oass.OpenExchangeRatesOrgProvider.reload
>> Reloading exchange rates from open-exchange-rates.json
>>    [junit4]   2> 840702 T2346
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
>> IMPORTANT NOTE
>>    [junit4]   2> 840703 T2346
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
>> key, got STRING
>>    [junit4]   2> 840703 T2346 oass.OpenExchangeRatesOrgProvider.reload
>> Reloading exchange rates from open-exchange-rates.json
>>    [junit4]   2> 840706 T2346
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
>> IMPORTANT NOTE
>>    [junit4]   2> 840706 T2346
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
>> key, got STRING
>>    [junit4]   2> 840706 T2346 oasc.CoreContainer.create Creating SolrCore
>> 'collection1' using configuration from collection control_collection
>>    [junit4]   2> 840707 T2346 oasc.SolrCore.initDirectoryFactory
>> org.apache.solr.core.MockDirectoryFactory
>>    [junit4]   2> 840707 T2346 oasc.SolrCore.<init> [collection1] Opening
>> new SolrCore at
>> ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/collection1/,
>> dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/control/data/
>>    [junit4]   2> 840707 T2346 oasc.JmxMonitoredMap.<init> JMX monitoring
>> is enabled. Adding Solr mbeans to JMX Server:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@2fb2b6a6
>>    [junit4]   2> 840708 T2346 oasc.CachingDirectoryFactory.get return new
>> directory for
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/control/data
>>    [junit4]   2> 840708 T2346 oasc.SolrCore.getNewIndexDir New index
>> directory detected: old=null
>> new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/control/data/index/
>>    [junit4]   2> 840709 T2346 oasc.SolrCore.initIndex WARN [collection1]
>> Solr index directory
>> '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/control/data/index'
>> doesn't exist. Creating new index...
>>    [junit4]   2> 840709 T2346 oasc.CachingDirectoryFactory.get return new
>> directory for
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/control/data/index
>>    [junit4]   2> 840710 T2346 oasu.RandomMergePolicy.<init>
>> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy:
>> [LogDocMergePolicy: minMergeSize=1000, mergeFactor=24,
>> maxMergeSize=9223372036854775807,
>> maxMergeSizeForForcedMerge=9223372036854775807,
>> calibrateSizeByDeletes=false, maxMergeDocs=2147483647,
>> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
>>    [junit4]   2> 840710 T2346 oasc.SolrDeletionPolicy.onCommit
>> SolrDeletionPolicy.onCommit: commits: num=1
>>    [junit4]   2>
>> commit{dir=MockDirectoryWrapper(RAMDirectory@4625a372
>> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3a8a04e8
>> ),segFN=segments_1,generation=1}
>>    [junit4]   2> 840711 T2346 oasc.SolrDeletionPolicy.updateCommits
>> newest commit generation = 1
>>    [junit4]   2> 840717 T2346 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "nodistrib"
>>    [junit4]   2> 840717 T2346 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "dedupe"
>>    [junit4]   2> 840718 T2346 oasup.UpdateRequestProcessorChain.init
>> inserting DistributedUpdateProcessorFactory into
>> updateRequestProcessorChain "dedupe"
>>    [junit4]   2> 840718 T2346 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "stored_sig"
>>    [junit4]   2> 840718 T2346 oasup.UpdateRequestProcessorChain.init
>> inserting DistributedUpdateProcessorFactory into
>> updateRequestProcessorChain "stored_sig"
>>    [junit4]   2> 840718 T2346 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
>>    [junit4]   2> 840720 T2346 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>>    [junit4]   2> 840720 T2346 oasup.UpdateRequestProcessorChain.init
>> inserting DistributedUpdateProcessorFactory into
>> updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>>    [junit4]   2> 840720 T2346 oasc.SolrCore.loadUpdateProcessorChains no
>> updateRequestProcessorChain defined as default, creating implicit default
>>    [junit4]   2> 840721 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created /update: org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 840721 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created /update/json: org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 840722 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created /update/csv: org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 840723 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 840724 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created /config: org.apache.solr.handler.SolrConfigHandler
>>    [junit4]   2> 840724 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created /schema: org.apache.solr.handler.SchemaHandler
>>    [junit4]   2> 840725 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created /replication: org.apache.solr.handler.ReplicationHandler
>>    [junit4]   2> 840726 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created /get: org.apache.solr.handler.RealTimeGetHandler
>>    [junit4]   2> 840727 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
>>    [junit4]   2> 840728 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
>>    [junit4]   2> 840729 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
>>    [junit4]   2> 840730 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
>>    [junit4]   2> 840730 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
>>    [junit4]   2> 840731 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/properties:
>> org.apache.solr.handler.admin.PropertiesRequestHandler
>>    [junit4]   2> 840732 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
>>    [junit4]   2> 840733 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/ping: org.apache.solr.handler.PingRequestHandler
>>    [junit4]   2> 840733 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created standard: solr.StandardRequestHandler
>>    [junit4]   2> 840734 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/file: solr.admin.ShowFileRequestHandler
>>    [junit4]   2> 840734 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/fileedit: solr.admin.EditFileRequestHandler
>>    [junit4]   2> 840747 T2346 oashl.XMLLoader.init
>> xsltCacheLifetimeSeconds=60
>>    [junit4]   2> 840749 T2346 oashl.XMLLoader.init
>> xsltCacheLifetimeSeconds=60
>>    [junit4]   2> 840750 T2346 oashl.XMLLoader.init
>> xsltCacheLifetimeSeconds=60
>>    [junit4]   2> 840752 T2346 oashl.XMLLoader.init
>> xsltCacheLifetimeSeconds=60
>>    [junit4]   2> 840757 T2346 oasu.CommitTracker.<init> Hard AutoCommit:
>> disabled
>>    [junit4]   2> 840758 T2346 oasu.CommitTracker.<init> Soft AutoCommit:
>> disabled
>>    [junit4]   2> 840758 T2346 oasu.RandomMergePolicy.<init>
>> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy:
>> [LogDocMergePolicy: minMergeSize=1000, mergeFactor=12,
>> maxMergeSize=9223372036854775807,
>> maxMergeSizeForForcedMerge=9223372036854775807,
>> calibrateSizeByDeletes=true, maxMergeDocs=2147483647,
>> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
>>    [junit4]   2> 840759 T2346 oasc.SolrDeletionPolicy.onInit
>> SolrDeletionPolicy.onInit: commits: num=1
>>    [junit4]   2>
>> commit{dir=MockDirectoryWrapper(RAMDirectory@4625a372
>> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3a8a04e8
>> ),segFN=segments_1,generation=1}
>>    [junit4]   2> 840759 T2346 oasc.SolrDeletionPolicy.updateCommits
>> newest commit generation = 1
>>    [junit4]   2> 840760 T2346 oass.SolrIndexSearcher.<init> Opening
>> Searcher@4de3bbc[collection1] main
>>    [junit4]   2> 840760 T2346 oascc.ZkStateReader.readConfigName Load
>> collection config from:/collections/control_collection
>>    [junit4]   2> 840763 T2346 oascc.ZkStateReader.readConfigName
>> path=/collections/control_collection configName=conf1 specified config
>> exists in ZooKeeper
>>    [junit4]   2> 840763 T2346 oasr.ManagedResourceStorage.newStorageIO
>> Setting up ZooKeeper-based storage for the RestManager with znodeBase:
>> /configs/conf1
>>    [junit4]   2> 840764 T2346
>> oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured
>> ZooKeeperStorageIO with znodeBase: /configs/conf1
>>    [junit4]   2> 840765 T2346 oasr.RestManager.init Initializing
>> RestManager with initArgs: {}
>>    [junit4]   2> 840765 T2346 oasr.ManagedResourceStorage.load Reading
>> _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
>>    [junit4]   2> 840768 T2346
>> oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data
>> found for znode /configs/conf1/_rest_managed.json
>>    [junit4]   2> 840768 T2346 oasr.ManagedResourceStorage.load Loaded
>> null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
>>    [junit4]   2> 840770 T2346 oascc.SolrZkClient.makePath makePath:
>> /configs/conf1/_rest_managed.json
>>    [junit4]   2> 840776 T2346
>> oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to
>> new znode /configs/conf1/_rest_managed.json
>>    [junit4]   2> 840776 T2346
>> oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path
>> _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
>>    [junit4]   2> 840776 T2346 oasr.RestManager.init Initializing 0
>> registered ManagedResources
>>    [junit4]   2> 840776 T2346 oash.ReplicationHandler.inform Commits will
>> be reserved for  10000
>>    [junit4]   2> 840778 T2347 oasc.SolrCore.registerSearcher
>> [collection1] Registered new searcher Searcher@4de3bbc[collection1]
>> main{ExitableDirectoryReader(UninvertingDirectoryReader())}
>>    [junit4]   2> 840779 T2346 oasc.CoreContainer.registerCore registering
>> core: collection1
>>    [junit4]   2> 840782 T2350 oasc.ZkController.register Register replica
>> - core:collection1 address:http://127.0.0.1:49857
>> collection:control_collection shard:shard1
>>    [junit4]   2> 840782 T2316 oass.SolrDispatchFilter.init
>> user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
>>    [junit4]   2> 840783 T2316 oass.SolrDispatchFilter.init
>> SolrDispatchFilter.init() done
>>    [junit4]   2> 840783 T2316
>> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
>> ZkCredentialsProvider
>>    [junit4]   2> 840785 T2316 oascc.ConnectionManager.waitForConnected
>> Waiting for client to connect to ZooKeeper
>>    [junit4]   2> 840793 T2353 oascc.ConnectionManager.process Watcher
>> org.apache.solr.common.cloud.ConnectionManager@7d66f1d9
>> name:ZooKeeperConnection Watcher:127.0.0.1:49854/solr got event
>> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>>    [junit4]   2> 840793 T2316 oascc.ConnectionManager.waitForConnected
>> Client is connected to ZooKeeper
>>    [junit4]   2> 840794 T2316 oascc.SolrZkClient.createZkACLProvider
>> Using default ZkACLProvider
>>    [junit4]   2> 840796 T2316
>> oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster
>> state from ZooKeeper...
>>    [junit4]   2> 840798 T2350 oascc.SolrZkClient.makePath makePath:
>> /collections/control_collection/leader_elect/shard1/election
>>    [junit4]   2> 840805 T2316 oasc.ChaosMonkey.monkeyLog monkey: init -
>> expire sessions:false cause connection loss:false
>>    [junit4]   2> 840805 T2316
>> oasc.AbstractFullDistribZkTestBase.createJettys Creating collection1 with
>> stateFormat=2
>>    [junit4]   2> 840807 T2316
>> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
>> ZkCredentialsProvider
>>    [junit4]   2> 840811 T2316 oascc.ConnectionManager.waitForConnected
>> Waiting for client to connect to ZooKeeper
>>    [junit4]   2> 840816 T2356 oascc.ConnectionManager.process Watcher
>> org.apache.solr.common.cloud.ConnectionManager@4d205ac9
>> name:ZooKeeperConnection Watcher:127.0.0.1:49854/solr got event
>> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>>    [junit4]   2> 840817 T2316 oascc.ConnectionManager.waitForConnected
>> Client is connected to ZooKeeper
>>    [junit4]   2> 840817 T2316 oascc.SolrZkClient.createZkACLProvider
>> Using default ZkACLProvider
>>    [junit4]   2> 840824 T2342 oasc.DistributedQueue$LatchWatcher.process
>> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>>    [junit4]   2> 840845 T2343 oasc.Overseer$ClusterStateUpdater.run
>> processMessage: queueSize: 1, message = {
>>    [junit4]   2>          "operation":"create",
>>    [junit4]   2>          "name":"collection1",
>>    [junit4]   2>          "numShards":"2",
>>    [junit4]   2>          "stateFormat":2} current state version: 1
>>    [junit4]   2> 840845 T2343 oasco.ClusterStateMutator.createCollection
>> building a new cName: collection1
>>    [junit4]   2> 840860 T2350
>> oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process
>> for shard shard1
>>    [junit4]   2> 840879 T2350
>> oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas
>> found to continue.
>>    [junit4]   2> 840880 T2350
>> oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader -
>> try and sync
>>    [junit4]   2> ASYNC  NEW_CORE C1382 name=collection1
>> org.apache.solr.core.SolrCore@755e68c7 url=
>> http://127.0.0.1:49857/collection1 node=127.0.0.1:49857_
>> C1382_STATE=coll:control_collection core:collection1
>> props:{core=collection1, base_url=http://127.0.0.1:49857,
>> node_name=127.0.0.1:49857_, state=down}
>>    [junit4]   2> 840880 T2350 C1382 P49857 oasc.SyncStrategy.sync Sync
>> replicas to http://127.0.0.1:49857/collection1/
>>    [junit4]   2> 840881 T2350 C1382 P49857 oasc.SyncStrategy.syncReplicas
>> Sync Success - now sync replicas to me
>>    [junit4]   2> 840881 T2350 C1382 P49857 oasc.SyncStrategy.syncToMe
>> http://127.0.0.1:49857/collection1/ has no replicas
>>    [junit4]   2> 840881 T2350
>> oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader:
>> http://127.0.0.1:49857/collection1/ shard1
>>    [junit4]   2> 840881 T2350 oascc.SolrZkClient.makePath makePath:
>> /collections/control_collection/leaders/shard1
>>    [junit4]   2> 840884 T2343 oasc.Overseer$ClusterStateUpdater.run
>> processMessage: queueSize: 1, message = {
>>    [junit4]   2>          "operation":"leader",
>>    [junit4]   2>          "shard":"shard1",
>>    [junit4]   2>          "collection":"control_collection"} current
>> state version: 1
>>    [junit4]   2> 840890 T2343 oasco.ZkStateWriter.writePendingUpdates
>> going to create_collection /collections/collection1/state.json
>>    [junit4]   2> 840897 T2353 oascc.ZkStateReader$2.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>>    [junit4]   2> 840897 T2342 oascc.ZkStateReader$2.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>>    [junit4]   2> 840915 T2357 oasc.DistributedQueue$LatchWatcher.process
>> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>>    [junit4]   2> 840933 T2343 oasc.Overseer$ClusterStateUpdater.run
>> processMessage: queueSize: 1, message = {
>>    [junit4]   2>          "operation":"leader",
>>    [junit4]   2>          "shard":"shard1",
>>    [junit4]   2>          "collection":"control_collection",
>>    [junit4]   2>          "base_url":"http://127.0.0.1:49857",
>>    [junit4]   2>          "core":"collection1",
>>    [junit4]   2>          "state":"active"} current state version: 2
>>    [junit4]   2> 840947 T2357 oasc.DistributedQueue$LatchWatcher.process
>> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>>    [junit4]   2> 841053 T2353 oascc.ZkStateReader$2.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>>    [junit4]   2> 841127 T2350 oasc.ZkController.register We are
>> http://127.0.0.1:49857/collection1/ and leader is
>> http://127.0.0.1:49857/collection1/
>>    [junit4]   2> 841127 T2350 oasc.ZkController.register No LogReplay
>> needed for core=collection1 baseURL=http://127.0.0.1:49857
>>    [junit4]   2> 841127 T2350 oasc.ZkController.checkRecovery I am the
>> leader, no recovery necessary
>>    [junit4]   2> 841130 T2350 oasc.ZkController.publish publishing
>> core=collection1 state=active collection=control_collection
>>    [junit4]   2> 841132 T2350 oasc.ZkController.publish numShards not
>> found on descriptor - reading it from system property
>>    [junit4]   2> 841139 T2342 oasc.DistributedQueue$LatchWatcher.process
>> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>>    [junit4]   2> 841156 T2343 oasc.Overseer$ClusterStateUpdater.run
>> processMessage: queueSize: 1, message = {
>>    [junit4]   2>          "core":"collection1",
>>    [junit4]   2>          "core_node_name":"core_node1",
>>    [junit4]   2>          "roles":null,
>>    [junit4]   2>          "base_url":"http://127.0.0.1:49857",
>>    [junit4]   2>          "node_name":"127.0.0.1:49857_",
>>    [junit4]   2>          "numShards":"2",
>>    [junit4]   2>          "state":"active",
>>    [junit4]   2>          "shard":"shard1",
>>    [junit4]   2>          "collection":"control_collection",
>>    [junit4]   2>          "operation":"state"} current state version: 3
>>    [junit4]   2> 841159 T2343 oasco.ReplicaMutator.updateState Update
>> state numShards=2 message={
>>    [junit4]   2>          "core":"collection1",
>>    [junit4]   2>          "core_node_name":"core_node1",
>>    [junit4]   2>          "roles":null,
>>    [junit4]   2>          "base_url":"http://127.0.0.1:49857",
>>    [junit4]   2>          "node_name":"127.0.0.1:49857_",
>>    [junit4]   2>          "numShards":"2",
>>    [junit4]   2>          "state":"active",
>>    [junit4]   2>          "shard":"shard1",
>>    [junit4]   2>          "collection":"control_collection",
>>    [junit4]   2>          "operation":"state"}
>>    [junit4]   2> 841276 T2353 oascc.ZkStateReader$2.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>>    [junit4]   2> 841276 T2342 oascc.ZkStateReader$2.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>>    [junit4]   2> 842764 T2316
>> oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
>>    [junit4]   2> 842765 T2316 oejs.Server.doStart jetty-8.1.10.v20130312
>>    [junit4]   2> 842771 T2316 oejs.AbstractConnector.doStart Started
>> SelectChannelConnector@127.0.0.1:49862
>>    [junit4]   2> 842772 T2316 oass.SolrDispatchFilter.init
>> SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
>>    [junit4]   2> 842772 T2316 oasc.SolrResourceLoader.locateSolrHome JNDI
>> not configured for solr (NoInitialContextEx)
>>    [junit4]   2> 842772 T2316 oasc.SolrResourceLoader.locateSolrHome
>> using system property solr.solr.home:
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003
>>    [junit4]   2> 842773 T2316 oasc.SolrResourceLoader.<init> new
>> SolrResourceLoader for directory:
>> '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/'
>>    [junit4]   2> 842810 T2316 oasc.ConfigSolr.fromFile Loading container
>> configuration from
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/solr.xml
>>    [junit4]   2> 842829 T2316 oasc.CoreContainer.<init> New CoreContainer
>> 335265571
>>    [junit4]   2> 842829 T2316 oasc.CoreContainer.load Loading cores into
>> CoreContainer
>> [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/]
>>    [junit4]   2> 842830 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting socketTimeout to: 90000
>>    [junit4]   2> 842830 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting urlScheme to:
>>    [junit4]   2> 842830 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting connTimeout to: 15000
>>    [junit4]   2> 842831 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting maxConnectionsPerHost to: 20
>>    [junit4]   2> 842831 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting maxConnections to: 10000
>>    [junit4]   2> 842832 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting corePoolSize to: 0
>>    [junit4]   2> 842832 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting maximumPoolSize to: 2147483647
>>    [junit4]   2> 842832 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting maxThreadIdleTime to: 5
>>    [junit4]   2> 842833 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting sizeOfQueue to: -1
>>    [junit4]   2> 842834 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting fairnessPolicy to: false
>>    [junit4]   2> 842835 T2316 oasu.UpdateShardHandler.<init> Creating
>> UpdateShardHandler HTTP client with params:
>> socketTimeout=340000&connTimeout=45000&retry=false
>>    [junit4]   2> 842836 T2316 oasl.LogWatcher.createWatcher SLF4J impl is
>> org.slf4j.impl.Log4jLoggerFactory
>>    [junit4]   2> 842836 T2316 oasl.LogWatcher.newRegisteredLogWatcher
>> Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>>    [junit4]   2> 842837 T2316 oasc.CoreContainer.load Host Name: 127.0.0.1
>>    [junit4]   2> 842837 T2316 oasc.ZkContainer.initZooKeeper Zookeeper
>> client=127.0.0.1:49854/solr
>>    [junit4]   2> 842837 T2316 oasc.ZkController.checkChrootPath zkHost
>> includes chroot
>>    [junit4]   2> 842838 T2316
>> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
>> ZkCredentialsProvider
>>    [junit4]   2> 842839 T2316 oascc.ConnectionManager.waitForConnected
>> Waiting for client to connect to ZooKeeper
>>    [junit4]   2> 842844 T2369 oascc.ConnectionManager.process Watcher
>> org.apache.solr.common.cloud.ConnectionManager@7f590f35
>> name:ZooKeeperConnection Watcher:127.0.0.1:49854 got event WatchedEvent
>> state:SyncConnected type:None path:null path:null type:None
>>    [junit4]   2> 842845 T2316 oascc.ConnectionManager.waitForConnected
>> Client is connected to ZooKeeper
>>    [junit4]   2> 842846 T2316 oascc.SolrZkClient.createZkACLProvider
>> Using default ZkACLProvider
>>    [junit4]   2> 842852 T2316 oascc.ConnectionManager.waitForConnected
>> Waiting for client to connect to ZooKeeper
>>    [junit4]   2> 842859 T2372 oascc.ConnectionManager.process Watcher
>> org.apache.solr.common.cloud.ConnectionManager@634dd196
>> name:ZooKeeperConnection Watcher:127.0.0.1:49854/solr got event
>> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>>    [junit4]   2> 842859 T2316 oascc.ConnectionManager.waitForConnected
>> Client is connected to ZooKeeper
>>    [junit4]   2> 842884 T2316
>> oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster
>> state from ZooKeeper...
>>    [junit4]   2> 843905 T2316 oasc.ZkController.createEphemeralLiveNode
>> Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49862_
>>    [junit4]   2> 843907 T2316 oascc.SolrZkClient.makePath makePath:
>> /live_nodes/127.0.0.1:49862_
>>    [junit4]   2> 843919 T2316 oasc.Overseer.close Overseer (id=null)
>> closing
>>    [junit4]   2> 843934 T2373 oasc.ZkController.publish publishing
>> core=collection1 state=down collection=collection1
>>    [junit4]   2> 843934 T2373 oasc.ZkController.publish numShards not
>> found on descriptor - reading it from system property
>>    [junit4]   2> 843941 T2342 oasc.DistributedQueue$LatchWatcher.process
>> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>>    [junit4]   2> 843941 T2373 oasc.ZkController.preRegister Registering
>> watch for external collection collection1
>>    [junit4]   2> 843944 T2373 oascc.ZkStateReader.addZkWatch addZkWatch
>> collection1
>>    [junit4]   2> 843943 T2343 oasc.Overseer$ClusterStateUpdater.run
>> processMessage: queueSize: 1, message = {
>>    [junit4]   2>          "core":"collection1",
>>    [junit4]   2>          "roles":null,
>>    [junit4]   2>          "base_url":"http://127.0.0.1:49862",
>>    [junit4]   2>          "node_name":"127.0.0.1:49862_",
>>    [junit4]   2>          "numShards":"2",
>>    [junit4]   2>          "state":"down",
>>    [junit4]   2>          "shard":null,
>>    [junit4]   2>          "collection":"collection1",
>>    [junit4]   2>          "operation":"state"} current state version: 4
>>    [junit4]   2> 843945 T2373 oascc.ZkStateReader.addZkWatch Updating
>> collection state at /collections/collection1/state.json from ZooKeeper...
>>    [junit4]   2> 843946 T2343 oasco.ReplicaMutator.updateState Update
>> state numShards=2 message={
>>    [junit4]   2>          "core":"collection1",
>>    [junit4]   2>          "roles":null,
>>    [junit4]   2>          "base_url":"http://127.0.0.1:49862",
>>    [junit4]   2>          "node_name":"127.0.0.1:49862_",
>>    [junit4]   2>          "numShards":"2",
>>    [junit4]   2>          "state":"down",
>>    [junit4]   2>          "shard":null,
>>    [junit4]   2>          "collection":"collection1",
>>    [junit4]   2>          "operation":"state"}
>>    [junit4]   2> 843947 T2343 oasco.ReplicaMutator.updateState Collection
>> already exists with numShards=2
>>    [junit4]   2> 843947 T2343 oasco.ReplicaMutator.updateState Assigning
>> new node to shard shard=shard2
>>    [junit4]   2> 843950 T2373 oascc.ZkStateReader.updateWatchedCollection
>> Updating data for collection1 to ver 0
>>    [junit4]   2> 843950 T2373 oasc.ZkController.waitForCoreNodeName look
>> for our core node name
>>    [junit4]   2> 843952 T2343 oasco.ZkStateWriter.writePendingUpdates
>> going to update_collection /collections/collection1/state.json version: 0
>>    [junit4]   2> 843953 T2372 oascc.ZkStateReader$7.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/collections/collection1/state.json, has occurred - updating...
>>    [junit4]   2> 843955 T2372 oascc.ZkStateReader.updateWatchedCollection
>> Updating data for collection1 to ver 1
>>    [junit4]   2> 844953 T2373 oasc.ZkController.waitForShardId waiting to
>> find shard id in clusterstate for collection1
>>    [junit4]   2> 844954 T2373 oasc.ZkController.createCollectionZkNode
>> Check for collection zkNode:collection1
>>    [junit4]   2> 844957 T2373 oasc.ZkController.createCollectionZkNode
>> Collection zkNode exists
>>    [junit4]   2> 844957 T2373 oascc.ZkStateReader.readConfigName Load
>> collection config from:/collections/collection1
>>    [junit4]   2> 844964 T2373 oascc.ZkStateReader.readConfigName
>> path=/collections/collection1 configName=conf1 specified config exists in
>> ZooKeeper
>>    [junit4]   2> 844965 T2373 oasc.SolrResourceLoader.<init> new
>> SolrResourceLoader for directory:
>> '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/collection1/'
>>    [junit4]   2> 844967 T2373 oasc.SolrResourceLoader.replaceClassLoader
>> Adding
>> 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/collection1/lib/.svn/'
>> to classloader
>>    [junit4]   2> 844968 T2373 oasc.SolrResourceLoader.replaceClassLoader
>> Adding
>> 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/collection1/lib/classes/'
>> to classloader
>>    [junit4]   2> 844969 T2373 oasc.SolrResourceLoader.replaceClassLoader
>> Adding
>> 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/collection1/lib/README'
>> to classloader
>>    [junit4]   2> 845009 T2373 oasc.ZkController.watchZKConfDir watch
>> zkdir /configs/conf1
>>    [junit4]   2> 845015 T2373 oasc.Config.<init> loaded config
>> solrconfig.xml with version 0
>>    [junit4]   2> 845033 T2373 oasc.SolrConfig.<init> Using Lucene
>> MatchVersion: 6.0.0
>>    [junit4]   2> 845046 T2373 oasc.SolrConfig.<init> Loaded SolrConfig:
>> solrconfig.xml
>>    [junit4]   2> 845049 T2373 oass.IndexSchema.readSchema Reading Solr
>> Schema from /configs/conf1/schema.xml
>>    [junit4]   2> 845056 T2373 oass.IndexSchema.readSchema [collection1]
>> Schema name=test
>>    [junit4]   2> 845191 T2373 oass.OpenExchangeRatesOrgProvider.init
>> Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
>>    [junit4]   2> 845206 T2373 oass.IndexSchema.readSchema default search
>> field in schema is text
>>    [junit4]   2> 845207 T2373 oass.IndexSchema.readSchema unique key
>> field: id
>>    [junit4]   2> 845244 T2373 oass.FileExchangeRateProvider.reload
>> Reloading exchange rates from file currency.xml
>>    [junit4]   2> 845249 T2373 oass.FileExchangeRateProvider.reload
>> Reloading exchange rates from file currency.xml
>>    [junit4]   2> 845253 T2373 oass.OpenExchangeRatesOrgProvider.reload
>> Reloading exchange rates from open-exchange-rates.json
>>    [junit4]   2> 845256 T2373
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
>> IMPORTANT NOTE
>>    [junit4]   2> 845258 T2373
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
>> key, got STRING
>>    [junit4]   2> 845258 T2373 oass.OpenExchangeRatesOrgProvider.reload
>> Reloading exchange rates from open-exchange-rates.json
>>    [junit4]   2> 845262 T2373
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
>> IMPORTANT NOTE
>>    [junit4]   2> 845262 T2373
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
>> key, got STRING
>>    [junit4]   2> 845263 T2373 oasc.CoreContainer.create Creating SolrCore
>> 'collection1' using configuration from collection collection1
>>    [junit4]   2> 845263 T2373 oasc.SolrCore.initDirectoryFactory
>> org.apache.solr.core.MockDirectoryFactory
>>    [junit4]   2> 845263 T2373 oasc.SolrCore.<init> [collection1] Opening
>> new SolrCore at
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/collection1/,
>> dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty1/
>>    [junit4]   2> 845264 T2373 oasc.JmxMonitoredMap.<init> JMX monitoring
>> is enabled. Adding Solr mbeans to JMX Server:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@2fb2b6a6
>>    [junit4]   2> 845264 T2373 oasc.CachingDirectoryFactory.get return new
>> directory for
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty1
>>    [junit4]   2> 845265 T2373 oasc.SolrCore.getNewIndexDir New index
>> directory detected: old=null
>> new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty1/index/
>>    [junit4]   2> 845265 T2373 oasc.SolrCore.initIndex WARN [collection1]
>> Solr index directory
>> '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty1/index'
>> doesn't exist. Creating new index...
>>    [junit4]   2> 845265 T2373 oasc.CachingDirectoryFactory.get return new
>> directory for
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty1/index
>>    [junit4]   2> 845266 T2373 oasu.RandomMergePolicy.<init>
>> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy:
>> [LogDocMergePolicy: minMergeSize=1000, mergeFactor=24,
>> maxMergeSize=9223372036854775807,
>> maxMergeSizeForForcedMerge=9223372036854775807,
>> calibrateSizeByDeletes=false, maxMergeDocs=2147483647,
>> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
>>    [junit4]   2> 845267 T2373 oasc.SolrDeletionPolicy.onCommit
>> SolrDeletionPolicy.onCommit: commits: num=1
>>    [junit4]   2>
>> commit{dir=MockDirectoryWrapper(RAMDirectory@2fb05928
>> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@19766ec3
>> ),segFN=segments_1,generation=1}
>>    [junit4]   2> 845267 T2373 oasc.SolrDeletionPolicy.updateCommits
>> newest commit generation = 1
>>    [junit4]   2> 845273 T2373 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "nodistrib"
>>    [junit4]   2> 845273 T2373 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "dedupe"
>>    [junit4]   2> 845274 T2373 oasup.UpdateRequestProcessorChain.init
>> inserting DistributedUpdateProcessorFactory into
>> updateRequestProcessorChain "dedupe"
>>    [junit4]   2> 845274 T2373 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "stored_sig"
>>    [junit4]   2> 845274 T2373 oasup.UpdateRequestProcessorChain.init
>> inserting DistributedUpdateProcessorFactory into
>> updateRequestProcessorChain "stored_sig"
>>    [junit4]   2> 845274 T2373 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
>>    [junit4]   2> 845275 T2373 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>>    [junit4]   2> 845275 T2373 oasup.UpdateRequestProcessorChain.init
>> inserting DistributedUpdateProcessorFactory into
>> updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>>    [junit4]   2> 845275 T2373 oasc.SolrCore.loadUpdateProcessorChains no
>> updateRequestProcessorChain defined as default, creating implicit default
>>    [junit4]   2> 845276 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created /update: org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 845276 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created /update/json: org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 845277 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created /update/csv: org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 845277 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 845278 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created /config: org.apache.solr.handler.SolrConfigHandler
>>    [junit4]   2> 845278 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created /schema: org.apache.solr.handler.SchemaHandler
>>    [junit4]   2> 845280 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created /replication: org.apache.solr.handler.ReplicationHandler
>>    [junit4]   2> 845280 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created /get: org.apache.solr.handler.RealTimeGetHandler
>>    [junit4]   2> 845281 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
>>    [junit4]   2> 845285 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
>>    [junit4]   2> 845286 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
>>    [junit4]   2> 845286 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
>>    [junit4]   2> 845287 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
>>    [junit4]   2> 845287 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/properties:
>> org.apache.solr.handler.admin.PropertiesRequestHandler
>>    [junit4]   2> 845287 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
>>    [junit4]   2> 845288 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/ping: org.apache.solr.handler.PingRequestHandler
>>    [junit4]   2> 845288 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created standard: solr.StandardRequestHandler
>>    [junit4]   2> 845289 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/file: solr.admin.ShowFileRequestHandler
>>    [junit4]   2> 845289 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/fileedit: solr.admin.EditFileRequestHandler
>>    [junit4]   2> 845296 T2373 oashl.XMLLoader.init
>> xsltCacheLifetimeSeconds=60
>>    [junit4]   2> 845297 T2373 oashl.XMLLoader.init
>> xsltCacheLifetimeSeconds=60
>>    [junit4]   2> 845298 T2373 oashl.XMLLoader.init
>> xsltCacheLifetimeSeconds=60
>>    [junit4]   2> 845299 T2373 oashl.XMLLoader.init
>> xsltCacheLifetimeSeconds=60
>>    [junit4]   2> 845301 T2373 oasu.CommitTracker.<init> Hard AutoCommit:
>> disabled
>>    [junit4]   2> 845302 T2373 oasu.CommitTracker.<init> Soft AutoCommit:
>> disabled
>>    [junit4]   2> 845303 T2373 oasu.RandomMergePolicy.<init>
>> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy:
>> [LogDocMergePolicy: minMergeSize=1000, mergeFactor=12,
>> maxMergeSize=9223372036854775807,
>> maxMergeSizeForForcedMerge=9223372036854775807,
>> calibrateSizeByDeletes=true, maxMergeDocs=2147483647,
>> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
>>    [junit4]   2> 845304 T2373 oasc.SolrDeletionPolicy.onInit
>> SolrDeletionPolicy.onInit: commits: num=1
>>    [junit4]   2>
>> commit{dir=MockDirectoryWrapper(RAMDirectory@2fb05928
>> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@19766ec3
>> ),segFN=segments_1,generation=1}
>>    [junit4]   2> 845304 T2373 oasc.SolrDeletionPolicy.updateCommits
>> newest commit generation = 1
>>    [junit4]   2> 845304 T2373 oass.SolrIndexSearcher.<init> Opening
>> Searcher@1466a306[collection1] main
>>    [junit4]   2> 845305 T2373 oascc.ZkStateReader.readConfigName Load
>> collection config from:/collections/collection1
>>    [junit4]   2> 845307 T2373 oascc.ZkStateReader.readConfigName
>> path=/collections/collection1 configName=conf1 specified config exists in
>> ZooKeeper
>>    [junit4]   2> 845308 T2373 oasr.ManagedResourceStorage.newStorageIO
>> Setting up ZooKeeper-based storage for the RestManager with znodeBase:
>> /configs/conf1
>>    [junit4]   2> 845309 T2373
>> oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured
>> ZooKeeperStorageIO with znodeBase: /configs/conf1
>>    [junit4]   2> 845309 T2373 oasr.RestManager.init Initializing
>> RestManager with initArgs: {}
>>    [junit4]   2> 845309 T2373 oasr.ManagedResourceStorage.load Reading
>> _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
>>    [junit4]   2> 845313 T2373
>> oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38
>> bytes from znode /configs/conf1/_rest_managed.json
>>    [junit4]   2> 845313 T2373 oasr.ManagedResourceStorage.load Loaded
>> LinkedHashMap at path _rest_managed.json using
>> ZooKeeperStorageIO:path=/configs/conf1
>>    [junit4]   2> 845313 T2373 oasr.ManagedResource.reloadFromStorage
>> Loaded initArgs {} for /rest/managed
>>    [junit4]   2> 845314 T2373 oasr.RestManager.init Initializing 0
>> registered ManagedResources
>>    [junit4]   2> 845314 T2373 oash.ReplicationHandler.inform Commits will
>> be reserved for  10000
>>    [junit4]   2> 845315 T2374 oasc.SolrCore.registerSearcher
>> [collection1] Registered new searcher Searcher@1466a306[collection1]
>> main{ExitableDirectoryReader(UninvertingDirectoryReader())}
>>    [junit4]   2> 845315 T2373 oasc.CoreContainer.registerCore registering
>> core: collection1
>>    [junit4]   2> 845317 T2377 oasc.ZkController.register Register replica
>> - core:collection1 address:http://127.0.0.1:49862 collection:collection1
>> shard:shard2
>>    [junit4]   2> 845318 T2316 oass.SolrDispatchFilter.init
>> user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
>>    [junit4]   2> 845319 T2316 oass.SolrDispatchFilter.init
>> SolrDispatchFilter.init() done
>>    [junit4]   2> 845320 T2377 oascc.SolrZkClient.makePath makePath:
>> /collections/collection1/leader_elect/shard2/election
>>    [junit4]   2> 845338 T2377
>> oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process
>> for shard shard2
>>    [junit4]   2> 845345 T2342 oasc.DistributedQueue$LatchWatcher.process
>> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>>    [junit4]   2> 845347 T2377
>> oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas
>> found to continue.
>>    [junit4]   2> 845347 T2377
>> oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader -
>> try and sync
>>    [junit4]   2> ASYNC  NEW_CORE C1383 name=collection1
>> org.apache.solr.core.SolrCore@2dc8d5fa url=
>> http://127.0.0.1:49862/collection1 node=127.0.0.1:49862_
>> C1383_STATE=coll:collection1 core:collection1 props:{core=collection1,
>> base_url=http://127.0.0.1:49862, node_name=127.0.0.1:49862_, state=down}
>>    [junit4]   2> 845347 T2377 C1383 P49862 oasc.SyncStrategy.sync Sync
>> replicas to http://127.0.0.1:49862/collection1/
>>    [junit4]   2> 845348 T2377 C1383 P49862 oasc.SyncStrategy.syncReplicas
>> Sync Success - now sync replicas to me
>>    [junit4]   2> 845348 T2377 C1383 P49862 oasc.SyncStrategy.syncToMe
>> http://127.0.0.1:49862/collection1/ has no replicas
>>    [junit4]   2> 845348 T2377
>> oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader:
>> http://127.0.0.1:49862/collection1/ shard2
>>    [junit4]   2> 845348 T2377 oascc.SolrZkClient.makePath makePath:
>> /collections/collection1/leaders/shard2
>>    [junit4]   2> 845349 T2343 oasc.Overseer$ClusterStateUpdater.run
>> processMessage: queueSize: 1, message = {
>>    [junit4]   2>          "operation":"leader",
>>    [junit4]   2>          "shard":"shard2",
>>    [junit4]   2>          "collection":"collection1"} current state
>> version: 4
>>    [junit4]   2> 845357 T2343 oasco.ZkStateWriter.writePendingUpdates
>> going to update_collection /collections/collection1/state.json version: 1
>>    [junit4]   2> 845361 T2372 oascc.ZkStateReader$7.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/collections/collection1/state.json, has occurred - updating...
>>    [junit4]   2> 845364 T2372 oascc.ZkStateReader.updateWatchedCollection
>> Updating data for collection1 to ver 2
>>    [junit4]   2> 845390 T2342 oasc.DistributedQueue$LatchWatcher.process
>> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>>    [junit4]   2> 845393 T2343 oasc.Overseer$ClusterStateUpdater.run
>> processMessage: queueSize: 1, message = {
>>    [junit4]   2>          "operation":"leader",
>>    [junit4]   2>          "shard":"shard2",
>>    [junit4]   2>          "collection":"collection1",
>>    [junit4]   2>          "base_url":"http://127.0.0.1:49862",
>>    [junit4]   2>          "core":"collection1",
>>    [junit4]   2>          "state":"active"} current state version: 4
>>    [junit4]   2> 845396 T2343 oasco.ZkStateWriter.writePendingUpdates
>> going to update_collection /collections/collection1/state.json version: 2
>>    [junit4]   2> 845397 T2372 oascc.ZkStateReader$7.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/collections/collection1/state.json, has occurred - updating...
>>    [junit4]   2> 845401 T2372 oascc.ZkStateReader.updateWatchedCollection
>> Updating data for collection1 to ver 3
>>    [junit4]   2> 845446 T2377 oasc.ZkController.register We are
>> http://127.0.0.1:49862/collection1/ and leader is
>> http://127.0.0.1:49862/collection1/
>>    [junit4]   2> 845446 T2377 oasc.ZkController.register No LogReplay
>> needed for core=collection1 baseURL=http://127.0.0.1:49862
>>    [junit4]   2> 845447 T2377 oasc.ZkController.checkRecovery I am the
>> leader, no recovery necessary
>>    [junit4]   2> 845447 T2377 oasc.ZkController.publish publishing
>> core=collection1 state=active collection=collection1
>>    [junit4]   2> 845447 T2377 oasc.ZkController.publish numShards not
>> found on descriptor - reading it from system property
>>    [junit4]   2> 845450 T2342 oasc.DistributedQueue$LatchWatcher.process
>> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>>    [junit4]   2> 845455 T2343 oasc.Overseer$ClusterStateUpdater.run
>> processMessage: queueSize: 1, message = {
>>    [junit4]   2>          "core":"collection1",
>>    [junit4]   2>          "core_node_name":"core_node1",
>>    [junit4]   2>          "roles":null,
>>    [junit4]   2>          "base_url":"http://127.0.0.1:49862",
>>    [junit4]   2>          "node_name":"127.0.0.1:49862_",
>>    [junit4]   2>          "numShards":"2",
>>    [junit4]   2>          "state":"active",
>>    [junit4]   2>          "shard":"shard2",
>>    [junit4]   2>          "collection":"collection1",
>>    [junit4]   2>          "operation":"state"} current state version: 4
>>    [junit4]   2> 845459 T2343 oasco.ReplicaMutator.updateState Update
>> state numShards=2 message={
>>    [junit4]   2>          "core":"collection1",
>>    [junit4]   2>          "core_node_name":"core_node1",
>>    [junit4]   2>          "roles":null,
>>    [junit4]   2>          "base_url":"http://127.0.0.1:49862",
>>    [junit4]   2>          "node_name":"127.0.0.1:49862_",
>>    [junit4]   2>          "numShards":"2",
>>    [junit4]   2>          "state":"active",
>>    [junit4]   2>          "shard":"shard2",
>>    [junit4]   2>          "collection":"collection1",
>>    [junit4]   2>          "operation":"state"}
>>    [junit4]   2> 845466 T2343 oasco.ZkStateWriter.writePendingUpdates
>> going to update_collection /collections/collection1/state.json version: 3
>>    [junit4]   2> 845475 T2372 oascc.ZkStateReader$7.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/collections/collection1/state.json, has occurred - updating...
>>    [junit4]   2> 845481 T2377 oascc.ZkStateReader.updateWatchedCollection
>> Updating data for collection1 to ver 4
>>    [junit4]   2> 845483 T2372 oascc.ZkStateReader.updateWatchedCollection
>> Updating data for collection1 to ver 4
>>    [junit4]   2> 847246 T2316
>> oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
>>    [junit4]   2> 847247 T2316 oejs.Server.doStart jetty-8.1.10.v20130312
>>    [junit4]   2> 847252 T2316 oejs.AbstractConnector.doStart Started
>> SelectChannelConnector@127.0.0.1:49865
>>    [junit4]   2> 847253 T2316 oass.SolrDispatchFilter.init
>> SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
>>    [junit4]   2> 847254 T2316 oasc.SolrResourceLoader.locateSolrHome JNDI
>> not configured for solr (NoInitialContextEx)
>>    [junit4]   2> 847254 T2316 oasc.SolrResourceLoader.locateSolrHome
>> using system property solr.solr.home:
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004
>>    [junit4]   2> 847255 T2316 oasc.SolrResourceLoader.<init> new
>> SolrResourceLoader for directory:
>> '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/'
>>    [junit4]   2> 847309 T2316 oasc.ConfigSolr.fromFile Loading container
>> configuration from
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/solr.xml
>>    [junit4]   2> 847325 T2316 oasc.CoreContainer.<init> New CoreContainer
>> 1078127689
>>    [junit4]   2> 847325 T2316 oasc.CoreContainer.load Loading cores into
>> CoreContainer
>> [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/]
>>    [junit4]   2> 847326 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting socketTimeout to: 90000
>>    [junit4]   2> 847326 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting urlScheme to:
>>    [junit4]   2> 847326 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting connTimeout to: 15000
>>    [junit4]   2> 847326 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting maxConnectionsPerHost to: 20
>>    [junit4]   2> 847326 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting maxConnections to: 10000
>>    [junit4]   2> 847327 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting corePoolSize to: 0
>>    [junit4]   2> 847328 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting maximumPoolSize to: 2147483647
>>    [junit4]   2> 847328 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting maxThreadIdleTime to: 5
>>    [junit4]   2> 847328 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting sizeOfQueue to: -1
>>    [junit4]   2> 847329 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting fairnessPolicy to: false
>>    [junit4]   2> 847329 T2316 oasu.UpdateShardHandler.<init> Creating
>> UpdateShardHandler HTTP client with params:
>> socketTimeout=340000&connTimeout=45000&retry=false
>>    [junit4]   2> 847330 T2316 oasl.LogWatcher.createWatcher SLF4J impl is
>> org.slf4j.impl.Log4jLoggerFactory
>>    [junit4]   2> 847330 T2316 oasl.LogWatcher.newRegisteredLogWatcher
>> Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>>    [junit4]   2> 847330 T2316 oasc.CoreContainer.load Host Name: 127.0.0.1
>>    [junit4]   2> 847330 T2316 oasc.ZkContainer.initZooKeeper Zookeeper
>> client=127.0.0.1:49854/solr
>>    [junit4]   2> 847330 T2316 oasc.ZkController.checkChrootPath zkHost
>> includes chroot
>>    [junit4]   2> 847331 T2316
>> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
>> ZkCredentialsProvider
>>    [junit4]   2> 847335 T2316 oascc.ConnectionManager.waitForConnected
>> Waiting for client to connect to ZooKeeper
>>    [junit4]   2> 847336 T2389 oascc.ConnectionManager.process Watcher
>> org.apache.solr.common.cloud.ConnectionManager@ece84e9
>> name:ZooKeeperConnection Watcher:127.0.0.1:49854 got event WatchedEvent
>> state:SyncConnected type:None path:null path:null type:None
>>    [junit4]   2> 847338 T2316 oascc.ConnectionManager.waitForConnected
>> Client is connected to ZooKeeper
>>    [junit4]   2> 847338 T2316 oascc.SolrZkClient.createZkACLProvider
>> Using default ZkACLProvider
>>    [junit4]   2> 847344 T2316 oascc.ConnectionManager.waitForConnected
>> Waiting for client to connect to ZooKeeper
>>    [junit4]   2> 847347 T2392 oascc.ConnectionManager.process Watcher
>> org.apache.solr.common.cloud.ConnectionManager@634647ce
>> name:ZooKeeperConnection Watcher:127.0.0.1:49854/solr got event
>> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>>    [junit4]   2> 847347 T2316 oascc.ConnectionManager.waitForConnected
>> Client is connected to ZooKeeper
>>    [junit4]   2> 847362 T2316
>> oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster
>> state from ZooKeeper...
>>    [junit4]   2> 848381 T2316 oasc.ZkController.createEphemeralLiveNode
>> Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49865_
>>    [junit4]   2> 848388 T2316 oascc.SolrZkClient.makePath makePath:
>> /live_nodes/127.0.0.1:49865_
>>    [junit4]   2> 848403 T2316 oasc.Overseer.close Overseer (id=null)
>> closing
>>    [junit4]   2> 848422 T2393 oasc.ZkController.publish publishing
>> core=collection1 state=down collection=collection1
>>    [junit4]   2> 848422 T2393 oasc.ZkController.publish numShards not
>> found on descriptor - reading it from system property
>>    [junit4]   2> 848428 T2342 oasc.DistributedQueue$LatchWatcher.process
>> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>>    [junit4]   2> 848429 T2393 oasc.ZkController.preRegister Registering
>> watch for external collection collection1
>>    [junit4]   2> 848429 T2393 oascc.ZkStateReader.addZkWatch addZkWatch
>> collection1
>>    [junit4]   2> 848431 T2393 oascc.ZkStateReader.addZkWatch Updating
>> collection state at /collections/collection1/state.json from ZooKeeper...
>>    [junit4]   2> 848432 T2343 oasc.Overseer$ClusterStateUpdater.run
>> processMessage: queueSize: 1, message = {
>>    [junit4]   2>          "core":"collection1",
>>    [junit4]   2>          "roles":null,
>>    [junit4]   2>          "base_url":"http://127.0.0.1:49865",
>>    [junit4]   2>          "node_name":"127.0.0.1:49865_",
>>    [junit4]   2>          "numShards":"2",
>>    [junit4]   2>          "state":"down",
>>    [junit4]   2>          "shard":null,
>>    [junit4]   2>          "collection":"collection1",
>>    [junit4]   2>          "operation":"state"} current state version: 4
>>    [junit4]   2> 848434 T2343 oasco.ReplicaMutator.updateState Update
>> state numShards=2 message={
>>    [junit4]   2>          "core":"collection1",
>>    [junit4]   2>          "roles":null,
>>    [junit4]   2>          "base_url":"http://127.0.0.1:49865",
>>    [junit4]   2>          "node_name":"127.0.0.1:49865_",
>>    [junit4]   2>          "numShards":"2",
>>    [junit4]   2>          "state":"down",
>>    [junit4]   2>          "shard":null,
>>    [junit4]   2>          "collection":"collection1",
>>    [junit4]   2>          "operation":"state"}
>>    [junit4]   2> 848434 T2343 oasco.ReplicaMutator.updateState Collection
>> already exists with numShards=2
>>    [junit4]   2> 848435 T2393 oascc.ZkStateReader.updateWatchedCollection
>> Updating data for collection1 to ver 4
>>    [junit4]   2> 848435 T2343 oasco.ReplicaMutator.updateState Assigning
>> new node to shard shard=shard1
>>    [junit4]   2> 848435 T2393 oasc.ZkController.waitForCoreNodeName look
>> for our core node name
>>    [junit4]   2> 848440 T2343 oasco.ZkStateWriter.writePendingUpdates
>> going to update_collection /collections/collection1/state.json version: 4
>>    [junit4]   2> 848442 T2392 oascc.ZkStateReader$7.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/collections/collection1/state.json, has occurred - updating...
>>    [junit4]   2> 848442 T2372 oascc.ZkStateReader$7.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/collections/collection1/state.json, has occurred - updating...
>>    [junit4]   2> 848444 T2392 oascc.ZkStateReader.updateWatchedCollection
>> Updating data for collection1 to ver 5
>>    [junit4]   2> 848444 T2372 oascc.ZkStateReader.updateWatchedCollection
>> Updating data for collection1 to ver 5
>>    [junit4]   2> 849438 T2393 oasc.ZkController.waitForShardId waiting to
>> find shard id in clusterstate for collection1
>>    [junit4]   2> 849439 T2393 oasc.ZkController.createCollectionZkNode
>> Check for collection zkNode:collection1
>>    [junit4]   2> 849442 T2393 oasc.ZkController.createCollectionZkNode
>> Collection zkNode exists
>>    [junit4]   2> 849442 T2393 oascc.ZkStateReader.readConfigName Load
>> collection config from:/collections/collection1
>>    [junit4]   2> 849445 T2393 oascc.ZkStateReader.readConfigName
>> path=/collections/collection1 configName=conf1 specified config exists in
>> ZooKeeper
>>    [junit4]   2> 849446 T2393 oasc.SolrResourceLoader.<init> new
>> SolrResourceLoader for directory:
>> '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/collection1/'
>>    [junit4]   2> 849448 T2393 oasc.SolrResourceLoader.replaceClassLoader
>> Adding
>> 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/collection1/lib/.svn/'
>> to classloader
>>    [junit4]   2> 849449 T2393 oasc.SolrResourceLoader.replaceClassLoader
>> Adding
>> 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/collection1/lib/classes/'
>> to classloader
>>    [junit4]   2> 849449 T2393 oasc.SolrResourceLoader.replaceClassLoader
>> Adding
>> 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/collection1/lib/README'
>> to classloader
>>    [junit4]   2> 849480 T2393 oasc.ZkController.watchZKConfDir watch
>> zkdir /configs/conf1
>>    [junit4]   2> 849487 T2393 oasc.Config.<init> loaded config
>> solrconfig.xml with version 0
>>    [junit4]   2> 849502 T2393 oasc.SolrConfig.<init> Using Lucene
>> MatchVersion: 6.0.0
>>    [junit4]   2> 849518 T2393 oasc.SolrConfig.<init> Loaded SolrConfig:
>> solrconfig.xml
>>    [junit4]   2> 849524 T2393 oass.IndexSchema.readSchema Reading Solr
>> Schema from /configs/conf1/schema.xml
>>    [junit4]   2> 849534 T2393 oass.IndexSchema.readSchema [collection1]
>> Schema name=test
>>    [junit4]   2> 849647 T2393 oass.OpenExchangeRatesOrgProvider.init
>> Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
>>    [junit4]   2> 849655 T2393 oass.IndexSchema.readSchema default search
>> field in schema is text
>>    [junit4]   2> 849656 T2393 oass.IndexSchema.readSchema unique key
>> field: id
>>    [junit4]   2> 849681 T2393 oass.FileExchangeRateProvider.reload
>> Reloading exchange rates from file currency.xml
>>    [junit4]   2> 849687 T2393 oass.FileExchangeRateProvider.reload
>> Reloading exchange rates from file currency.xml
>>    [junit4]   2> 849692 T2393 oass.OpenExchangeRatesOrgProvider.reload
>> Reloading exchange rates from open-exchange-rates.json
>>    [junit4]   2> 849694 T2393
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
>> IMPORTANT NOTE
>>    [junit4]   2> 849695 T2393
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
>> key, got STRING
>>    [junit4]   2> 849696 T2393 oass.OpenExchangeRatesOrgProvider.reload
>> Reloading exchange rates from open-exchange-rates.json
>>    [junit4]   2> 849698 T2393
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
>> IMPORTANT NOTE
>>    [junit4]   2> 849699 T2393
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
>> key, got STRING
>>    [junit4]   2> 849699 T2393 oasc.CoreContainer.create Creating SolrCore
>> 'collection1' using configuration from collection collection1
>>    [junit4]   2> 849699 T2393 oasc.SolrCore.initDirectoryFactory
>> org.apache.solr.core.MockDirectoryFactory
>>    [junit4]   2> 849699 T2393 oasc.SolrCore.<init> [collection1] Opening
>> new SolrCore at
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/collection1/,
>> dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty2/
>>    [junit4]   2> 849700 T2393 oasc.JmxMonitoredMap.<init> JMX monitoring
>> is enabled. Adding Solr mbeans to JMX Server:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@2fb2b6a6
>>    [junit4]   2> 849700 T2393 oasc.CachingDirectoryFactory.get return new
>> directory for
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty2
>>    [junit4]   2> 849700 T2393 oasc.SolrCore.getNewIndexDir New index
>> directory detected: old=null
>> new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty2/index/
>>    [junit4]   2> 849701 T2393 oasc.SolrCore.initIndex WARN [collection1]
>> Solr index directory
>> '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty2/index'
>> doesn't exist. Creating new index...
>>    [junit4]   2> 849701 T2393 oasc.CachingDirectoryFactory.get return new
>> directory for
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty2/index
>>    [junit4]   2> 849701 T2393 oasu.RandomMergePolicy.<init>
>> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy:
>> [LogDocMergePolicy: minMergeSize=1000, mergeFactor=24,
>> maxMergeSize=9223372036854775807,
>> maxMergeSizeForForcedMerge=9223372036854775807,
>> calibrateSizeByDeletes=false, maxMergeDocs=2147483647,
>> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
>>    [junit4]   2> 849702 T2393 oasc.SolrDeletionPolicy.onCommit
>> SolrDeletionPolicy.onCommit: commits: num=1
>>    [junit4]   2>
>> commit{dir=MockDirectoryWrapper(RAMDirectory@3df67880
>> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7941453f
>> ),segFN=segments_1,generation=1}
>>    [junit4]   2> 849702 T2393 oasc.SolrDeletionPolicy.updateCommits
>> newest commit generation = 1
>>    [junit4]   2> 849706 T2393 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "nodistrib"
>>    [junit4]   2> 849707 T2393 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "dedupe"
>>    [junit4]   2> 849707 T2393 oasup.UpdateRequestProcessorChain.init
>> inserting DistributedUpdateProcessorFactory into
>> updateRequestProcessorChain "dedupe"
>>    [junit4]   2> 849707 T2393 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "stored_sig"
>>    [junit4]   2> 849707 T2393 oasup.UpdateRequestProcessorChain.init
>> inserting DistributedUpdateProcessorFactory into
>> updateRequestProcessorChain "stored_sig"
>>    [junit4]   2> 849708 T2393 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
>>    [junit4]   2> 849709 T2393 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>>    [junit4]   2> 849709 T2393 oasup.UpdateRequestProcessorChain.init
>> inserting DistributedUpdateProcessorFactory into
>> updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>>    [junit4]   2> 849709 T2393 oasc.SolrCore.loadUpdateProcessorChains no
>> updateRequestProcessorChain defined as default, creating implicit default
>>    [junit4]   2> 849710 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created /update: org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 849710 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created /update/json: org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 849711 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created /update/csv: org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 849711 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 849711 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created /config: org.apache.solr.handler.SolrConfigHandler
>>    [junit4]   2> 849712 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created /schema: org.apache.solr.handler.SchemaHandler
>>    [junit4]   2> 849714 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created /replication: org.apache.solr.handler.ReplicationHandler
>>    [junit4]   2> 849715 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created /get: org.apache.solr.handler.RealTimeGetHandler
>>    [junit4]   2> 849715 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
>>    [junit4]   2> 849716 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
>>    [junit4]   2> 849717 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
>>    [junit4]   2> 849717 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
>>    [junit4]   2> 849718 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
>>    [junit4]   2> 849719 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/properties:
>> org.apache.solr.handler.admin.PropertiesRequestHandler
>>    [junit4]   2> 849719 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
>>    [junit4]   2> 849720 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/ping: org.apache.solr.handler.PingRequestHandler
>>    [junit4]   2> 849720 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created standard: solr.StandardRequestHandler
>>    [junit4]   2> 849721 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/file: solr.admin.ShowFileRequestHandler
>>    [junit4]   2> 849721 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/fileedit: solr.admin.EditFileRequestHandler
>>    [junit4]   2> 849730 T2393 oashl.XMLLoader.init
>> xsltCacheLifetimeSeconds=60
>>    [junit4]   2> 849731 T2393 oashl.XMLLoader.init
>> xsltCacheLifetimeSeconds=60
>>    [junit4]   2> 849733 T2393 oashl.XMLLoader.init
>> xsltCacheLifetimeSeconds=60
>>    [junit4]   2> 849735 T2393 oashl.XMLLoader.init
>> xsltCacheLifetimeSeconds=60
>>    [junit4]   2> 849738 T2393 oasu.CommitTracker.<init> Hard AutoCommit:
>> disabled
>>    [junit4]   2> 849738 T2393 oasu.CommitTracker.<init> Soft AutoCommit:
>> disabled
>>    [junit4]   2> 849740 T2393 oasu.RandomMergePolicy.<init>
>> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy:
>> [LogDocMergePolicy: minMergeSize=1000, mergeFactor=12,
>> maxMergeSize=9223372036854775807,
>> maxMergeSizeForForcedMerge=9223372036854775807,
>> calibrateSizeByDeletes=true, maxMergeDocs=2147483647,
>> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
>>    [junit4]   2> 849741 T2393 oasc.SolrDeletionPolicy.onInit
>> SolrDeletionPolicy.onInit: commits: num=1
>>    [junit4]   2>
>> commit{dir=MockDirectoryWrapper(RAMDirectory@3df67880
>> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7941453f
>> ),segFN=segments_1,generation=1}
>>    [junit4]   2> 849741 T2393 oasc.SolrDeletionPolicy.updateCommits
>> newest commit generation = 1
>>    [junit4]   2> 849742 T2393 oass.SolrIndexSearcher.<init> Opening
>> Searcher@49e1a7c7[collection1] main
>>    [junit4]   2> 849742 T2393 oascc.ZkStateReader.readConfigName Load
>> collection config from:/collections/collection1
>>    [junit4]   2> 849745 T2393 oascc.ZkStateReader.readConfigName
>> path=/collections/collection1 configName=conf1 specified config exists in
>> ZooKeeper
>>    [junit4]   2> 849745 T2393 oasr.ManagedResourceStorage.newStorageIO
>> Setting up ZooKeeper-based storage for the RestManager with znodeBase:
>> /configs/conf1
>>    [junit4]   2> 849747 T2393
>> oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured
>> ZooKeeperStorageIO with znodeBase: /configs/conf1
>>    [junit4]   2> 849747 T2393 oasr.RestManager.init Initializing
>> RestManager with initArgs: {}
>>    [junit4]   2> 849747 T2393 oasr.ManagedResourceStorage.load Reading
>> _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
>>    [junit4]   2> 849751 T2393
>> oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38
>> bytes from znode /configs/conf1/_rest_managed.json
>>    [junit4]   2> 849751 T2393 oasr.ManagedResourceStorage.load Loaded
>> LinkedHashMap at path _rest_managed.json using
>> ZooKeeperStorageIO:path=/configs/conf1
>>    [junit4]   2> 849751 T2393 oasr.ManagedResource.reloadFromStorage
>> Loaded initArgs {} for /rest/managed
>>    [junit4]   2> 849752 T2393 oasr.RestManager.init Initializing 0
>> registered ManagedResources
>>    [junit4]   2> 849752 T2393 oash.ReplicationHandler.inform Commits will
>> be reserved for  10000
>>    [junit4]   2> 849753 T2393 oasc.CoreContainer.registerCore registering
>> core: collection1
>>    [junit4]   2> 849755 T2397 oasc.ZkController.register Register replica
>> - core:collection1 address:http://127.0.0.1:49865 collection:collection1
>> shard:shard1
>>    [junit4]   2> 849756 T2394 oasc.SolrCore.registerSearcher
>> [collection1] Registered new searcher Searcher@49e1a7c7[collection1]
>> main{ExitableDirectoryReader(UninvertingDirectoryReader())}
>>    [junit4]   2> 849756 T2316 oass.SolrDispatchFilter.init
>> user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
>>    [junit4]   2> 849758 T2316 oass.SolrDispatchFilter.init
>> SolrDispatchFilter.init() done
>>    [junit4]   2> 849760 T2397
>>
>> [...truncated too long message...]
>>
>> it4]   2> 888022 T2316 oasc.ZkController.unRegisterConfListener  a
>> listener was removed because of core close
>>    [junit4]   2> 888023 T2316 oasu.DirectUpdateHandler2.close closing
>> DirectUpdateHandler2{commits=0,autocommits=0,soft
>> autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
>>    [junit4]   2> 888023 T2316 oasu.SolrCoreState.decrefSolrCoreState
>> Closing SolrCoreState
>>    [junit4]   2> 888023 T2485 oasc.Overseer$ClusterStateUpdater.run
>> processMessage: queueSize: 1, message = {
>>    [junit4]   2>          "core":"collection1",
>>    [junit4]   2>          "core_node_name":"core_node4",
>>    [junit4]   2>          "roles":null,
>>    [junit4]   2>          "base_url":"http://127.0.0.1:49872",
>>    [junit4]   2>          "node_name":"127.0.0.1:49872_",
>>    [junit4]   2>          "numShards":"2",
>>    [junit4]   2>          "state":"down",
>>    [junit4]   2>          "shard":"shard1",
>>    [junit4]   2>          "collection":"collection1",
>>    [junit4]   2>          "operation":"state"} current state version: 15
>>    [junit4]   2> 888024 T2316 oasu.DefaultSolrCoreState.closeIndexWriter
>> SolrCoreState ref count has reached 0 - closing IndexWriter
>>    [junit4]   2> 888024 T2316 oasu.DefaultSolrCoreState.closeIndexWriter
>> closing IndexWriter with IndexWriterCloser
>>    [junit4]   2> 888025 T2485 oasco.ReplicaMutator.updateState Update
>> state numShards=2 message={
>>    [junit4]   2>          "core":"collection1",
>>    [junit4]   2>          "core_node_name":"core_node4",
>>    [junit4]   2>          "roles":null,
>>    [junit4]   2>          "base_url":"http://127.0.0.1:49872",
>>    [junit4]   2>          "node_name":"127.0.0.1:49872_",
>>    [junit4]   2>          "numShards":"2",
>>    [junit4]   2>          "state":"down",
>>    [junit4]   2>          "shard":"shard1",
>>    [junit4]   2>          "collection":"collection1",
>>    [junit4]   2>          "operation":"state"}
>>    [junit4]   2> 888025 T2316 oasc.SolrCore.closeSearcher [collection1]
>> Closing main searcher on request.
>>    [junit4]   2> 888031 T2485 oasco.ZkStateWriter.writePendingUpdates
>> going to update_collection /collections/collection1/state.json version: 22
>>    [junit4]   2> 888039 T2316 oasc.CachingDirectoryFactory.close Closing
>> MockDirectoryFactory - 2 directories currently being tracked
>>    [junit4]   2> 888040 T2316
>> oasc.CachingDirectoryFactory.closeCacheValue looking to close
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty4/index
>> [CachedDir<<refCount=0;path=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty4/index;done=false>>]
>>    [junit4]   2> 888041 T2316 oasc.CachingDirectoryFactory.close Closing
>> directory:
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty4/index
>>    [junit4]   2> 888042 T2434 oascc.ZkStateReader$7.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/collections/collection1/state.json, has occurred - updating...
>>    [junit4]   2> 888042 T2316
>> oasc.CachingDirectoryFactory.closeCacheValue looking to close
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty4
>> [CachedDir<<refCount=0;path=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty4;done=false>>]
>>    [junit4]   2> 888043 T2316 oasc.CachingDirectoryFactory.close Closing
>> directory:
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty4
>>    [junit4]   2> 888044 T2316 oasc.Overseer.close Overseer
>> (id=93006854147866637-127.0.0.1:49872_-n_0000000004) closing
>>    [junit4]   2> 888045 T2485 oasc.Overseer$ClusterStateUpdater.run
>> Overseer Loop exiting : 127.0.0.1:49872_
>>    [junit4]   2> 889547 T2434 oascc.ZkStateReader$7.process WARN
>> ZooKeeper watch triggered, but Solr cannot talk to ZK
>>    [junit4]   2> 889548 T2475 oascc.ZkStateReader$3.process WARN
>> ZooKeeper watch triggered, but Solr cannot talk to ZK
>>    [junit4]   2> 889565 T2316 oejsh.ContextHandler.doStop stopped
>> o.e.j.s.ServletContextHandler{/,null}
>>    [junit4]   2> 894556 T2316 oas.SolrTestCaseJ4.tearDown ###Ending
>> testDistribSearch
>>    [junit4]   2> 894558 T2316 oasc.ZkTestServer.send4LetterWord
>> connecting to 127.0.0.1:49854 49854
>>    [junit4]   2> 894571 T2317 oasc.ZkTestServer.send4LetterWord
>> connecting to 127.0.0.1:49854 49854
>>    [junit4]   2> 894790 T2317
>> oasc.ZkTestServer$ZKServerMain.runFromConfig WARN Watch limit violations:
>>    [junit4]   2>        Maximum concurrent create/delete watches above
>> limit:
>>    [junit4]   2>
>>    [junit4]   2>                10      /solr/configs/conf1
>>    [junit4]   2>                6       /solr/aliases.json
>>    [junit4]   2>                6       /solr/clusterstate.json
>>    [junit4]   2>                4
>>  /solr/collections/collection1/state.json
>>    [junit4]   2>                2       /solr/configs/.system
>>    [junit4]   2>
>>    [junit4]   2>        Maximum concurrent children watches above limit:
>>    [junit4]   2>
>>    [junit4]   2>                6       /solr/live_nodes
>>    [junit4]   2>                5
>>  /solr/overseer/collection-queue-work
>>    [junit4]   2>                4       /solr/overseer/queue
>>    [junit4]   2>
>>    [junit4]   2> NOTE: reproduce with: ant test
>> -Dtestcase=TestDynamicLoading -Dtests.method=testDistribSearch
>> -Dtests.seed=CC8AD89B44D0A93D -Dtests.slow=true -Dtests.locale=es_GT
>> -Dtests.timezone=America/Kentucky/Louisville -Dtests.asserts=true
>> -Dtests.file.encoding=UTF-8
>>    [junit4] FAILURE 57.8s | TestDynamicLoading.testDistribSearch <<<
>>    [junit4]    > Throwable #1: java.lang.AssertionError: {
>>    [junit4]    >   "responseHeader":{
>>    [junit4]    >     "status":404,
>>    [junit4]    >     "QTime":14},
>>    [junit4]    >   "error":{
>>    [junit4]    >     "msg":"no such blob or version available: test/1",
>>    [junit4]    >     "code":404}}
>> expected:<org.apache.solr.core.BlobStoreTestRequestHandler> but was:<null>
>>    [junit4]    >        at
>> __randomizedtesting.SeedInfo.seed([CC8AD89B44D0A93D:4D6C5683338FC901]:0)
>>    [junit4]    >        at
>> org.apache.solr.core.TestDynamicLoading.dynamicLoading(TestDynamicLoading.java:101)
>>    [junit4]    >        at
>> org.apache.solr.core.TestDynamicLoading.doTest(TestDynamicLoading.java:64)
>>    [junit4]    >        at
>> org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
>>    [junit4]    >        at java.lang.Thread.run(Thread.java:745)
>>    [junit4]   2> 894984 T2316 oas.SolrTestCaseJ4.deleteCore ###deleteCore
>>    [junit4]   2> NOTE: leaving temporary files on disk at:
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001
>>    [junit4]   2> 57768 T2315 ccr.ThreadLeakControl.checkThreadLeaks
>> WARNING Will linger awaiting termination of 1 leaked thread(s).
>>    [junit4]   2> NOTE: test params are: codec=Asserting(Lucene50):
>> {blobName=PostingsFormat(name=LuceneVarGapFixedInterval),
>> _version_=PostingsFormat(name=Memory doPackFST= false),
>> id=PostingsFormat(name=Direct), version=PostingsFormat(name=Memory
>> doPackFST= false),
>> timestamp=PostingsFormat(name=LuceneVarGapFixedInterval)}, docValues:{},
>> sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=es_GT,
>> timezone=America/Kentucky/Louisville
>>    [junit4]   2> NOTE: Mac OS X 10.8.5 x86_64/Oracle Corporation 1.8.0_20
>> (64-bit)/cpus=2,threads=1,free=139693720,total=288882688
>>    [junit4]   2> NOTE: All tests run in this JVM:
>> [TestSerializedLuceneMatchVersion, ReplicationFactorTest,
>> RAMDirectoryFactoryTest, TestLRUCache, OutputWriterTest, ZkStateWriterTest,
>> TestInitParams, TestExpandComponent, CoreAdminCreateDiscoverTest,
>> TestCloudSchemaless, MigrateRouteKeyTest, InfoHandlerTest,
>> DisMaxRequestHandlerTest, DistributedFacetPivotSmallTest,
>> HdfsLockFactoryTest, TestPHPSerializedResponseWriter, CursorPagingTest,
>> TestSolrXml, TestClassNameShortening, StressHdfsTest,
>> DistributedFacetPivotSmallAdvancedTest, TestIndexSearcher,
>> LoggingHandlerTest, TestCoreContainer, ExternalCollectionsTest,
>> TestSchemaNameResource, TestBinaryResponseWriter, TestRangeQuery,
>> QueryParsingTest, XmlUpdateRequestHandlerTest, TestAddFieldRealTimeGet,
>> AnalyticsQueryTest, DistribCursorPagingTest, TestRawResponseWriter,
>> ZkSolrClientTest, TestFastWriter, TestDynamicLoading]
>>    [junit4] Completed in 58.31s, 1 test, 1 failure <<< FAILURES!
>>
>> [...truncated 1307 lines...]
>> BUILD FAILED
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:519: The
>> following error occurred while executing this line:
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:467: The
>> following error occurred while executing this line:
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:61: The
>> following error occurred while executing this line:
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/extra-targets.xml:39:
>> The following error occurred while executing this line:
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:187: The
>> following error occurred while executing this line:
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:510:
>> The following error occurred while executing this line:
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1349:
>> The following error occurred while executing this line:
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:956:
>> There were test failures: 453 suites, 1850 tests, 1 failure, 37 ignored (21
>> assumptions)
>>
>> Total time: 166 minutes 36 seconds
>> Build step 'Invoke Ant' marked build as failure
>> [description-setter] Description set: Java: 64bit/jdk1.8.0
>> -XX:+UseCompressedOops -XX:+UseParallelGC (asserts: true)
>> Archiving artifacts
>> Recording test results
>> Email was triggered for: Failure - Any
>> Sending email for trigger: Failure - Any
>>
>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: dev-help@lucene.apache.org
>>
>
>
>
> --
> Regards,
> Shalin Shekhar Mangar.
>


-- 
-----------------------------------------------------
Noble Paul

Re: [JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.8.0) - Build # 2008 - Still Failing!

Posted by Shalin Shekhar Mangar <sh...@gmail.com>.
This is probably related to SOLR-6787

On Sun, Dec 21, 2014 at 4:23 PM, Policeman Jenkins Server <
jenkins@thetaphi.de> wrote:

> Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/2008/
> Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseParallelGC (asserts:
> true)
>
> 1 tests failed.
> FAILED:  org.apache.solr.core.TestDynamicLoading.testDistribSearch
>
> Error Message:
> {   "responseHeader":{     "status":404,     "QTime":14},   "error":{
>  "msg":"no such blob or version available: test/1",     "code":404}}
> expected:<org.apache.solr.core.BlobStoreTestRequestHandler> but was:<null>
>
> Stack Trace:
> java.lang.AssertionError: {
>   "responseHeader":{
>     "status":404,
>     "QTime":14},
>   "error":{
>     "msg":"no such blob or version available: test/1",
>     "code":404}}
> expected:<org.apache.solr.core.BlobStoreTestRequestHandler> but was:<null>
>         at
> __randomizedtesting.SeedInfo.seed([CC8AD89B44D0A93D:4D6C5683338FC901]:0)
>         at org.junit.Assert.fail(Assert.java:93)
>         at org.junit.Assert.failNotEquals(Assert.java:647)
>         at org.junit.Assert.assertEquals(Assert.java:128)
>         at
> org.apache.solr.core.TestDynamicLoading.dynamicLoading(TestDynamicLoading.java:101)
>         at
> org.apache.solr.core.TestDynamicLoading.doTest(TestDynamicLoading.java:64)
>         at
> org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:483)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
>         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>         at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
>         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
>         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
>         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
>         at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
>         at java.lang.Thread.run(Thread.java:745)
>
>
>
>
> Build Log:
> [...truncated 8743 lines...]
>    [junit4] Suite: org.apache.solr.core.TestDynamicLoading
>    [junit4]   2> Creating dataDir:
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/init-core-data-001
>    [junit4]   2> 837229 T2316 oas.SolrTestCaseJ4.buildSSLConfig Randomized
> ssl (false) and clientAuth (false)
>    [junit4]   2> 837230 T2316
> oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext
> system property: /
>    [junit4]   2> 837237 T2316 oas.SolrTestCaseJ4.setUp ###Starting
> testDistribSearch
>    [junit4]   2> 837239 T2316 oasc.ZkTestServer.run STARTING ZK TEST SERVER
>    [junit4]   1> client port:0.0.0.0/0.0.0.0:0
>    [junit4]   2> 837240 T2317 oasc.ZkTestServer$ZKServerMain.runFromConfig
> Starting server
>    [junit4]   2> 837341 T2316 oasc.ZkTestServer.run start zk server on
> port:49854
>    [junit4]   2> 837345 T2316
> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
> ZkCredentialsProvider
>    [junit4]   2> 837348 T2316 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
>    [junit4]   2> 837355 T2324 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@6e4d3d31
> name:ZooKeeperConnection Watcher:127.0.0.1:49854 got event WatchedEvent
> state:SyncConnected type:None path:null path:null type:None
>    [junit4]   2> 837355 T2316 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
>    [junit4]   2> 837355 T2316 oascc.SolrZkClient.createZkACLProvider Using
> default ZkACLProvider
>    [junit4]   2> 837356 T2316 oascc.SolrZkClient.makePath makePath: /solr
>    [junit4]   2> 837365 T2316
> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
> ZkCredentialsProvider
>    [junit4]   2> 837366 T2316 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
>    [junit4]   2> 837370 T2327 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@36723d68
> name:ZooKeeperConnection Watcher:127.0.0.1:49854/solr got event
> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>    [junit4]   2> 837370 T2316 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
>    [junit4]   2> 837370 T2316 oascc.SolrZkClient.createZkACLProvider Using
> default ZkACLProvider
>    [junit4]   2> 837371 T2316 oascc.SolrZkClient.makePath makePath:
> /collections/collection1
>    [junit4]   2> 837378 T2316 oascc.SolrZkClient.makePath makePath:
> /collections/collection1/shards
>    [junit4]   2> 837385 T2316 oascc.SolrZkClient.makePath makePath:
> /collections/control_collection
>    [junit4]   2> 837389 T2316 oascc.SolrZkClient.makePath makePath:
> /collections/control_collection/shards
>    [junit4]   2> 837396 T2316 oasc.AbstractZkTestCase.putConfig put
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
> to /configs/conf1/solrconfig.xml
>    [junit4]   2> 837397 T2316 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/solrconfig.xml
>    [junit4]   2> 837404 T2316 oasc.AbstractZkTestCase.putConfig put
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema.xml
> to /configs/conf1/schema.xml
>    [junit4]   2> 837405 T2316 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/schema.xml
>    [junit4]   2> 837412 T2316 oasc.AbstractZkTestCase.putConfig put
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
> to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
>    [junit4]   2> 837413 T2316 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/solrconfig.snippet.randomindexconfig.xml
>    [junit4]   2> 837423 T2316 oasc.AbstractZkTestCase.putConfig put
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
> to /configs/conf1/stopwords.txt
>    [junit4]   2> 837423 T2316 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/stopwords.txt
>    [junit4]   2> 837429 T2316 oasc.AbstractZkTestCase.putConfig put
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt
> to /configs/conf1/protwords.txt
>    [junit4]   2> 837430 T2316 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/protwords.txt
>    [junit4]   2> 837436 T2316 oasc.AbstractZkTestCase.putConfig put
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml
> to /configs/conf1/currency.xml
>    [junit4]   2> 837437 T2316 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/currency.xml
>    [junit4]   2> 837443 T2316 oasc.AbstractZkTestCase.putConfig put
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
> to /configs/conf1/enumsConfig.xml
>    [junit4]   2> 837444 T2316 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/enumsConfig.xml
>    [junit4]   2> 837450 T2316 oasc.AbstractZkTestCase.putConfig put
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
> to /configs/conf1/open-exchange-rates.json
>    [junit4]   2> 837451 T2316 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/open-exchange-rates.json
>    [junit4]   2> 837457 T2316 oasc.AbstractZkTestCase.putConfig put
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
> to /configs/conf1/mapping-ISOLatin1Accent.txt
>    [junit4]   2> 837458 T2316 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/mapping-ISOLatin1Accent.txt
>    [junit4]   2> 837463 T2316 oasc.AbstractZkTestCase.putConfig put
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
> to /configs/conf1/old_synonyms.txt
>    [junit4]   2> 837463 T2316 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/old_synonyms.txt
>    [junit4]   2> 837469 T2316 oasc.AbstractZkTestCase.putConfig put
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
> to /configs/conf1/synonyms.txt
>    [junit4]   2> 837469 T2316 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/synonyms.txt
>    [junit4]   2> 839165 T2316 oejs.Server.doStart jetty-8.1.10.v20130312
>    [junit4]   2> 839174 T2316 oejs.AbstractConnector.doStart Started
> SelectChannelConnector@127.0.0.1:49857
>    [junit4]   2> 839175 T2316 oass.SolrDispatchFilter.init
> SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
>    [junit4]   2> 839176 T2316 oasc.SolrResourceLoader.locateSolrHome JNDI
> not configured for solr (NoInitialContextEx)
>    [junit4]   2> 839176 T2316 oasc.SolrResourceLoader.locateSolrHome using
> system property solr.solr.home:
> ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002
>    [junit4]   2> 839177 T2316 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/'
>    [junit4]   2> 839217 T2316 oasc.ConfigSolr.fromFile Loading container
> configuration from
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/solr.xml
>    [junit4]   2> 839240 T2316 oasc.CoreContainer.<init> New CoreContainer
> 1028334353
>    [junit4]   2> 839240 T2316 oasc.CoreContainer.load Loading cores into
> CoreContainer
> [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/]
>    [junit4]   2> 839241 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting socketTimeout to: 90000
>    [junit4]   2> 839241 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting urlScheme to:
>    [junit4]   2> 839241 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting connTimeout to: 15000
>    [junit4]   2> 839241 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting maxConnectionsPerHost to: 20
>    [junit4]   2> 839242 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting maxConnections to: 10000
>    [junit4]   2> 839242 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting corePoolSize to: 0
>    [junit4]   2> 839242 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting maximumPoolSize to: 2147483647
>    [junit4]   2> 839243 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting maxThreadIdleTime to: 5
>    [junit4]   2> 839243 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting sizeOfQueue to: -1
>    [junit4]   2> 839243 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting fairnessPolicy to: false
>    [junit4]   2> 839243 T2316 oasu.UpdateShardHandler.<init> Creating
> UpdateShardHandler HTTP client with params:
> socketTimeout=340000&connTimeout=45000&retry=false
>    [junit4]   2> 839244 T2316 oasl.LogWatcher.createWatcher SLF4J impl is
> org.slf4j.impl.Log4jLoggerFactory
>    [junit4]   2> 839245 T2316 oasl.LogWatcher.newRegisteredLogWatcher
> Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>    [junit4]   2> 839245 T2316 oasc.CoreContainer.load Host Name: 127.0.0.1
>    [junit4]   2> 839245 T2316 oasc.ZkContainer.initZooKeeper Zookeeper
> client=127.0.0.1:49854/solr
>    [junit4]   2> 839246 T2316 oasc.ZkController.checkChrootPath zkHost
> includes chroot
>    [junit4]   2> 839246 T2316
> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
> ZkCredentialsProvider
>    [junit4]   2> 839248 T2316 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
>    [junit4]   2> 839253 T2339 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@12e5b223
> name:ZooKeeperConnection Watcher:127.0.0.1:49854 got event WatchedEvent
> state:SyncConnected type:None path:null path:null type:None
>    [junit4]   2> 839254 T2316 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
>    [junit4]   2> 839255 T2316 oascc.SolrZkClient.createZkACLProvider Using
> default ZkACLProvider
>    [junit4]   2> 839260 T2316 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
>    [junit4]   2> 839263 T2342 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@6406c22
> name:ZooKeeperConnection Watcher:127.0.0.1:49854/solr got event
> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>    [junit4]   2> 839264 T2316 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
>    [junit4]   2> 839265 T2316 oascc.SolrZkClient.makePath makePath:
> /overseer/queue
>    [junit4]   2> 839273 T2316 oascc.SolrZkClient.makePath makePath:
> /overseer/collection-queue-work
>    [junit4]   2> 839280 T2316 oascc.SolrZkClient.makePath makePath:
> /overseer/collection-map-running
>    [junit4]   2> 839288 T2316 oascc.SolrZkClient.makePath makePath:
> /overseer/collection-map-completed
>    [junit4]   2> 839294 T2316 oascc.SolrZkClient.makePath makePath:
> /overseer/collection-map-failure
>    [junit4]   2> 839302 T2316 oascc.SolrZkClient.makePath makePath:
> /live_nodes
>    [junit4]   2> 839304 T2316 oasc.ZkController.createEphemeralLiveNode
> Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49857_
>    [junit4]   2> 839305 T2316 oascc.SolrZkClient.makePath makePath:
> /live_nodes/127.0.0.1:49857_
>    [junit4]   2> 839311 T2316 oascc.SolrZkClient.makePath makePath:
> /overseer_elect
>    [junit4]   2> 839313 T2316 oascc.SolrZkClient.makePath makePath:
> /overseer_elect/election
>    [junit4]   2> 839317 T2316 oasc.Overseer.close Overseer (id=null)
> closing
>    [junit4]   2> 839322 T2316
> oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader
> 127.0.0.1:49857_
>    [junit4]   2> 839323 T2316 oascc.SolrZkClient.makePath makePath:
> /overseer_elect/leader
>    [junit4]   2> 839328 T2316 oasc.Overseer.start Overseer
> (id=93006854147866627-127.0.0.1:49857_-n_0000000000) starting
>    [junit4]   2> 839332 T2316 oascc.SolrZkClient.makePath makePath:
> /overseer/queue-work
>    [junit4]   2> 839351 T2316
> oasc.OverseerAutoReplicaFailoverThread.<init> Starting
> OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000
> autoReplicaFailoverWaitAfterExpiration=30000
> autoReplicaFailoverBadNodeExpiration=60000
>    [junit4]   2> 839353 T2344 oasc.OverseerCollectionProcessor.run Process
> current queue of collection creations
>    [junit4]   2> 839355 T2316 oascc.SolrZkClient.makePath makePath:
> /clusterstate.json
>    [junit4]   2> 839361 T2316 oascc.SolrZkClient.makePath makePath:
> /aliases.json
>    [junit4]   2> 839364 T2316
> oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster
> state from ZooKeeper...
>    [junit4]   2> 839375 T2343 oasc.Overseer$ClusterStateUpdater.run
> Starting to work on the main queue
>    [junit4]   2> 839383 T2346 oasc.ZkController.publish publishing
> core=collection1 state=down collection=control_collection
>    [junit4]   2> 839383 T2346 oasc.ZkController.publish numShards not
> found on descriptor - reading it from system property
>    [junit4]   2> 839385 T2346 oasc.ZkController.waitForCoreNodeName look
> for our core node name
>    [junit4]   2> 839385 T2342 oasc.DistributedQueue$LatchWatcher.process
> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>    [junit4]   2> 839392 T2343 oasc.Overseer$ClusterStateUpdater.run
> processMessage: queueSize: 0, message = {
>    [junit4]   2>          "core":"collection1",
>    [junit4]   2>          "roles":null,
>    [junit4]   2>          "base_url":"http://127.0.0.1:49857",
>    [junit4]   2>          "node_name":"127.0.0.1:49857_",
>    [junit4]   2>          "numShards":"1",
>    [junit4]   2>          "state":"down",
>    [junit4]   2>          "shard":null,
>    [junit4]   2>          "collection":"control_collection",
>    [junit4]   2>          "operation":"state"} current state version: 0
>    [junit4]   2> 839393 T2343 oasco.ReplicaMutator.updateState Update
> state numShards=1 message={
>    [junit4]   2>          "core":"collection1",
>    [junit4]   2>          "roles":null,
>    [junit4]   2>          "base_url":"http://127.0.0.1:49857",
>    [junit4]   2>          "node_name":"127.0.0.1:49857_",
>    [junit4]   2>          "numShards":"1",
>    [junit4]   2>          "state":"down",
>    [junit4]   2>          "shard":null,
>    [junit4]   2>          "collection":"control_collection",
>    [junit4]   2>          "operation":"state"}
>    [junit4]   2> 839393 T2343 oasco.ClusterStateMutator.createCollection
> building a new cName: control_collection
>    [junit4]   2> 839394 T2343 oasco.ReplicaMutator.updateState Assigning
> new node to shard shard=shard1
>    [junit4]   2> 839395 T2342 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>    [junit4]   2> 840387 T2346 oasc.ZkController.waitForShardId waiting to
> find shard id in clusterstate for collection1
>    [junit4]   2> 840387 T2346 oasc.ZkController.createCollectionZkNode
> Check for collection zkNode:control_collection
>    [junit4]   2> 840389 T2346 oasc.ZkController.createCollectionZkNode
> Collection zkNode exists
>    [junit4]   2> 840389 T2346 oascc.ZkStateReader.readConfigName Load
> collection config from:/collections/control_collection
>    [junit4]   2> 840395 T2346 oascc.ZkStateReader.readConfigName
> path=/collections/control_collection configName=conf1 specified config
> exists in ZooKeeper
>    [junit4]   2> 840395 T2346 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/collection1/'
>    [junit4]   2> 840397 T2346 oasc.SolrResourceLoader.replaceClassLoader
> Adding
> 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/collection1/lib/.svn/'
> to classloader
>    [junit4]   2> 840398 T2346 oasc.SolrResourceLoader.replaceClassLoader
> Adding
> 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/collection1/lib/classes/'
> to classloader
>    [junit4]   2> 840399 T2346 oasc.SolrResourceLoader.replaceClassLoader
> Adding
> 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/collection1/lib/README'
> to classloader
>    [junit4]   2> 840444 T2346 oasc.ZkController.watchZKConfDir watch zkdir
> /configs/conf1
>    [junit4]   2> 840450 T2346 oasc.Config.<init> loaded config
> solrconfig.xml with version 0
>    [junit4]   2> 840469 T2346 oasc.SolrConfig.<init> Using Lucene
> MatchVersion: 6.0.0
>    [junit4]   2> 840481 T2346 oasc.SolrConfig.<init> Loaded SolrConfig:
> solrconfig.xml
>    [junit4]   2> 840486 T2346 oass.IndexSchema.readSchema Reading Solr
> Schema from /configs/conf1/schema.xml
>    [junit4]   2> 840494 T2346 oass.IndexSchema.readSchema [collection1]
> Schema name=test
>    [junit4]   2> 840630 T2346 oass.OpenExchangeRatesOrgProvider.init
> Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
>    [junit4]   2> 840644 T2346 oass.IndexSchema.readSchema default search
> field in schema is text
>    [junit4]   2> 840647 T2346 oass.IndexSchema.readSchema unique key
> field: id
>    [junit4]   2> 840690 T2346 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
>    [junit4]   2> 840694 T2346 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
>    [junit4]   2> 840699 T2346 oass.OpenExchangeRatesOrgProvider.reload
> Reloading exchange rates from open-exchange-rates.json
>    [junit4]   2> 840702 T2346
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
> IMPORTANT NOTE
>    [junit4]   2> 840703 T2346
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
> key, got STRING
>    [junit4]   2> 840703 T2346 oass.OpenExchangeRatesOrgProvider.reload
> Reloading exchange rates from open-exchange-rates.json
>    [junit4]   2> 840706 T2346
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
> IMPORTANT NOTE
>    [junit4]   2> 840706 T2346
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
> key, got STRING
>    [junit4]   2> 840706 T2346 oasc.CoreContainer.create Creating SolrCore
> 'collection1' using configuration from collection control_collection
>    [junit4]   2> 840707 T2346 oasc.SolrCore.initDirectoryFactory
> org.apache.solr.core.MockDirectoryFactory
>    [junit4]   2> 840707 T2346 oasc.SolrCore.<init> [collection1] Opening
> new SolrCore at
> ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/collection1/,
> dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/control/data/
>    [junit4]   2> 840707 T2346 oasc.JmxMonitoredMap.<init> JMX monitoring
> is enabled. Adding Solr mbeans to JMX Server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@2fb2b6a6
>    [junit4]   2> 840708 T2346 oasc.CachingDirectoryFactory.get return new
> directory for
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/control/data
>    [junit4]   2> 840708 T2346 oasc.SolrCore.getNewIndexDir New index
> directory detected: old=null
> new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/control/data/index/
>    [junit4]   2> 840709 T2346 oasc.SolrCore.initIndex WARN [collection1]
> Solr index directory
> '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/control/data/index'
> doesn't exist. Creating new index...
>    [junit4]   2> 840709 T2346 oasc.CachingDirectoryFactory.get return new
> directory for
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/control/data/index
>    [junit4]   2> 840710 T2346 oasu.RandomMergePolicy.<init>
> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy:
> [LogDocMergePolicy: minMergeSize=1000, mergeFactor=24,
> maxMergeSize=9223372036854775807,
> maxMergeSizeForForcedMerge=9223372036854775807,
> calibrateSizeByDeletes=false, maxMergeDocs=2147483647,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
>    [junit4]   2> 840710 T2346 oasc.SolrDeletionPolicy.onCommit
> SolrDeletionPolicy.onCommit: commits: num=1
>    [junit4]   2>
> commit{dir=MockDirectoryWrapper(RAMDirectory@4625a372
> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3a8a04e8
> ),segFN=segments_1,generation=1}
>    [junit4]   2> 840711 T2346 oasc.SolrDeletionPolicy.updateCommits newest
> commit generation = 1
>    [junit4]   2> 840717 T2346 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "nodistrib"
>    [junit4]   2> 840717 T2346 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "dedupe"
>    [junit4]   2> 840718 T2346 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "dedupe"
>    [junit4]   2> 840718 T2346 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "stored_sig"
>    [junit4]   2> 840718 T2346 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "stored_sig"
>    [junit4]   2> 840718 T2346 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
>    [junit4]   2> 840720 T2346 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>    [junit4]   2> 840720 T2346 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>    [junit4]   2> 840720 T2346 oasc.SolrCore.loadUpdateProcessorChains no
> updateRequestProcessorChain defined as default, creating implicit default
>    [junit4]   2> 840721 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created /update: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 840721 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created /update/json: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 840722 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created /update/csv: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 840723 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 840724 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created /config: org.apache.solr.handler.SolrConfigHandler
>    [junit4]   2> 840724 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created /schema: org.apache.solr.handler.SchemaHandler
>    [junit4]   2> 840725 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created /replication: org.apache.solr.handler.ReplicationHandler
>    [junit4]   2> 840726 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created /get: org.apache.solr.handler.RealTimeGetHandler
>    [junit4]   2> 840727 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
>    [junit4]   2> 840728 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
>    [junit4]   2> 840729 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
>    [junit4]   2> 840730 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
>    [junit4]   2> 840730 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
>    [junit4]   2> 840731 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/properties:
> org.apache.solr.handler.admin.PropertiesRequestHandler
>    [junit4]   2> 840732 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
>    [junit4]   2> 840733 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/ping: org.apache.solr.handler.PingRequestHandler
>    [junit4]   2> 840733 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created standard: solr.StandardRequestHandler
>    [junit4]   2> 840734 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/file: solr.admin.ShowFileRequestHandler
>    [junit4]   2> 840734 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/fileedit: solr.admin.EditFileRequestHandler
>    [junit4]   2> 840747 T2346 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
>    [junit4]   2> 840749 T2346 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
>    [junit4]   2> 840750 T2346 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
>    [junit4]   2> 840752 T2346 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
>    [junit4]   2> 840757 T2346 oasu.CommitTracker.<init> Hard AutoCommit:
> disabled
>    [junit4]   2> 840758 T2346 oasu.CommitTracker.<init> Soft AutoCommit:
> disabled
>    [junit4]   2> 840758 T2346 oasu.RandomMergePolicy.<init>
> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy:
> [LogDocMergePolicy: minMergeSize=1000, mergeFactor=12,
> maxMergeSize=9223372036854775807,
> maxMergeSizeForForcedMerge=9223372036854775807,
> calibrateSizeByDeletes=true, maxMergeDocs=2147483647,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
>    [junit4]   2> 840759 T2346 oasc.SolrDeletionPolicy.onInit
> SolrDeletionPolicy.onInit: commits: num=1
>    [junit4]   2>
> commit{dir=MockDirectoryWrapper(RAMDirectory@4625a372
> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3a8a04e8
> ),segFN=segments_1,generation=1}
>    [junit4]   2> 840759 T2346 oasc.SolrDeletionPolicy.updateCommits newest
> commit generation = 1
>    [junit4]   2> 840760 T2346 oass.SolrIndexSearcher.<init> Opening
> Searcher@4de3bbc[collection1] main
>    [junit4]   2> 840760 T2346 oascc.ZkStateReader.readConfigName Load
> collection config from:/collections/control_collection
>    [junit4]   2> 840763 T2346 oascc.ZkStateReader.readConfigName
> path=/collections/control_collection configName=conf1 specified config
> exists in ZooKeeper
>    [junit4]   2> 840763 T2346 oasr.ManagedResourceStorage.newStorageIO
> Setting up ZooKeeper-based storage for the RestManager with znodeBase:
> /configs/conf1
>    [junit4]   2> 840764 T2346
> oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured
> ZooKeeperStorageIO with znodeBase: /configs/conf1
>    [junit4]   2> 840765 T2346 oasr.RestManager.init Initializing
> RestManager with initArgs: {}
>    [junit4]   2> 840765 T2346 oasr.ManagedResourceStorage.load Reading
> _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
>    [junit4]   2> 840768 T2346
> oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data
> found for znode /configs/conf1/_rest_managed.json
>    [junit4]   2> 840768 T2346 oasr.ManagedResourceStorage.load Loaded null
> at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
>    [junit4]   2> 840770 T2346 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/_rest_managed.json
>    [junit4]   2> 840776 T2346
> oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to
> new znode /configs/conf1/_rest_managed.json
>    [junit4]   2> 840776 T2346
> oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path
> _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
>    [junit4]   2> 840776 T2346 oasr.RestManager.init Initializing 0
> registered ManagedResources
>    [junit4]   2> 840776 T2346 oash.ReplicationHandler.inform Commits will
> be reserved for  10000
>    [junit4]   2> 840778 T2347 oasc.SolrCore.registerSearcher [collection1]
> Registered new searcher Searcher@4de3bbc[collection1]
> main{ExitableDirectoryReader(UninvertingDirectoryReader())}
>    [junit4]   2> 840779 T2346 oasc.CoreContainer.registerCore registering
> core: collection1
>    [junit4]   2> 840782 T2350 oasc.ZkController.register Register replica
> - core:collection1 address:http://127.0.0.1:49857
> collection:control_collection shard:shard1
>    [junit4]   2> 840782 T2316 oass.SolrDispatchFilter.init
> user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
>    [junit4]   2> 840783 T2316 oass.SolrDispatchFilter.init
> SolrDispatchFilter.init() done
>    [junit4]   2> 840783 T2316
> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
> ZkCredentialsProvider
>    [junit4]   2> 840785 T2316 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
>    [junit4]   2> 840793 T2353 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@7d66f1d9
> name:ZooKeeperConnection Watcher:127.0.0.1:49854/solr got event
> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>    [junit4]   2> 840793 T2316 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
>    [junit4]   2> 840794 T2316 oascc.SolrZkClient.createZkACLProvider Using
> default ZkACLProvider
>    [junit4]   2> 840796 T2316
> oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster
> state from ZooKeeper...
>    [junit4]   2> 840798 T2350 oascc.SolrZkClient.makePath makePath:
> /collections/control_collection/leader_elect/shard1/election
>    [junit4]   2> 840805 T2316 oasc.ChaosMonkey.monkeyLog monkey: init -
> expire sessions:false cause connection loss:false
>    [junit4]   2> 840805 T2316
> oasc.AbstractFullDistribZkTestBase.createJettys Creating collection1 with
> stateFormat=2
>    [junit4]   2> 840807 T2316
> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
> ZkCredentialsProvider
>    [junit4]   2> 840811 T2316 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
>    [junit4]   2> 840816 T2356 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@4d205ac9
> name:ZooKeeperConnection Watcher:127.0.0.1:49854/solr got event
> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>    [junit4]   2> 840817 T2316 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
>    [junit4]   2> 840817 T2316 oascc.SolrZkClient.createZkACLProvider Using
> default ZkACLProvider
>    [junit4]   2> 840824 T2342 oasc.DistributedQueue$LatchWatcher.process
> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>    [junit4]   2> 840845 T2343 oasc.Overseer$ClusterStateUpdater.run
> processMessage: queueSize: 1, message = {
>    [junit4]   2>          "operation":"create",
>    [junit4]   2>          "name":"collection1",
>    [junit4]   2>          "numShards":"2",
>    [junit4]   2>          "stateFormat":2} current state version: 1
>    [junit4]   2> 840845 T2343 oasco.ClusterStateMutator.createCollection
> building a new cName: collection1
>    [junit4]   2> 840860 T2350
> oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process
> for shard shard1
>    [junit4]   2> 840879 T2350
> oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas
> found to continue.
>    [junit4]   2> 840880 T2350
> oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader -
> try and sync
>    [junit4]   2> ASYNC  NEW_CORE C1382 name=collection1
> org.apache.solr.core.SolrCore@755e68c7 url=
> http://127.0.0.1:49857/collection1 node=127.0.0.1:49857_
> C1382_STATE=coll:control_collection core:collection1
> props:{core=collection1, base_url=http://127.0.0.1:49857,
> node_name=127.0.0.1:49857_, state=down}
>    [junit4]   2> 840880 T2350 C1382 P49857 oasc.SyncStrategy.sync Sync
> replicas to http://127.0.0.1:49857/collection1/
>    [junit4]   2> 840881 T2350 C1382 P49857 oasc.SyncStrategy.syncReplicas
> Sync Success - now sync replicas to me
>    [junit4]   2> 840881 T2350 C1382 P49857 oasc.SyncStrategy.syncToMe
> http://127.0.0.1:49857/collection1/ has no replicas
>    [junit4]   2> 840881 T2350
> oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader:
> http://127.0.0.1:49857/collection1/ shard1
>    [junit4]   2> 840881 T2350 oascc.SolrZkClient.makePath makePath:
> /collections/control_collection/leaders/shard1
>    [junit4]   2> 840884 T2343 oasc.Overseer$ClusterStateUpdater.run
> processMessage: queueSize: 1, message = {
>    [junit4]   2>          "operation":"leader",
>    [junit4]   2>          "shard":"shard1",
>    [junit4]   2>          "collection":"control_collection"} current state
> version: 1
>    [junit4]   2> 840890 T2343 oasco.ZkStateWriter.writePendingUpdates
> going to create_collection /collections/collection1/state.json
>    [junit4]   2> 840897 T2353 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>    [junit4]   2> 840897 T2342 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>    [junit4]   2> 840915 T2357 oasc.DistributedQueue$LatchWatcher.process
> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>    [junit4]   2> 840933 T2343 oasc.Overseer$ClusterStateUpdater.run
> processMessage: queueSize: 1, message = {
>    [junit4]   2>          "operation":"leader",
>    [junit4]   2>          "shard":"shard1",
>    [junit4]   2>          "collection":"control_collection",
>    [junit4]   2>          "base_url":"http://127.0.0.1:49857",
>    [junit4]   2>          "core":"collection1",
>    [junit4]   2>          "state":"active"} current state version: 2
>    [junit4]   2> 840947 T2357 oasc.DistributedQueue$LatchWatcher.process
> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>    [junit4]   2> 841053 T2353 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>    [junit4]   2> 841127 T2350 oasc.ZkController.register We are
> http://127.0.0.1:49857/collection1/ and leader is
> http://127.0.0.1:49857/collection1/
>    [junit4]   2> 841127 T2350 oasc.ZkController.register No LogReplay
> needed for core=collection1 baseURL=http://127.0.0.1:49857
>    [junit4]   2> 841127 T2350 oasc.ZkController.checkRecovery I am the
> leader, no recovery necessary
>    [junit4]   2> 841130 T2350 oasc.ZkController.publish publishing
> core=collection1 state=active collection=control_collection
>    [junit4]   2> 841132 T2350 oasc.ZkController.publish numShards not
> found on descriptor - reading it from system property
>    [junit4]   2> 841139 T2342 oasc.DistributedQueue$LatchWatcher.process
> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>    [junit4]   2> 841156 T2343 oasc.Overseer$ClusterStateUpdater.run
> processMessage: queueSize: 1, message = {
>    [junit4]   2>          "core":"collection1",
>    [junit4]   2>          "core_node_name":"core_node1",
>    [junit4]   2>          "roles":null,
>    [junit4]   2>          "base_url":"http://127.0.0.1:49857",
>    [junit4]   2>          "node_name":"127.0.0.1:49857_",
>    [junit4]   2>          "numShards":"2",
>    [junit4]   2>          "state":"active",
>    [junit4]   2>          "shard":"shard1",
>    [junit4]   2>          "collection":"control_collection",
>    [junit4]   2>          "operation":"state"} current state version: 3
>    [junit4]   2> 841159 T2343 oasco.ReplicaMutator.updateState Update
> state numShards=2 message={
>    [junit4]   2>          "core":"collection1",
>    [junit4]   2>          "core_node_name":"core_node1",
>    [junit4]   2>          "roles":null,
>    [junit4]   2>          "base_url":"http://127.0.0.1:49857",
>    [junit4]   2>          "node_name":"127.0.0.1:49857_",
>    [junit4]   2>          "numShards":"2",
>    [junit4]   2>          "state":"active",
>    [junit4]   2>          "shard":"shard1",
>    [junit4]   2>          "collection":"control_collection",
>    [junit4]   2>          "operation":"state"}
>    [junit4]   2> 841276 T2353 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>    [junit4]   2> 841276 T2342 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>    [junit4]   2> 842764 T2316
> oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
>    [junit4]   2> 842765 T2316 oejs.Server.doStart jetty-8.1.10.v20130312
>    [junit4]   2> 842771 T2316 oejs.AbstractConnector.doStart Started
> SelectChannelConnector@127.0.0.1:49862
>    [junit4]   2> 842772 T2316 oass.SolrDispatchFilter.init
> SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
>    [junit4]   2> 842772 T2316 oasc.SolrResourceLoader.locateSolrHome JNDI
> not configured for solr (NoInitialContextEx)
>    [junit4]   2> 842772 T2316 oasc.SolrResourceLoader.locateSolrHome using
> system property solr.solr.home:
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003
>    [junit4]   2> 842773 T2316 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/'
>    [junit4]   2> 842810 T2316 oasc.ConfigSolr.fromFile Loading container
> configuration from
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/solr.xml
>    [junit4]   2> 842829 T2316 oasc.CoreContainer.<init> New CoreContainer
> 335265571
>    [junit4]   2> 842829 T2316 oasc.CoreContainer.load Loading cores into
> CoreContainer
> [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/]
>    [junit4]   2> 842830 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting socketTimeout to: 90000
>    [junit4]   2> 842830 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting urlScheme to:
>    [junit4]   2> 842830 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting connTimeout to: 15000
>    [junit4]   2> 842831 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting maxConnectionsPerHost to: 20
>    [junit4]   2> 842831 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting maxConnections to: 10000
>    [junit4]   2> 842832 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting corePoolSize to: 0
>    [junit4]   2> 842832 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting maximumPoolSize to: 2147483647
>    [junit4]   2> 842832 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting maxThreadIdleTime to: 5
>    [junit4]   2> 842833 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting sizeOfQueue to: -1
>    [junit4]   2> 842834 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting fairnessPolicy to: false
>    [junit4]   2> 842835 T2316 oasu.UpdateShardHandler.<init> Creating
> UpdateShardHandler HTTP client with params:
> socketTimeout=340000&connTimeout=45000&retry=false
>    [junit4]   2> 842836 T2316 oasl.LogWatcher.createWatcher SLF4J impl is
> org.slf4j.impl.Log4jLoggerFactory
>    [junit4]   2> 842836 T2316 oasl.LogWatcher.newRegisteredLogWatcher
> Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>    [junit4]   2> 842837 T2316 oasc.CoreContainer.load Host Name: 127.0.0.1
>    [junit4]   2> 842837 T2316 oasc.ZkContainer.initZooKeeper Zookeeper
> client=127.0.0.1:49854/solr
>    [junit4]   2> 842837 T2316 oasc.ZkController.checkChrootPath zkHost
> includes chroot
>    [junit4]   2> 842838 T2316
> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
> ZkCredentialsProvider
>    [junit4]   2> 842839 T2316 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
>    [junit4]   2> 842844 T2369 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@7f590f35
> name:ZooKeeperConnection Watcher:127.0.0.1:49854 got event WatchedEvent
> state:SyncConnected type:None path:null path:null type:None
>    [junit4]   2> 842845 T2316 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
>    [junit4]   2> 842846 T2316 oascc.SolrZkClient.createZkACLProvider Using
> default ZkACLProvider
>    [junit4]   2> 842852 T2316 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
>    [junit4]   2> 842859 T2372 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@634dd196
> name:ZooKeeperConnection Watcher:127.0.0.1:49854/solr got event
> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>    [junit4]   2> 842859 T2316 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
>    [junit4]   2> 842884 T2316
> oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster
> state from ZooKeeper...
>    [junit4]   2> 843905 T2316 oasc.ZkController.createEphemeralLiveNode
> Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49862_
>    [junit4]   2> 843907 T2316 oascc.SolrZkClient.makePath makePath:
> /live_nodes/127.0.0.1:49862_
>    [junit4]   2> 843919 T2316 oasc.Overseer.close Overseer (id=null)
> closing
>    [junit4]   2> 843934 T2373 oasc.ZkController.publish publishing
> core=collection1 state=down collection=collection1
>    [junit4]   2> 843934 T2373 oasc.ZkController.publish numShards not
> found on descriptor - reading it from system property
>    [junit4]   2> 843941 T2342 oasc.DistributedQueue$LatchWatcher.process
> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>    [junit4]   2> 843941 T2373 oasc.ZkController.preRegister Registering
> watch for external collection collection1
>    [junit4]   2> 843944 T2373 oascc.ZkStateReader.addZkWatch addZkWatch
> collection1
>    [junit4]   2> 843943 T2343 oasc.Overseer$ClusterStateUpdater.run
> processMessage: queueSize: 1, message = {
>    [junit4]   2>          "core":"collection1",
>    [junit4]   2>          "roles":null,
>    [junit4]   2>          "base_url":"http://127.0.0.1:49862",
>    [junit4]   2>          "node_name":"127.0.0.1:49862_",
>    [junit4]   2>          "numShards":"2",
>    [junit4]   2>          "state":"down",
>    [junit4]   2>          "shard":null,
>    [junit4]   2>          "collection":"collection1",
>    [junit4]   2>          "operation":"state"} current state version: 4
>    [junit4]   2> 843945 T2373 oascc.ZkStateReader.addZkWatch Updating
> collection state at /collections/collection1/state.json from ZooKeeper...
>    [junit4]   2> 843946 T2343 oasco.ReplicaMutator.updateState Update
> state numShards=2 message={
>    [junit4]   2>          "core":"collection1",
>    [junit4]   2>          "roles":null,
>    [junit4]   2>          "base_url":"http://127.0.0.1:49862",
>    [junit4]   2>          "node_name":"127.0.0.1:49862_",
>    [junit4]   2>          "numShards":"2",
>    [junit4]   2>          "state":"down",
>    [junit4]   2>          "shard":null,
>    [junit4]   2>          "collection":"collection1",
>    [junit4]   2>          "operation":"state"}
>    [junit4]   2> 843947 T2343 oasco.ReplicaMutator.updateState Collection
> already exists with numShards=2
>    [junit4]   2> 843947 T2343 oasco.ReplicaMutator.updateState Assigning
> new node to shard shard=shard2
>    [junit4]   2> 843950 T2373 oascc.ZkStateReader.updateWatchedCollection
> Updating data for collection1 to ver 0
>    [junit4]   2> 843950 T2373 oasc.ZkController.waitForCoreNodeName look
> for our core node name
>    [junit4]   2> 843952 T2343 oasco.ZkStateWriter.writePendingUpdates
> going to update_collection /collections/collection1/state.json version: 0
>    [junit4]   2> 843953 T2372 oascc.ZkStateReader$7.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/collection1/state.json, has occurred - updating...
>    [junit4]   2> 843955 T2372 oascc.ZkStateReader.updateWatchedCollection
> Updating data for collection1 to ver 1
>    [junit4]   2> 844953 T2373 oasc.ZkController.waitForShardId waiting to
> find shard id in clusterstate for collection1
>    [junit4]   2> 844954 T2373 oasc.ZkController.createCollectionZkNode
> Check for collection zkNode:collection1
>    [junit4]   2> 844957 T2373 oasc.ZkController.createCollectionZkNode
> Collection zkNode exists
>    [junit4]   2> 844957 T2373 oascc.ZkStateReader.readConfigName Load
> collection config from:/collections/collection1
>    [junit4]   2> 844964 T2373 oascc.ZkStateReader.readConfigName
> path=/collections/collection1 configName=conf1 specified config exists in
> ZooKeeper
>    [junit4]   2> 844965 T2373 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/collection1/'
>    [junit4]   2> 844967 T2373 oasc.SolrResourceLoader.replaceClassLoader
> Adding
> 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/collection1/lib/.svn/'
> to classloader
>    [junit4]   2> 844968 T2373 oasc.SolrResourceLoader.replaceClassLoader
> Adding
> 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/collection1/lib/classes/'
> to classloader
>    [junit4]   2> 844969 T2373 oasc.SolrResourceLoader.replaceClassLoader
> Adding
> 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/collection1/lib/README'
> to classloader
>    [junit4]   2> 845009 T2373 oasc.ZkController.watchZKConfDir watch zkdir
> /configs/conf1
>    [junit4]   2> 845015 T2373 oasc.Config.<init> loaded config
> solrconfig.xml with version 0
>    [junit4]   2> 845033 T2373 oasc.SolrConfig.<init> Using Lucene
> MatchVersion: 6.0.0
>    [junit4]   2> 845046 T2373 oasc.SolrConfig.<init> Loaded SolrConfig:
> solrconfig.xml
>    [junit4]   2> 845049 T2373 oass.IndexSchema.readSchema Reading Solr
> Schema from /configs/conf1/schema.xml
>    [junit4]   2> 845056 T2373 oass.IndexSchema.readSchema [collection1]
> Schema name=test
>    [junit4]   2> 845191 T2373 oass.OpenExchangeRatesOrgProvider.init
> Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
>    [junit4]   2> 845206 T2373 oass.IndexSchema.readSchema default search
> field in schema is text
>    [junit4]   2> 845207 T2373 oass.IndexSchema.readSchema unique key
> field: id
>    [junit4]   2> 845244 T2373 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
>    [junit4]   2> 845249 T2373 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
>    [junit4]   2> 845253 T2373 oass.OpenExchangeRatesOrgProvider.reload
> Reloading exchange rates from open-exchange-rates.json
>    [junit4]   2> 845256 T2373
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
> IMPORTANT NOTE
>    [junit4]   2> 845258 T2373
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
> key, got STRING
>    [junit4]   2> 845258 T2373 oass.OpenExchangeRatesOrgProvider.reload
> Reloading exchange rates from open-exchange-rates.json
>    [junit4]   2> 845262 T2373
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
> IMPORTANT NOTE
>    [junit4]   2> 845262 T2373
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
> key, got STRING
>    [junit4]   2> 845263 T2373 oasc.CoreContainer.create Creating SolrCore
> 'collection1' using configuration from collection collection1
>    [junit4]   2> 845263 T2373 oasc.SolrCore.initDirectoryFactory
> org.apache.solr.core.MockDirectoryFactory
>    [junit4]   2> 845263 T2373 oasc.SolrCore.<init> [collection1] Opening
> new SolrCore at
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/collection1/,
> dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty1/
>    [junit4]   2> 845264 T2373 oasc.JmxMonitoredMap.<init> JMX monitoring
> is enabled. Adding Solr mbeans to JMX Server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@2fb2b6a6
>    [junit4]   2> 845264 T2373 oasc.CachingDirectoryFactory.get return new
> directory for
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty1
>    [junit4]   2> 845265 T2373 oasc.SolrCore.getNewIndexDir New index
> directory detected: old=null
> new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty1/index/
>    [junit4]   2> 845265 T2373 oasc.SolrCore.initIndex WARN [collection1]
> Solr index directory
> '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty1/index'
> doesn't exist. Creating new index...
>    [junit4]   2> 845265 T2373 oasc.CachingDirectoryFactory.get return new
> directory for
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty1/index
>    [junit4]   2> 845266 T2373 oasu.RandomMergePolicy.<init>
> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy:
> [LogDocMergePolicy: minMergeSize=1000, mergeFactor=24,
> maxMergeSize=9223372036854775807,
> maxMergeSizeForForcedMerge=9223372036854775807,
> calibrateSizeByDeletes=false, maxMergeDocs=2147483647,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
>    [junit4]   2> 845267 T2373 oasc.SolrDeletionPolicy.onCommit
> SolrDeletionPolicy.onCommit: commits: num=1
>    [junit4]   2>
> commit{dir=MockDirectoryWrapper(RAMDirectory@2fb05928
> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@19766ec3
> ),segFN=segments_1,generation=1}
>    [junit4]   2> 845267 T2373 oasc.SolrDeletionPolicy.updateCommits newest
> commit generation = 1
>    [junit4]   2> 845273 T2373 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "nodistrib"
>    [junit4]   2> 845273 T2373 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "dedupe"
>    [junit4]   2> 845274 T2373 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "dedupe"
>    [junit4]   2> 845274 T2373 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "stored_sig"
>    [junit4]   2> 845274 T2373 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "stored_sig"
>    [junit4]   2> 845274 T2373 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
>    [junit4]   2> 845275 T2373 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>    [junit4]   2> 845275 T2373 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>    [junit4]   2> 845275 T2373 oasc.SolrCore.loadUpdateProcessorChains no
> updateRequestProcessorChain defined as default, creating implicit default
>    [junit4]   2> 845276 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created /update: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 845276 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created /update/json: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 845277 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created /update/csv: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 845277 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 845278 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created /config: org.apache.solr.handler.SolrConfigHandler
>    [junit4]   2> 845278 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created /schema: org.apache.solr.handler.SchemaHandler
>    [junit4]   2> 845280 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created /replication: org.apache.solr.handler.ReplicationHandler
>    [junit4]   2> 845280 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created /get: org.apache.solr.handler.RealTimeGetHandler
>    [junit4]   2> 845281 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
>    [junit4]   2> 845285 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
>    [junit4]   2> 845286 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
>    [junit4]   2> 845286 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
>    [junit4]   2> 845287 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
>    [junit4]   2> 845287 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/properties:
> org.apache.solr.handler.admin.PropertiesRequestHandler
>    [junit4]   2> 845287 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
>    [junit4]   2> 845288 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/ping: org.apache.solr.handler.PingRequestHandler
>    [junit4]   2> 845288 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created standard: solr.StandardRequestHandler
>    [junit4]   2> 845289 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/file: solr.admin.ShowFileRequestHandler
>    [junit4]   2> 845289 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/fileedit: solr.admin.EditFileRequestHandler
>    [junit4]   2> 845296 T2373 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
>    [junit4]   2> 845297 T2373 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
>    [junit4]   2> 845298 T2373 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
>    [junit4]   2> 845299 T2373 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
>    [junit4]   2> 845301 T2373 oasu.CommitTracker.<init> Hard AutoCommit:
> disabled
>    [junit4]   2> 845302 T2373 oasu.CommitTracker.<init> Soft AutoCommit:
> disabled
>    [junit4]   2> 845303 T2373 oasu.RandomMergePolicy.<init>
> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy:
> [LogDocMergePolicy: minMergeSize=1000, mergeFactor=12,
> maxMergeSize=9223372036854775807,
> maxMergeSizeForForcedMerge=9223372036854775807,
> calibrateSizeByDeletes=true, maxMergeDocs=2147483647,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
>    [junit4]   2> 845304 T2373 oasc.SolrDeletionPolicy.onInit
> SolrDeletionPolicy.onInit: commits: num=1
>    [junit4]   2>
> commit{dir=MockDirectoryWrapper(RAMDirectory@2fb05928
> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@19766ec3
> ),segFN=segments_1,generation=1}
>    [junit4]   2> 845304 T2373 oasc.SolrDeletionPolicy.updateCommits newest
> commit generation = 1
>    [junit4]   2> 845304 T2373 oass.SolrIndexSearcher.<init> Opening
> Searcher@1466a306[collection1] main
>    [junit4]   2> 845305 T2373 oascc.ZkStateReader.readConfigName Load
> collection config from:/collections/collection1
>    [junit4]   2> 845307 T2373 oascc.ZkStateReader.readConfigName
> path=/collections/collection1 configName=conf1 specified config exists in
> ZooKeeper
>    [junit4]   2> 845308 T2373 oasr.ManagedResourceStorage.newStorageIO
> Setting up ZooKeeper-based storage for the RestManager with znodeBase:
> /configs/conf1
>    [junit4]   2> 845309 T2373
> oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured
> ZooKeeperStorageIO with znodeBase: /configs/conf1
>    [junit4]   2> 845309 T2373 oasr.RestManager.init Initializing
> RestManager with initArgs: {}
>    [junit4]   2> 845309 T2373 oasr.ManagedResourceStorage.load Reading
> _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
>    [junit4]   2> 845313 T2373
> oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38
> bytes from znode /configs/conf1/_rest_managed.json
>    [junit4]   2> 845313 T2373 oasr.ManagedResourceStorage.load Loaded
> LinkedHashMap at path _rest_managed.json using
> ZooKeeperStorageIO:path=/configs/conf1
>    [junit4]   2> 845313 T2373 oasr.ManagedResource.reloadFromStorage
> Loaded initArgs {} for /rest/managed
>    [junit4]   2> 845314 T2373 oasr.RestManager.init Initializing 0
> registered ManagedResources
>    [junit4]   2> 845314 T2373 oash.ReplicationHandler.inform Commits will
> be reserved for  10000
>    [junit4]   2> 845315 T2374 oasc.SolrCore.registerSearcher [collection1]
> Registered new searcher Searcher@1466a306[collection1]
> main{ExitableDirectoryReader(UninvertingDirectoryReader())}
>    [junit4]   2> 845315 T2373 oasc.CoreContainer.registerCore registering
> core: collection1
>    [junit4]   2> 845317 T2377 oasc.ZkController.register Register replica
> - core:collection1 address:http://127.0.0.1:49862 collection:collection1
> shard:shard2
>    [junit4]   2> 845318 T2316 oass.SolrDispatchFilter.init
> user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
>    [junit4]   2> 845319 T2316 oass.SolrDispatchFilter.init
> SolrDispatchFilter.init() done
>    [junit4]   2> 845320 T2377 oascc.SolrZkClient.makePath makePath:
> /collections/collection1/leader_elect/shard2/election
>    [junit4]   2> 845338 T2377
> oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process
> for shard shard2
>    [junit4]   2> 845345 T2342 oasc.DistributedQueue$LatchWatcher.process
> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>    [junit4]   2> 845347 T2377
> oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas
> found to continue.
>    [junit4]   2> 845347 T2377
> oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader -
> try and sync
>    [junit4]   2> ASYNC  NEW_CORE C1383 name=collection1
> org.apache.solr.core.SolrCore@2dc8d5fa url=
> http://127.0.0.1:49862/collection1 node=127.0.0.1:49862_
> C1383_STATE=coll:collection1 core:collection1 props:{core=collection1,
> base_url=http://127.0.0.1:49862, node_name=127.0.0.1:49862_, state=down}
>    [junit4]   2> 845347 T2377 C1383 P49862 oasc.SyncStrategy.sync Sync
> replicas to http://127.0.0.1:49862/collection1/
>    [junit4]   2> 845348 T2377 C1383 P49862 oasc.SyncStrategy.syncReplicas
> Sync Success - now sync replicas to me
>    [junit4]   2> 845348 T2377 C1383 P49862 oasc.SyncStrategy.syncToMe
> http://127.0.0.1:49862/collection1/ has no replicas
>    [junit4]   2> 845348 T2377
> oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader:
> http://127.0.0.1:49862/collection1/ shard2
>    [junit4]   2> 845348 T2377 oascc.SolrZkClient.makePath makePath:
> /collections/collection1/leaders/shard2
>    [junit4]   2> 845349 T2343 oasc.Overseer$ClusterStateUpdater.run
> processMessage: queueSize: 1, message = {
>    [junit4]   2>          "operation":"leader",
>    [junit4]   2>          "shard":"shard2",
>    [junit4]   2>          "collection":"collection1"} current state
> version: 4
>    [junit4]   2> 845357 T2343 oasco.ZkStateWriter.writePendingUpdates
> going to update_collection /collections/collection1/state.json version: 1
>    [junit4]   2> 845361 T2372 oascc.ZkStateReader$7.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/collection1/state.json, has occurred - updating...
>    [junit4]   2> 845364 T2372 oascc.ZkStateReader.updateWatchedCollection
> Updating data for collection1 to ver 2
>    [junit4]   2> 845390 T2342 oasc.DistributedQueue$LatchWatcher.process
> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>    [junit4]   2> 845393 T2343 oasc.Overseer$ClusterStateUpdater.run
> processMessage: queueSize: 1, message = {
>    [junit4]   2>          "operation":"leader",
>    [junit4]   2>          "shard":"shard2",
>    [junit4]   2>          "collection":"collection1",
>    [junit4]   2>          "base_url":"http://127.0.0.1:49862",
>    [junit4]   2>          "core":"collection1",
>    [junit4]   2>          "state":"active"} current state version: 4
>    [junit4]   2> 845396 T2343 oasco.ZkStateWriter.writePendingUpdates
> going to update_collection /collections/collection1/state.json version: 2
>    [junit4]   2> 845397 T2372 oascc.ZkStateReader$7.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/collection1/state.json, has occurred - updating...
>    [junit4]   2> 845401 T2372 oascc.ZkStateReader.updateWatchedCollection
> Updating data for collection1 to ver 3
>    [junit4]   2> 845446 T2377 oasc.ZkController.register We are
> http://127.0.0.1:49862/collection1/ and leader is
> http://127.0.0.1:49862/collection1/
>    [junit4]   2> 845446 T2377 oasc.ZkController.register No LogReplay
> needed for core=collection1 baseURL=http://127.0.0.1:49862
>    [junit4]   2> 845447 T2377 oasc.ZkController.checkRecovery I am the
> leader, no recovery necessary
>    [junit4]   2> 845447 T2377 oasc.ZkController.publish publishing
> core=collection1 state=active collection=collection1
>    [junit4]   2> 845447 T2377 oasc.ZkController.publish numShards not
> found on descriptor - reading it from system property
>    [junit4]   2> 845450 T2342 oasc.DistributedQueue$LatchWatcher.process
> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>    [junit4]   2> 845455 T2343 oasc.Overseer$ClusterStateUpdater.run
> processMessage: queueSize: 1, message = {
>    [junit4]   2>          "core":"collection1",
>    [junit4]   2>          "core_node_name":"core_node1",
>    [junit4]   2>          "roles":null,
>    [junit4]   2>          "base_url":"http://127.0.0.1:49862",
>    [junit4]   2>          "node_name":"127.0.0.1:49862_",
>    [junit4]   2>          "numShards":"2",
>    [junit4]   2>          "state":"active",
>    [junit4]   2>          "shard":"shard2",
>    [junit4]   2>          "collection":"collection1",
>    [junit4]   2>          "operation":"state"} current state version: 4
>    [junit4]   2> 845459 T2343 oasco.ReplicaMutator.updateState Update
> state numShards=2 message={
>    [junit4]   2>          "core":"collection1",
>    [junit4]   2>          "core_node_name":"core_node1",
>    [junit4]   2>          "roles":null,
>    [junit4]   2>          "base_url":"http://127.0.0.1:49862",
>    [junit4]   2>          "node_name":"127.0.0.1:49862_",
>    [junit4]   2>          "numShards":"2",
>    [junit4]   2>          "state":"active",
>    [junit4]   2>          "shard":"shard2",
>    [junit4]   2>          "collection":"collection1",
>    [junit4]   2>          "operation":"state"}
>    [junit4]   2> 845466 T2343 oasco.ZkStateWriter.writePendingUpdates
> going to update_collection /collections/collection1/state.json version: 3
>    [junit4]   2> 845475 T2372 oascc.ZkStateReader$7.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/collection1/state.json, has occurred - updating...
>    [junit4]   2> 845481 T2377 oascc.ZkStateReader.updateWatchedCollection
> Updating data for collection1 to ver 4
>    [junit4]   2> 845483 T2372 oascc.ZkStateReader.updateWatchedCollection
> Updating data for collection1 to ver 4
>    [junit4]   2> 847246 T2316
> oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
>    [junit4]   2> 847247 T2316 oejs.Server.doStart jetty-8.1.10.v20130312
>    [junit4]   2> 847252 T2316 oejs.AbstractConnector.doStart Started
> SelectChannelConnector@127.0.0.1:49865
>    [junit4]   2> 847253 T2316 oass.SolrDispatchFilter.init
> SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
>    [junit4]   2> 847254 T2316 oasc.SolrResourceLoader.locateSolrHome JNDI
> not configured for solr (NoInitialContextEx)
>    [junit4]   2> 847254 T2316 oasc.SolrResourceLoader.locateSolrHome using
> system property solr.solr.home:
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004
>    [junit4]   2> 847255 T2316 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/'
>    [junit4]   2> 847309 T2316 oasc.ConfigSolr.fromFile Loading container
> configuration from
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/solr.xml
>    [junit4]   2> 847325 T2316 oasc.CoreContainer.<init> New CoreContainer
> 1078127689
>    [junit4]   2> 847325 T2316 oasc.CoreContainer.load Loading cores into
> CoreContainer
> [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/]
>    [junit4]   2> 847326 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting socketTimeout to: 90000
>    [junit4]   2> 847326 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting urlScheme to:
>    [junit4]   2> 847326 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting connTimeout to: 15000
>    [junit4]   2> 847326 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting maxConnectionsPerHost to: 20
>    [junit4]   2> 847326 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting maxConnections to: 10000
>    [junit4]   2> 847327 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting corePoolSize to: 0
>    [junit4]   2> 847328 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting maximumPoolSize to: 2147483647
>    [junit4]   2> 847328 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting maxThreadIdleTime to: 5
>    [junit4]   2> 847328 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting sizeOfQueue to: -1
>    [junit4]   2> 847329 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting fairnessPolicy to: false
>    [junit4]   2> 847329 T2316 oasu.UpdateShardHandler.<init> Creating
> UpdateShardHandler HTTP client with params:
> socketTimeout=340000&connTimeout=45000&retry=false
>    [junit4]   2> 847330 T2316 oasl.LogWatcher.createWatcher SLF4J impl is
> org.slf4j.impl.Log4jLoggerFactory
>    [junit4]   2> 847330 T2316 oasl.LogWatcher.newRegisteredLogWatcher
> Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>    [junit4]   2> 847330 T2316 oasc.CoreContainer.load Host Name: 127.0.0.1
>    [junit4]   2> 847330 T2316 oasc.ZkContainer.initZooKeeper Zookeeper
> client=127.0.0.1:49854/solr
>    [junit4]   2> 847330 T2316 oasc.ZkController.checkChrootPath zkHost
> includes chroot
>    [junit4]   2> 847331 T2316
> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
> ZkCredentialsProvider
>    [junit4]   2> 847335 T2316 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
>    [junit4]   2> 847336 T2389 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@ece84e9
> name:ZooKeeperConnection Watcher:127.0.0.1:49854 got event WatchedEvent
> state:SyncConnected type:None path:null path:null type:None
>    [junit4]   2> 847338 T2316 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
>    [junit4]   2> 847338 T2316 oascc.SolrZkClient.createZkACLProvider Using
> default ZkACLProvider
>    [junit4]   2> 847344 T2316 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
>    [junit4]   2> 847347 T2392 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@634647ce
> name:ZooKeeperConnection Watcher:127.0.0.1:49854/solr got event
> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>    [junit4]   2> 847347 T2316 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
>    [junit4]   2> 847362 T2316
> oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster
> state from ZooKeeper...
>    [junit4]   2> 848381 T2316 oasc.ZkController.createEphemeralLiveNode
> Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49865_
>    [junit4]   2> 848388 T2316 oascc.SolrZkClient.makePath makePath:
> /live_nodes/127.0.0.1:49865_
>    [junit4]   2> 848403 T2316 oasc.Overseer.close Overseer (id=null)
> closing
>    [junit4]   2> 848422 T2393 oasc.ZkController.publish publishing
> core=collection1 state=down collection=collection1
>    [junit4]   2> 848422 T2393 oasc.ZkController.publish numShards not
> found on descriptor - reading it from system property
>    [junit4]   2> 848428 T2342 oasc.DistributedQueue$LatchWatcher.process
> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>    [junit4]   2> 848429 T2393 oasc.ZkController.preRegister Registering
> watch for external collection collection1
>    [junit4]   2> 848429 T2393 oascc.ZkStateReader.addZkWatch addZkWatch
> collection1
>    [junit4]   2> 848431 T2393 oascc.ZkStateReader.addZkWatch Updating
> collection state at /collections/collection1/state.json from ZooKeeper...
>    [junit4]   2> 848432 T2343 oasc.Overseer$ClusterStateUpdater.run
> processMessage: queueSize: 1, message = {
>    [junit4]   2>          "core":"collection1",
>    [junit4]   2>          "roles":null,
>    [junit4]   2>          "base_url":"http://127.0.0.1:49865",
>    [junit4]   2>          "node_name":"127.0.0.1:49865_",
>    [junit4]   2>          "numShards":"2",
>    [junit4]   2>          "state":"down",
>    [junit4]   2>          "shard":null,
>    [junit4]   2>          "collection":"collection1",
>    [junit4]   2>          "operation":"state"} current state version: 4
>    [junit4]   2> 848434 T2343 oasco.ReplicaMutator.updateState Update
> state numShards=2 message={
>    [junit4]   2>          "core":"collection1",
>    [junit4]   2>          "roles":null,
>    [junit4]   2>          "base_url":"http://127.0.0.1:49865",
>    [junit4]   2>          "node_name":"127.0.0.1:49865_",
>    [junit4]   2>          "numShards":"2",
>    [junit4]   2>          "state":"down",
>    [junit4]   2>          "shard":null,
>    [junit4]   2>          "collection":"collection1",
>    [junit4]   2>          "operation":"state"}
>    [junit4]   2> 848434 T2343 oasco.ReplicaMutator.updateState Collection
> already exists with numShards=2
>    [junit4]   2> 848435 T2393 oascc.ZkStateReader.updateWatchedCollection
> Updating data for collection1 to ver 4
>    [junit4]   2> 848435 T2343 oasco.ReplicaMutator.updateState Assigning
> new node to shard shard=shard1
>    [junit4]   2> 848435 T2393 oasc.ZkController.waitForCoreNodeName look
> for our core node name
>    [junit4]   2> 848440 T2343 oasco.ZkStateWriter.writePendingUpdates
> going to update_collection /collections/collection1/state.json version: 4
>    [junit4]   2> 848442 T2392 oascc.ZkStateReader$7.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/collection1/state.json, has occurred - updating...
>    [junit4]   2> 848442 T2372 oascc.ZkStateReader$7.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/collection1/state.json, has occurred - updating...
>    [junit4]   2> 848444 T2392 oascc.ZkStateReader.updateWatchedCollection
> Updating data for collection1 to ver 5
>    [junit4]   2> 848444 T2372 oascc.ZkStateReader.updateWatchedCollection
> Updating data for collection1 to ver 5
>    [junit4]   2> 849438 T2393 oasc.ZkController.waitForShardId waiting to
> find shard id in clusterstate for collection1
>    [junit4]   2> 849439 T2393 oasc.ZkController.createCollectionZkNode
> Check for collection zkNode:collection1
>    [junit4]   2> 849442 T2393 oasc.ZkController.createCollectionZkNode
> Collection zkNode exists
>    [junit4]   2> 849442 T2393 oascc.ZkStateReader.readConfigName Load
> collection config from:/collections/collection1
>    [junit4]   2> 849445 T2393 oascc.ZkStateReader.readConfigName
> path=/collections/collection1 configName=conf1 specified config exists in
> ZooKeeper
>    [junit4]   2> 849446 T2393 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/collection1/'
>    [junit4]   2> 849448 T2393 oasc.SolrResourceLoader.replaceClassLoader
> Adding
> 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/collection1/lib/.svn/'
> to classloader
>    [junit4]   2> 849449 T2393 oasc.SolrResourceLoader.replaceClassLoader
> Adding
> 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/collection1/lib/classes/'
> to classloader
>    [junit4]   2> 849449 T2393 oasc.SolrResourceLoader.replaceClassLoader
> Adding
> 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/collection1/lib/README'
> to classloader
>    [junit4]   2> 849480 T2393 oasc.ZkController.watchZKConfDir watch zkdir
> /configs/conf1
>    [junit4]   2> 849487 T2393 oasc.Config.<init> loaded config
> solrconfig.xml with version 0
>    [junit4]   2> 849502 T2393 oasc.SolrConfig.<init> Using Lucene
> MatchVersion: 6.0.0
>    [junit4]   2> 849518 T2393 oasc.SolrConfig.<init> Loaded SolrConfig:
> solrconfig.xml
>    [junit4]   2> 849524 T2393 oass.IndexSchema.readSchema Reading Solr
> Schema from /configs/conf1/schema.xml
>    [junit4]   2> 849534 T2393 oass.IndexSchema.readSchema [collection1]
> Schema name=test
>    [junit4]   2> 849647 T2393 oass.OpenExchangeRatesOrgProvider.init
> Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
>    [junit4]   2> 849655 T2393 oass.IndexSchema.readSchema default search
> field in schema is text
>    [junit4]   2> 849656 T2393 oass.IndexSchema.readSchema unique key
> field: id
>    [junit4]   2> 849681 T2393 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
>    [junit4]   2> 849687 T2393 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
>    [junit4]   2> 849692 T2393 oass.OpenExchangeRatesOrgProvider.reload
> Reloading exchange rates from open-exchange-rates.json
>    [junit4]   2> 849694 T2393
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
> IMPORTANT NOTE
>    [junit4]   2> 849695 T2393
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
> key, got STRING
>    [junit4]   2> 849696 T2393 oass.OpenExchangeRatesOrgProvider.reload
> Reloading exchange rates from open-exchange-rates.json
>    [junit4]   2> 849698 T2393
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
> IMPORTANT NOTE
>    [junit4]   2> 849699 T2393
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
> key, got STRING
>    [junit4]   2> 849699 T2393 oasc.CoreContainer.create Creating SolrCore
> 'collection1' using configuration from collection collection1
>    [junit4]   2> 849699 T2393 oasc.SolrCore.initDirectoryFactory
> org.apache.solr.core.MockDirectoryFactory
>    [junit4]   2> 849699 T2393 oasc.SolrCore.<init> [collection1] Opening
> new SolrCore at
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/collection1/,
> dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty2/
>    [junit4]   2> 849700 T2393 oasc.JmxMonitoredMap.<init> JMX monitoring
> is enabled. Adding Solr mbeans to JMX Server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@2fb2b6a6
>    [junit4]   2> 849700 T2393 oasc.CachingDirectoryFactory.get return new
> directory for
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty2
>    [junit4]   2> 849700 T2393 oasc.SolrCore.getNewIndexDir New index
> directory detected: old=null
> new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty2/index/
>    [junit4]   2> 849701 T2393 oasc.SolrCore.initIndex WARN [collection1]
> Solr index directory
> '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty2/index'
> doesn't exist. Creating new index...
>    [junit4]   2> 849701 T2393 oasc.CachingDirectoryFactory.get return new
> directory for
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty2/index
>    [junit4]   2> 849701 T2393 oasu.RandomMergePolicy.<init>
> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy:
> [LogDocMergePolicy: minMergeSize=1000, mergeFactor=24,
> maxMergeSize=9223372036854775807,
> maxMergeSizeForForcedMerge=9223372036854775807,
> calibrateSizeByDeletes=false, maxMergeDocs=2147483647,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
>    [junit4]   2> 849702 T2393 oasc.SolrDeletionPolicy.onCommit
> SolrDeletionPolicy.onCommit: commits: num=1
>    [junit4]   2>
> commit{dir=MockDirectoryWrapper(RAMDirectory@3df67880
> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7941453f
> ),segFN=segments_1,generation=1}
>    [junit4]   2> 849702 T2393 oasc.SolrDeletionPolicy.updateCommits newest
> commit generation = 1
>    [junit4]   2> 849706 T2393 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "nodistrib"
>    [junit4]   2> 849707 T2393 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "dedupe"
>    [junit4]   2> 849707 T2393 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "dedupe"
>    [junit4]   2> 849707 T2393 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "stored_sig"
>    [junit4]   2> 849707 T2393 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "stored_sig"
>    [junit4]   2> 849708 T2393 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
>    [junit4]   2> 849709 T2393 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>    [junit4]   2> 849709 T2393 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>    [junit4]   2> 849709 T2393 oasc.SolrCore.loadUpdateProcessorChains no
> updateRequestProcessorChain defined as default, creating implicit default
>    [junit4]   2> 849710 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created /update: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 849710 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created /update/json: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 849711 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created /update/csv: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 849711 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 849711 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created /config: org.apache.solr.handler.SolrConfigHandler
>    [junit4]   2> 849712 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created /schema: org.apache.solr.handler.SchemaHandler
>    [junit4]   2> 849714 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created /replication: org.apache.solr.handler.ReplicationHandler
>    [junit4]   2> 849715 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created /get: org.apache.solr.handler.RealTimeGetHandler
>    [junit4]   2> 849715 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
>    [junit4]   2> 849716 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
>    [junit4]   2> 849717 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
>    [junit4]   2> 849717 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
>    [junit4]   2> 849718 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
>    [junit4]   2> 849719 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/properties:
> org.apache.solr.handler.admin.PropertiesRequestHandler
>    [junit4]   2> 849719 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
>    [junit4]   2> 849720 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/ping: org.apache.solr.handler.PingRequestHandler
>    [junit4]   2> 849720 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created standard: solr.StandardRequestHandler
>    [junit4]   2> 849721 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/file: solr.admin.ShowFileRequestHandler
>    [junit4]   2> 849721 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/fileedit: solr.admin.EditFileRequestHandler
>    [junit4]   2> 849730 T2393 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
>    [junit4]   2> 849731 T2393 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
>    [junit4]   2> 849733 T2393 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
>    [junit4]   2> 849735 T2393 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
>    [junit4]   2> 849738 T2393 oasu.CommitTracker.<init> Hard AutoCommit:
> disabled
>    [junit4]   2> 849738 T2393 oasu.CommitTracker.<init> Soft AutoCommit:
> disabled
>    [junit4]   2> 849740 T2393 oasu.RandomMergePolicy.<init>
> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy:
> [LogDocMergePolicy: minMergeSize=1000, mergeFactor=12,
> maxMergeSize=9223372036854775807,
> maxMergeSizeForForcedMerge=9223372036854775807,
> calibrateSizeByDeletes=true, maxMergeDocs=2147483647,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
>    [junit4]   2> 849741 T2393 oasc.SolrDeletionPolicy.onInit
> SolrDeletionPolicy.onInit: commits: num=1
>    [junit4]   2>
> commit{dir=MockDirectoryWrapper(RAMDirectory@3df67880
> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7941453f
> ),segFN=segments_1,generation=1}
>    [junit4]   2> 849741 T2393 oasc.SolrDeletionPolicy.updateCommits newest
> commit generation = 1
>    [junit4]   2> 849742 T2393 oass.SolrIndexSearcher.<init> Opening
> Searcher@49e1a7c7[collection1] main
>    [junit4]   2> 849742 T2393 oascc.ZkStateReader.readConfigName Load
> collection config from:/collections/collection1
>    [junit4]   2> 849745 T2393 oascc.ZkStateReader.readConfigName
> path=/collections/collection1 configName=conf1 specified config exists in
> ZooKeeper
>    [junit4]   2> 849745 T2393 oasr.ManagedResourceStorage.newStorageIO
> Setting up ZooKeeper-based storage for the RestManager with znodeBase:
> /configs/conf1
>    [junit4]   2> 849747 T2393
> oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured
> ZooKeeperStorageIO with znodeBase: /configs/conf1
>    [junit4]   2> 849747 T2393 oasr.RestManager.init Initializing
> RestManager with initArgs: {}
>    [junit4]   2> 849747 T2393 oasr.ManagedResourceStorage.load Reading
> _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
>    [junit4]   2> 849751 T2393
> oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38
> bytes from znode /configs/conf1/_rest_managed.json
>    [junit4]   2> 849751 T2393 oasr.ManagedResourceStorage.load Loaded
> LinkedHashMap at path _rest_managed.json using
> ZooKeeperStorageIO:path=/configs/conf1
>    [junit4]   2> 849751 T2393 oasr.ManagedResource.reloadFromStorage
> Loaded initArgs {} for /rest/managed
>    [junit4]   2> 849752 T2393 oasr.RestManager.init Initializing 0
> registered ManagedResources
>    [junit4]   2> 849752 T2393 oash.ReplicationHandler.inform Commits will
> be reserved for  10000
>    [junit4]   2> 849753 T2393 oasc.CoreContainer.registerCore registering
> core: collection1
>    [junit4]   2> 849755 T2397 oasc.ZkController.register Register replica
> - core:collection1 address:http://127.0.0.1:49865 collection:collection1
> shard:shard1
>    [junit4]   2> 849756 T2394 oasc.SolrCore.registerSearcher [collection1]
> Registered new searcher Searcher@49e1a7c7[collection1]
> main{ExitableDirectoryReader(UninvertingDirectoryReader())}
>    [junit4]   2> 849756 T2316 oass.SolrDispatchFilter.init
> user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
>    [junit4]   2> 849758 T2316 oass.SolrDispatchFilter.init
> SolrDispatchFilter.init() done
>    [junit4]   2> 849760 T2397
>
> [...truncated too long message...]
>
> it4]   2> 888022 T2316 oasc.ZkController.unRegisterConfListener  a
> listener was removed because of core close
>    [junit4]   2> 888023 T2316 oasu.DirectUpdateHandler2.close closing
> DirectUpdateHandler2{commits=0,autocommits=0,soft
> autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
>    [junit4]   2> 888023 T2316 oasu.SolrCoreState.decrefSolrCoreState
> Closing SolrCoreState
>    [junit4]   2> 888023 T2485 oasc.Overseer$ClusterStateUpdater.run
> processMessage: queueSize: 1, message = {
>    [junit4]   2>          "core":"collection1",
>    [junit4]   2>          "core_node_name":"core_node4",
>    [junit4]   2>          "roles":null,
>    [junit4]   2>          "base_url":"http://127.0.0.1:49872",
>    [junit4]   2>          "node_name":"127.0.0.1:49872_",
>    [junit4]   2>          "numShards":"2",
>    [junit4]   2>          "state":"down",
>    [junit4]   2>          "shard":"shard1",
>    [junit4]   2>          "collection":"collection1",
>    [junit4]   2>          "operation":"state"} current state version: 15
>    [junit4]   2> 888024 T2316 oasu.DefaultSolrCoreState.closeIndexWriter
> SolrCoreState ref count has reached 0 - closing IndexWriter
>    [junit4]   2> 888024 T2316 oasu.DefaultSolrCoreState.closeIndexWriter
> closing IndexWriter with IndexWriterCloser
>    [junit4]   2> 888025 T2485 oasco.ReplicaMutator.updateState Update
> state numShards=2 message={
>    [junit4]   2>          "core":"collection1",
>    [junit4]   2>          "core_node_name":"core_node4",
>    [junit4]   2>          "roles":null,
>    [junit4]   2>          "base_url":"http://127.0.0.1:49872",
>    [junit4]   2>          "node_name":"127.0.0.1:49872_",
>    [junit4]   2>          "numShards":"2",
>    [junit4]   2>          "state":"down",
>    [junit4]   2>          "shard":"shard1",
>    [junit4]   2>          "collection":"collection1",
>    [junit4]   2>          "operation":"state"}
>    [junit4]   2> 888025 T2316 oasc.SolrCore.closeSearcher [collection1]
> Closing main searcher on request.
>    [junit4]   2> 888031 T2485 oasco.ZkStateWriter.writePendingUpdates
> going to update_collection /collections/collection1/state.json version: 22
>    [junit4]   2> 888039 T2316 oasc.CachingDirectoryFactory.close Closing
> MockDirectoryFactory - 2 directories currently being tracked
>    [junit4]   2> 888040 T2316 oasc.CachingDirectoryFactory.closeCacheValue
> looking to close
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty4/index
> [CachedDir<<refCount=0;path=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty4/index;done=false>>]
>    [junit4]   2> 888041 T2316 oasc.CachingDirectoryFactory.close Closing
> directory:
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty4/index
>    [junit4]   2> 888042 T2434 oascc.ZkStateReader$7.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/collection1/state.json, has occurred - updating...
>    [junit4]   2> 888042 T2316 oasc.CachingDirectoryFactory.closeCacheValue
> looking to close
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty4
> [CachedDir<<refCount=0;path=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty4;done=false>>]
>    [junit4]   2> 888043 T2316 oasc.CachingDirectoryFactory.close Closing
> directory:
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty4
>    [junit4]   2> 888044 T2316 oasc.Overseer.close Overseer
> (id=93006854147866637-127.0.0.1:49872_-n_0000000004) closing
>    [junit4]   2> 888045 T2485 oasc.Overseer$ClusterStateUpdater.run
> Overseer Loop exiting : 127.0.0.1:49872_
>    [junit4]   2> 889547 T2434 oascc.ZkStateReader$7.process WARN ZooKeeper
> watch triggered, but Solr cannot talk to ZK
>    [junit4]   2> 889548 T2475 oascc.ZkStateReader$3.process WARN ZooKeeper
> watch triggered, but Solr cannot talk to ZK
>    [junit4]   2> 889565 T2316 oejsh.ContextHandler.doStop stopped
> o.e.j.s.ServletContextHandler{/,null}
>    [junit4]   2> 894556 T2316 oas.SolrTestCaseJ4.tearDown ###Ending
> testDistribSearch
>    [junit4]   2> 894558 T2316 oasc.ZkTestServer.send4LetterWord connecting
> to 127.0.0.1:49854 49854
>    [junit4]   2> 894571 T2317 oasc.ZkTestServer.send4LetterWord connecting
> to 127.0.0.1:49854 49854
>    [junit4]   2> 894790 T2317 oasc.ZkTestServer$ZKServerMain.runFromConfig
> WARN Watch limit violations:
>    [junit4]   2>        Maximum concurrent create/delete watches above
> limit:
>    [junit4]   2>
>    [junit4]   2>                10      /solr/configs/conf1
>    [junit4]   2>                6       /solr/aliases.json
>    [junit4]   2>                6       /solr/clusterstate.json
>    [junit4]   2>                4
>  /solr/collections/collection1/state.json
>    [junit4]   2>                2       /solr/configs/.system
>    [junit4]   2>
>    [junit4]   2>        Maximum concurrent children watches above limit:
>    [junit4]   2>
>    [junit4]   2>                6       /solr/live_nodes
>    [junit4]   2>                5
>  /solr/overseer/collection-queue-work
>    [junit4]   2>                4       /solr/overseer/queue
>    [junit4]   2>
>    [junit4]   2> NOTE: reproduce with: ant test
> -Dtestcase=TestDynamicLoading -Dtests.method=testDistribSearch
> -Dtests.seed=CC8AD89B44D0A93D -Dtests.slow=true -Dtests.locale=es_GT
> -Dtests.timezone=America/Kentucky/Louisville -Dtests.asserts=true
> -Dtests.file.encoding=UTF-8
>    [junit4] FAILURE 57.8s | TestDynamicLoading.testDistribSearch <<<
>    [junit4]    > Throwable #1: java.lang.AssertionError: {
>    [junit4]    >   "responseHeader":{
>    [junit4]    >     "status":404,
>    [junit4]    >     "QTime":14},
>    [junit4]    >   "error":{
>    [junit4]    >     "msg":"no such blob or version available: test/1",
>    [junit4]    >     "code":404}}
> expected:<org.apache.solr.core.BlobStoreTestRequestHandler> but was:<null>
>    [junit4]    >        at
> __randomizedtesting.SeedInfo.seed([CC8AD89B44D0A93D:4D6C5683338FC901]:0)
>    [junit4]    >        at
> org.apache.solr.core.TestDynamicLoading.dynamicLoading(TestDynamicLoading.java:101)
>    [junit4]    >        at
> org.apache.solr.core.TestDynamicLoading.doTest(TestDynamicLoading.java:64)
>    [junit4]    >        at
> org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
>    [junit4]    >        at java.lang.Thread.run(Thread.java:745)
>    [junit4]   2> 894984 T2316 oas.SolrTestCaseJ4.deleteCore ###deleteCore
>    [junit4]   2> NOTE: leaving temporary files on disk at:
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001
>    [junit4]   2> 57768 T2315 ccr.ThreadLeakControl.checkThreadLeaks
> WARNING Will linger awaiting termination of 1 leaked thread(s).
>    [junit4]   2> NOTE: test params are: codec=Asserting(Lucene50):
> {blobName=PostingsFormat(name=LuceneVarGapFixedInterval),
> _version_=PostingsFormat(name=Memory doPackFST= false),
> id=PostingsFormat(name=Direct), version=PostingsFormat(name=Memory
> doPackFST= false),
> timestamp=PostingsFormat(name=LuceneVarGapFixedInterval)}, docValues:{},
> sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=es_GT,
> timezone=America/Kentucky/Louisville
>    [junit4]   2> NOTE: Mac OS X 10.8.5 x86_64/Oracle Corporation 1.8.0_20
> (64-bit)/cpus=2,threads=1,free=139693720,total=288882688
>    [junit4]   2> NOTE: All tests run in this JVM:
> [TestSerializedLuceneMatchVersion, ReplicationFactorTest,
> RAMDirectoryFactoryTest, TestLRUCache, OutputWriterTest, ZkStateWriterTest,
> TestInitParams, TestExpandComponent, CoreAdminCreateDiscoverTest,
> TestCloudSchemaless, MigrateRouteKeyTest, InfoHandlerTest,
> DisMaxRequestHandlerTest, DistributedFacetPivotSmallTest,
> HdfsLockFactoryTest, TestPHPSerializedResponseWriter, CursorPagingTest,
> TestSolrXml, TestClassNameShortening, StressHdfsTest,
> DistributedFacetPivotSmallAdvancedTest, TestIndexSearcher,
> LoggingHandlerTest, TestCoreContainer, ExternalCollectionsTest,
> TestSchemaNameResource, TestBinaryResponseWriter, TestRangeQuery,
> QueryParsingTest, XmlUpdateRequestHandlerTest, TestAddFieldRealTimeGet,
> AnalyticsQueryTest, DistribCursorPagingTest, TestRawResponseWriter,
> ZkSolrClientTest, TestFastWriter, TestDynamicLoading]
>    [junit4] Completed in 58.31s, 1 test, 1 failure <<< FAILURES!
>
> [...truncated 1307 lines...]
> BUILD FAILED
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:519: The
> following error occurred while executing this line:
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:467: The
> following error occurred while executing this line:
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:61: The
> following error occurred while executing this line:
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/extra-targets.xml:39:
> The following error occurred while executing this line:
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:187: The
> following error occurred while executing this line:
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:510:
> The following error occurred while executing this line:
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1349:
> The following error occurred while executing this line:
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:956:
> There were test failures: 453 suites, 1850 tests, 1 failure, 37 ignored (21
> assumptions)
>
> Total time: 166 minutes 36 seconds
> Build step 'Invoke Ant' marked build as failure
> [description-setter] Description set: Java: 64bit/jdk1.8.0
> -XX:+UseCompressedOops -XX:+UseParallelGC (asserts: true)
> Archiving artifacts
> Recording test results
> Email was triggered for: Failure - Any
> Sending email for trigger: Failure - Any
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>



-- 
Regards,
Shalin Shekhar Mangar.

[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.8.0) - Build # 2008 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/2008/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseParallelGC (asserts: true)

1 tests failed.
FAILED:  org.apache.solr.core.TestDynamicLoading.testDistribSearch

Error Message:
{   "responseHeader":{     "status":404,     "QTime":14},   "error":{     "msg":"no such blob or version available: test/1",     "code":404}} expected:<org.apache.solr.core.BlobStoreTestRequestHandler> but was:<null>

Stack Trace:
java.lang.AssertionError: {
  "responseHeader":{
    "status":404,
    "QTime":14},
  "error":{
    "msg":"no such blob or version available: test/1",
    "code":404}} expected:<org.apache.solr.core.BlobStoreTestRequestHandler> but was:<null>
	at __randomizedtesting.SeedInfo.seed([CC8AD89B44D0A93D:4D6C5683338FC901]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.apache.solr.core.TestDynamicLoading.dynamicLoading(TestDynamicLoading.java:101)
	at org.apache.solr.core.TestDynamicLoading.doTest(TestDynamicLoading.java:64)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 8743 lines...]
   [junit4] Suite: org.apache.solr.core.TestDynamicLoading
   [junit4]   2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/init-core-data-001
   [junit4]   2> 837229 T2316 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 837230 T2316 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 837237 T2316 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 837239 T2316 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 837240 T2317 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 837341 T2316 oasc.ZkTestServer.run start zk server on port:49854
   [junit4]   2> 837345 T2316 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 837348 T2316 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 837355 T2324 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6e4d3d31 name:ZooKeeperConnection Watcher:127.0.0.1:49854 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 837355 T2316 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 837355 T2316 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 837356 T2316 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 837365 T2316 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 837366 T2316 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 837370 T2327 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@36723d68 name:ZooKeeperConnection Watcher:127.0.0.1:49854/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 837370 T2316 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 837370 T2316 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 837371 T2316 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 837378 T2316 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 837385 T2316 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 837389 T2316 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 837396 T2316 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 837397 T2316 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 837404 T2316 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 837405 T2316 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 837412 T2316 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 837413 T2316 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 837423 T2316 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 837423 T2316 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 837429 T2316 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 837430 T2316 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 837436 T2316 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 837437 T2316 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 837443 T2316 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 837444 T2316 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 837450 T2316 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 837451 T2316 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 837457 T2316 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 837458 T2316 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 837463 T2316 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 837463 T2316 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 837469 T2316 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 837469 T2316 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 839165 T2316 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 839174 T2316 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49857
   [junit4]   2> 839175 T2316 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
   [junit4]   2> 839176 T2316 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 839176 T2316 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002
   [junit4]   2> 839177 T2316 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/'
   [junit4]   2> 839217 T2316 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/solr.xml
   [junit4]   2> 839240 T2316 oasc.CoreContainer.<init> New CoreContainer 1028334353
   [junit4]   2> 839240 T2316 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/]
   [junit4]   2> 839241 T2316 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 839241 T2316 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 839241 T2316 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 839241 T2316 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 839242 T2316 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 839242 T2316 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 839242 T2316 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 839243 T2316 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 839243 T2316 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 839243 T2316 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 839243 T2316 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 839244 T2316 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 839245 T2316 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 839245 T2316 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 839245 T2316 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49854/solr
   [junit4]   2> 839246 T2316 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 839246 T2316 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 839248 T2316 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 839253 T2339 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12e5b223 name:ZooKeeperConnection Watcher:127.0.0.1:49854 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 839254 T2316 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 839255 T2316 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 839260 T2316 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 839263 T2342 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6406c22 name:ZooKeeperConnection Watcher:127.0.0.1:49854/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 839264 T2316 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 839265 T2316 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 839273 T2316 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 839280 T2316 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 839288 T2316 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 839294 T2316 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 839302 T2316 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 839304 T2316 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49857_
   [junit4]   2> 839305 T2316 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49857_
   [junit4]   2> 839311 T2316 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 839313 T2316 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 839317 T2316 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 839322 T2316 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:49857_
   [junit4]   2> 839323 T2316 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 839328 T2316 oasc.Overseer.start Overseer (id=93006854147866627-127.0.0.1:49857_-n_0000000000) starting
   [junit4]   2> 839332 T2316 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 839351 T2316 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 839353 T2344 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 839355 T2316 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 839361 T2316 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 839364 T2316 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 839375 T2343 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 839383 T2346 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 839383 T2346 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 839385 T2346 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 839385 T2342 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 839392 T2343 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 0, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49857",
   [junit4]   2> 	  "node_name":"127.0.0.1:49857_",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"} current state version: 0
   [junit4]   2> 839393 T2343 oasco.ReplicaMutator.updateState Update state numShards=1 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49857",
   [junit4]   2> 	  "node_name":"127.0.0.1:49857_",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 839393 T2343 oasco.ClusterStateMutator.createCollection building a new cName: control_collection
   [junit4]   2> 839394 T2343 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 839395 T2342 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 840387 T2346 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 840387 T2346 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 840389 T2346 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 840389 T2346 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 840395 T2346 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 840395 T2346 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/collection1/'
   [junit4]   2> 840397 T2346 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/collection1/lib/.svn/' to classloader
   [junit4]   2> 840398 T2346 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/collection1/lib/classes/' to classloader
   [junit4]   2> 840399 T2346 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/collection1/lib/README' to classloader
   [junit4]   2> 840444 T2346 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 840450 T2346 oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 840469 T2346 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 840481 T2346 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 840486 T2346 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 840494 T2346 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 840630 T2346 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 840644 T2346 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 840647 T2346 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 840690 T2346 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 840694 T2346 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 840699 T2346 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 840702 T2346 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 840703 T2346 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 840703 T2346 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 840706 T2346 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 840706 T2346 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 840706 T2346 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 840707 T2346 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 840707 T2346 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/collection1/, dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/control/data/
   [junit4]   2> 840707 T2346 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2fb2b6a6
   [junit4]   2> 840708 T2346 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/control/data
   [junit4]   2> 840708 T2346 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/control/data/index/
   [junit4]   2> 840709 T2346 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
   [junit4]   2> 840709 T2346 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/control/data/index
   [junit4]   2> 840710 T2346 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=24, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 840710 T2346 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@4625a372 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3a8a04e8),segFN=segments_1,generation=1}
   [junit4]   2> 840711 T2346 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 840717 T2346 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 840717 T2346 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 840718 T2346 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 840718 T2346 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 840718 T2346 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 840718 T2346 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 840720 T2346 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 840720 T2346 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 840720 T2346 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 840721 T2346 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 840721 T2346 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 840722 T2346 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 840723 T2346 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 840724 T2346 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
   [junit4]   2> 840724 T2346 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
   [junit4]   2> 840725 T2346 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
   [junit4]   2> 840726 T2346 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
   [junit4]   2> 840727 T2346 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
   [junit4]   2> 840728 T2346 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
   [junit4]   2> 840729 T2346 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
   [junit4]   2> 840730 T2346 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
   [junit4]   2> 840730 T2346 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
   [junit4]   2> 840731 T2346 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
   [junit4]   2> 840732 T2346 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
   [junit4]   2> 840733 T2346 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
   [junit4]   2> 840733 T2346 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 840734 T2346 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 840734 T2346 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 840747 T2346 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 840749 T2346 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 840750 T2346 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 840752 T2346 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 840757 T2346 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 840758 T2346 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 840758 T2346 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=12, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 840759 T2346 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@4625a372 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3a8a04e8),segFN=segments_1,generation=1}
   [junit4]   2> 840759 T2346 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 840760 T2346 oass.SolrIndexSearcher.<init> Opening Searcher@4de3bbc[collection1] main
   [junit4]   2> 840760 T2346 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 840763 T2346 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 840763 T2346 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 840764 T2346 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 840765 T2346 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 840765 T2346 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 840768 T2346 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 840768 T2346 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 840770 T2346 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
   [junit4]   2> 840776 T2346 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
   [junit4]   2> 840776 T2346 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 840776 T2346 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 840776 T2346 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 840778 T2347 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4de3bbc[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 840779 T2346 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 840782 T2350 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49857 collection:control_collection shard:shard1
   [junit4]   2> 840782 T2316 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 840783 T2316 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 840783 T2316 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 840785 T2316 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 840793 T2353 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7d66f1d9 name:ZooKeeperConnection Watcher:127.0.0.1:49854/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 840793 T2316 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 840794 T2316 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 840796 T2316 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 840798 T2350 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 840805 T2316 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 840805 T2316 oasc.AbstractFullDistribZkTestBase.createJettys Creating collection1 with stateFormat=2
   [junit4]   2> 840807 T2316 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 840811 T2316 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 840816 T2356 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4d205ac9 name:ZooKeeperConnection Watcher:127.0.0.1:49854/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 840817 T2316 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 840817 T2316 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 840824 T2342 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 840845 T2343 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"create",
   [junit4]   2> 	  "name":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "stateFormat":2} current state version: 1
   [junit4]   2> 840845 T2343 oasco.ClusterStateMutator.createCollection building a new cName: collection1
   [junit4]   2> 840860 T2350 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 840879 T2350 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 840880 T2350 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C1382 name=collection1 org.apache.solr.core.SolrCore@755e68c7 url=http://127.0.0.1:49857/collection1 node=127.0.0.1:49857_ C1382_STATE=coll:control_collection core:collection1 props:{core=collection1, base_url=http://127.0.0.1:49857, node_name=127.0.0.1:49857_, state=down}
   [junit4]   2> 840880 T2350 C1382 P49857 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49857/collection1/
   [junit4]   2> 840881 T2350 C1382 P49857 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 840881 T2350 C1382 P49857 oasc.SyncStrategy.syncToMe http://127.0.0.1:49857/collection1/ has no replicas
   [junit4]   2> 840881 T2350 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49857/collection1/ shard1
   [junit4]   2> 840881 T2350 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 840884 T2343 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection"} current state version: 1
   [junit4]   2> 840890 T2343 oasco.ZkStateWriter.writePendingUpdates going to create_collection /collections/collection1/state.json
   [junit4]   2> 840897 T2353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 840897 T2342 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 840915 T2357 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 840933 T2343 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49857",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "state":"active"} current state version: 2
   [junit4]   2> 840947 T2357 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 841053 T2353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 841127 T2350 oasc.ZkController.register We are http://127.0.0.1:49857/collection1/ and leader is http://127.0.0.1:49857/collection1/
   [junit4]   2> 841127 T2350 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49857
   [junit4]   2> 841127 T2350 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 841130 T2350 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
   [junit4]   2> 841132 T2350 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 841139 T2342 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 841156 T2343 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49857",
   [junit4]   2> 	  "node_name":"127.0.0.1:49857_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"} current state version: 3
   [junit4]   2> 841159 T2343 oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49857",
   [junit4]   2> 	  "node_name":"127.0.0.1:49857_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 841276 T2353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 841276 T2342 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 842764 T2316 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 842765 T2316 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 842771 T2316 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49862
   [junit4]   2> 842772 T2316 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
   [junit4]   2> 842772 T2316 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 842772 T2316 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003
   [junit4]   2> 842773 T2316 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/'
   [junit4]   2> 842810 T2316 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/solr.xml
   [junit4]   2> 842829 T2316 oasc.CoreContainer.<init> New CoreContainer 335265571
   [junit4]   2> 842829 T2316 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/]
   [junit4]   2> 842830 T2316 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 842830 T2316 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 842830 T2316 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 842831 T2316 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 842831 T2316 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 842832 T2316 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 842832 T2316 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 842832 T2316 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 842833 T2316 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 842834 T2316 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 842835 T2316 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 842836 T2316 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 842836 T2316 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 842837 T2316 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 842837 T2316 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49854/solr
   [junit4]   2> 842837 T2316 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 842838 T2316 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 842839 T2316 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 842844 T2369 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7f590f35 name:ZooKeeperConnection Watcher:127.0.0.1:49854 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 842845 T2316 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 842846 T2316 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 842852 T2316 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 842859 T2372 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@634dd196 name:ZooKeeperConnection Watcher:127.0.0.1:49854/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 842859 T2316 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 842884 T2316 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 843905 T2316 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49862_
   [junit4]   2> 843907 T2316 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49862_
   [junit4]   2> 843919 T2316 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 843934 T2373 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 843934 T2373 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 843941 T2342 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 843941 T2373 oasc.ZkController.preRegister Registering watch for external collection collection1
   [junit4]   2> 843944 T2373 oascc.ZkStateReader.addZkWatch addZkWatch collection1
   [junit4]   2> 843943 T2343 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49862",
   [junit4]   2> 	  "node_name":"127.0.0.1:49862_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"} current state version: 4
   [junit4]   2> 843945 T2373 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/collection1/state.json from ZooKeeper... 
   [junit4]   2> 843946 T2343 oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49862",
   [junit4]   2> 	  "node_name":"127.0.0.1:49862_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 843947 T2343 oasco.ReplicaMutator.updateState Collection already exists with numShards=2
   [junit4]   2> 843947 T2343 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 843950 T2373 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 0 
   [junit4]   2> 843950 T2373 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 843952 T2343 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 0
   [junit4]   2> 843953 T2372 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 843955 T2372 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 1 
   [junit4]   2> 844953 T2373 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 844954 T2373 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 844957 T2373 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 844957 T2373 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 844964 T2373 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 844965 T2373 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/collection1/'
   [junit4]   2> 844967 T2373 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/collection1/lib/.svn/' to classloader
   [junit4]   2> 844968 T2373 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/collection1/lib/classes/' to classloader
   [junit4]   2> 844969 T2373 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/collection1/lib/README' to classloader
   [junit4]   2> 845009 T2373 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 845015 T2373 oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 845033 T2373 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 845046 T2373 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 845049 T2373 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 845056 T2373 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 845191 T2373 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 845206 T2373 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 845207 T2373 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 845244 T2373 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 845249 T2373 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 845253 T2373 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 845256 T2373 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 845258 T2373 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 845258 T2373 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 845262 T2373 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 845262 T2373 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 845263 T2373 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 845263 T2373 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 845263 T2373 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/collection1/, dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty1/
   [junit4]   2> 845264 T2373 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2fb2b6a6
   [junit4]   2> 845264 T2373 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty1
   [junit4]   2> 845265 T2373 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty1/index/
   [junit4]   2> 845265 T2373 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
   [junit4]   2> 845265 T2373 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty1/index
   [junit4]   2> 845266 T2373 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=24, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 845267 T2373 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@2fb05928 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@19766ec3),segFN=segments_1,generation=1}
   [junit4]   2> 845267 T2373 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 845273 T2373 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 845273 T2373 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 845274 T2373 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 845274 T2373 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 845274 T2373 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 845274 T2373 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 845275 T2373 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 845275 T2373 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 845275 T2373 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 845276 T2373 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 845276 T2373 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 845277 T2373 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 845277 T2373 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 845278 T2373 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
   [junit4]   2> 845278 T2373 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
   [junit4]   2> 845280 T2373 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
   [junit4]   2> 845280 T2373 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
   [junit4]   2> 845281 T2373 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
   [junit4]   2> 845285 T2373 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
   [junit4]   2> 845286 T2373 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
   [junit4]   2> 845286 T2373 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
   [junit4]   2> 845287 T2373 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
   [junit4]   2> 845287 T2373 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
   [junit4]   2> 845287 T2373 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
   [junit4]   2> 845288 T2373 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
   [junit4]   2> 845288 T2373 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 845289 T2373 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 845289 T2373 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 845296 T2373 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 845297 T2373 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 845298 T2373 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 845299 T2373 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 845301 T2373 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 845302 T2373 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 845303 T2373 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=12, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 845304 T2373 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@2fb05928 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@19766ec3),segFN=segments_1,generation=1}
   [junit4]   2> 845304 T2373 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 845304 T2373 oass.SolrIndexSearcher.<init> Opening Searcher@1466a306[collection1] main
   [junit4]   2> 845305 T2373 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 845307 T2373 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 845308 T2373 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 845309 T2373 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 845309 T2373 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 845309 T2373 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 845313 T2373 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 845313 T2373 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 845313 T2373 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
   [junit4]   2> 845314 T2373 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 845314 T2373 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 845315 T2374 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1466a306[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 845315 T2373 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 845317 T2377 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49862 collection:collection1 shard:shard2
   [junit4]   2> 845318 T2316 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 845319 T2316 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 845320 T2377 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 845338 T2377 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 845345 T2342 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 845347 T2377 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 845347 T2377 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C1383 name=collection1 org.apache.solr.core.SolrCore@2dc8d5fa url=http://127.0.0.1:49862/collection1 node=127.0.0.1:49862_ C1383_STATE=coll:collection1 core:collection1 props:{core=collection1, base_url=http://127.0.0.1:49862, node_name=127.0.0.1:49862_, state=down}
   [junit4]   2> 845347 T2377 C1383 P49862 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49862/collection1/
   [junit4]   2> 845348 T2377 C1383 P49862 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 845348 T2377 C1383 P49862 oasc.SyncStrategy.syncToMe http://127.0.0.1:49862/collection1/ has no replicas
   [junit4]   2> 845348 T2377 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49862/collection1/ shard2
   [junit4]   2> 845348 T2377 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 845349 T2343 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1"} current state version: 4
   [junit4]   2> 845357 T2343 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 1
   [junit4]   2> 845361 T2372 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 845364 T2372 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 2 
   [junit4]   2> 845390 T2342 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 845393 T2343 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49862",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "state":"active"} current state version: 4
   [junit4]   2> 845396 T2343 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 2
   [junit4]   2> 845397 T2372 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 845401 T2372 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 3 
   [junit4]   2> 845446 T2377 oasc.ZkController.register We are http://127.0.0.1:49862/collection1/ and leader is http://127.0.0.1:49862/collection1/
   [junit4]   2> 845446 T2377 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49862
   [junit4]   2> 845447 T2377 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 845447 T2377 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 845447 T2377 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 845450 T2342 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 845455 T2343 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49862",
   [junit4]   2> 	  "node_name":"127.0.0.1:49862_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"} current state version: 4
   [junit4]   2> 845459 T2343 oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49862",
   [junit4]   2> 	  "node_name":"127.0.0.1:49862_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 845466 T2343 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 3
   [junit4]   2> 845475 T2372 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 845481 T2377 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 4 
   [junit4]   2> 845483 T2372 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 4 
   [junit4]   2> 847246 T2316 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 847247 T2316 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 847252 T2316 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49865
   [junit4]   2> 847253 T2316 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
   [junit4]   2> 847254 T2316 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 847254 T2316 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004
   [junit4]   2> 847255 T2316 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/'
   [junit4]   2> 847309 T2316 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/solr.xml
   [junit4]   2> 847325 T2316 oasc.CoreContainer.<init> New CoreContainer 1078127689
   [junit4]   2> 847325 T2316 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/]
   [junit4]   2> 847326 T2316 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 847326 T2316 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 847326 T2316 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 847326 T2316 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 847326 T2316 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 847327 T2316 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 847328 T2316 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 847328 T2316 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 847328 T2316 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 847329 T2316 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 847329 T2316 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 847330 T2316 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 847330 T2316 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 847330 T2316 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 847330 T2316 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49854/solr
   [junit4]   2> 847330 T2316 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 847331 T2316 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 847335 T2316 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 847336 T2389 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ece84e9 name:ZooKeeperConnection Watcher:127.0.0.1:49854 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 847338 T2316 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 847338 T2316 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 847344 T2316 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 847347 T2392 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@634647ce name:ZooKeeperConnection Watcher:127.0.0.1:49854/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 847347 T2316 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 847362 T2316 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 848381 T2316 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49865_
   [junit4]   2> 848388 T2316 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49865_
   [junit4]   2> 848403 T2316 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 848422 T2393 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 848422 T2393 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 848428 T2342 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 848429 T2393 oasc.ZkController.preRegister Registering watch for external collection collection1
   [junit4]   2> 848429 T2393 oascc.ZkStateReader.addZkWatch addZkWatch collection1
   [junit4]   2> 848431 T2393 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/collection1/state.json from ZooKeeper... 
   [junit4]   2> 848432 T2343 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49865",
   [junit4]   2> 	  "node_name":"127.0.0.1:49865_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"} current state version: 4
   [junit4]   2> 848434 T2343 oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49865",
   [junit4]   2> 	  "node_name":"127.0.0.1:49865_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 848434 T2343 oasco.ReplicaMutator.updateState Collection already exists with numShards=2
   [junit4]   2> 848435 T2393 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 4 
   [junit4]   2> 848435 T2343 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 848435 T2393 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 848440 T2343 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 4
   [junit4]   2> 848442 T2392 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 848442 T2372 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 848444 T2392 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 5 
   [junit4]   2> 848444 T2372 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 5 
   [junit4]   2> 849438 T2393 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 849439 T2393 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 849442 T2393 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 849442 T2393 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 849445 T2393 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 849446 T2393 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/collection1/'
   [junit4]   2> 849448 T2393 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/collection1/lib/.svn/' to classloader
   [junit4]   2> 849449 T2393 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/collection1/lib/classes/' to classloader
   [junit4]   2> 849449 T2393 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/collection1/lib/README' to classloader
   [junit4]   2> 849480 T2393 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 849487 T2393 oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 849502 T2393 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 849518 T2393 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 849524 T2393 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 849534 T2393 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 849647 T2393 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 849655 T2393 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 849656 T2393 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 849681 T2393 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 849687 T2393 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 849692 T2393 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 849694 T2393 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 849695 T2393 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 849696 T2393 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 849698 T2393 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 849699 T2393 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 849699 T2393 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 849699 T2393 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 849699 T2393 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/collection1/, dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty2/
   [junit4]   2> 849700 T2393 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2fb2b6a6
   [junit4]   2> 849700 T2393 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty2
   [junit4]   2> 849700 T2393 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty2/index/
   [junit4]   2> 849701 T2393 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
   [junit4]   2> 849701 T2393 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty2/index
   [junit4]   2> 849701 T2393 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=24, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 849702 T2393 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@3df67880 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7941453f),segFN=segments_1,generation=1}
   [junit4]   2> 849702 T2393 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 849706 T2393 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 849707 T2393 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 849707 T2393 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 849707 T2393 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 849707 T2393 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 849708 T2393 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 849709 T2393 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 849709 T2393 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 849709 T2393 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 849710 T2393 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 849710 T2393 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 849711 T2393 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 849711 T2393 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 849711 T2393 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
   [junit4]   2> 849712 T2393 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
   [junit4]   2> 849714 T2393 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
   [junit4]   2> 849715 T2393 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
   [junit4]   2> 849715 T2393 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
   [junit4]   2> 849716 T2393 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
   [junit4]   2> 849717 T2393 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
   [junit4]   2> 849717 T2393 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
   [junit4]   2> 849718 T2393 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
   [junit4]   2> 849719 T2393 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
   [junit4]   2> 849719 T2393 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
   [junit4]   2> 849720 T2393 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
   [junit4]   2> 849720 T2393 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 849721 T2393 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 849721 T2393 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 849730 T2393 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 849731 T2393 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 849733 T2393 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 849735 T2393 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 849738 T2393 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 849738 T2393 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 849740 T2393 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=12, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 849741 T2393 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@3df67880 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7941453f),segFN=segments_1,generation=1}
   [junit4]   2> 849741 T2393 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 849742 T2393 oass.SolrIndexSearcher.<init> Opening Searcher@49e1a7c7[collection1] main
   [junit4]   2> 849742 T2393 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 849745 T2393 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 849745 T2393 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 849747 T2393 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 849747 T2393 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 849747 T2393 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 849751 T2393 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 849751 T2393 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 849751 T2393 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
   [junit4]   2> 849752 T2393 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 849752 T2393 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 849753 T2393 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 849755 T2397 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49865 collection:collection1 shard:shard1
   [junit4]   2> 849756 T2394 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@49e1a7c7[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 849756 T2316 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 849758 T2316 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 849760 T2397

[...truncated too long message...]

it4]   2> 888022 T2316 oasc.ZkController.unRegisterConfListener  a listener was removed because of core close
   [junit4]   2> 888023 T2316 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
   [junit4]   2> 888023 T2316 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 888023 T2485 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node4",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49872",
   [junit4]   2> 	  "node_name":"127.0.0.1:49872_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"} current state version: 15
   [junit4]   2> 888024 T2316 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 888024 T2316 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 888025 T2485 oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node4",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49872",
   [junit4]   2> 	  "node_name":"127.0.0.1:49872_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 888025 T2316 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 888031 T2485 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 22
   [junit4]   2> 888039 T2316 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 888040 T2316 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty4/index [CachedDir<<refCount=0;path=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty4/index;done=false>>]
   [junit4]   2> 888041 T2316 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty4/index
   [junit4]   2> 888042 T2434 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 888042 T2316 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty4 [CachedDir<<refCount=0;path=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty4;done=false>>]
   [junit4]   2> 888043 T2316 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty4
   [junit4]   2> 888044 T2316 oasc.Overseer.close Overseer (id=93006854147866637-127.0.0.1:49872_-n_0000000004) closing
   [junit4]   2> 888045 T2485 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:49872_
   [junit4]   2> 889547 T2434 oascc.ZkStateReader$7.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 889548 T2475 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 889565 T2316 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
   [junit4]   2> 894556 T2316 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
   [junit4]   2> 894558 T2316 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:49854 49854
   [junit4]   2> 894571 T2317 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:49854 49854
   [junit4]   2> 894790 T2317 oasc.ZkTestServer$ZKServerMain.runFromConfig WARN Watch limit violations: 
   [junit4]   2> 	Maximum concurrent create/delete watches above limit:
   [junit4]   2> 	
   [junit4]   2> 		10	/solr/configs/conf1
   [junit4]   2> 		6	/solr/aliases.json
   [junit4]   2> 		6	/solr/clusterstate.json
   [junit4]   2> 		4	/solr/collections/collection1/state.json
   [junit4]   2> 		2	/solr/configs/.system
   [junit4]   2> 	
   [junit4]   2> 	Maximum concurrent children watches above limit:
   [junit4]   2> 	
   [junit4]   2> 		6	/solr/live_nodes
   [junit4]   2> 		5	/solr/overseer/collection-queue-work
   [junit4]   2> 		4	/solr/overseer/queue
   [junit4]   2> 	
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestDynamicLoading -Dtests.method=testDistribSearch -Dtests.seed=CC8AD89B44D0A93D -Dtests.slow=true -Dtests.locale=es_GT -Dtests.timezone=America/Kentucky/Louisville -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] FAILURE 57.8s | TestDynamicLoading.testDistribSearch <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: {
   [junit4]    >   "responseHeader":{
   [junit4]    >     "status":404,
   [junit4]    >     "QTime":14},
   [junit4]    >   "error":{
   [junit4]    >     "msg":"no such blob or version available: test/1",
   [junit4]    >     "code":404}} expected:<org.apache.solr.core.BlobStoreTestRequestHandler> but was:<null>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([CC8AD89B44D0A93D:4D6C5683338FC901]:0)
   [junit4]    > 	at org.apache.solr.core.TestDynamicLoading.dynamicLoading(TestDynamicLoading.java:101)
   [junit4]    > 	at org.apache.solr.core.TestDynamicLoading.doTest(TestDynamicLoading.java:64)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 894984 T2316 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001
   [junit4]   2> 57768 T2315 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene50): {blobName=PostingsFormat(name=LuceneVarGapFixedInterval), _version_=PostingsFormat(name=Memory doPackFST= false), id=PostingsFormat(name=Direct), version=PostingsFormat(name=Memory doPackFST= false), timestamp=PostingsFormat(name=LuceneVarGapFixedInterval)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=es_GT, timezone=America/Kentucky/Louisville
   [junit4]   2> NOTE: Mac OS X 10.8.5 x86_64/Oracle Corporation 1.8.0_20 (64-bit)/cpus=2,threads=1,free=139693720,total=288882688
   [junit4]   2> NOTE: All tests run in this JVM: [TestSerializedLuceneMatchVersion, ReplicationFactorTest, RAMDirectoryFactoryTest, TestLRUCache, OutputWriterTest, ZkStateWriterTest, TestInitParams, TestExpandComponent, CoreAdminCreateDiscoverTest, TestCloudSchemaless, MigrateRouteKeyTest, InfoHandlerTest, DisMaxRequestHandlerTest, DistributedFacetPivotSmallTest, HdfsLockFactoryTest, TestPHPSerializedResponseWriter, CursorPagingTest, TestSolrXml, TestClassNameShortening, StressHdfsTest, DistributedFacetPivotSmallAdvancedTest, TestIndexSearcher, LoggingHandlerTest, TestCoreContainer, ExternalCollectionsTest, TestSchemaNameResource, TestBinaryResponseWriter, TestRangeQuery, QueryParsingTest, XmlUpdateRequestHandlerTest, TestAddFieldRealTimeGet, AnalyticsQueryTest, DistribCursorPagingTest, TestRawResponseWriter, ZkSolrClientTest, TestFastWriter, TestDynamicLoading]
   [junit4] Completed in 58.31s, 1 test, 1 failure <<< FAILURES!

[...truncated 1307 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:519: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:467: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:61: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/extra-targets.xml:39: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:187: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:510: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1349: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:956: There were test failures: 453 suites, 1850 tests, 1 failure, 37 ignored (21 assumptions)

Total time: 166 minutes 36 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseParallelGC (asserts: true)
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.8.0) - Build # 2007 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/2007/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseG1GC (asserts: false)

1 tests failed.
FAILED:  org.apache.solr.TestDistributedMissingSort.testDistribSearch

Error Message:
Timeout occured while waiting response from server at: https://127.0.0.1:50978/fm/db

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: https://127.0.0.1:50978/fm/db
	at __randomizedtesting.SeedInfo.seed([84BC817DF13FEF5F:55A0F6586608F63]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:578)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:213)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:209)
	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:124)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
	at org.apache.solr.BaseDistributedSearchTestCase.indexDoc(BaseDistributedSearchTestCase.java:438)
	at org.apache.solr.BaseDistributedSearchTestCase.indexr(BaseDistributedSearchTestCase.java:420)
	at org.apache.solr.TestDistributedMissingSort.index(TestDistributedMissingSort.java:90)
	at org.apache.solr.TestDistributedMissingSort.doTest(TestDistributedMissingSort.java:42)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:875)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketTimeoutException: Read timed out
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.read(SocketInputStream.java:150)
	at java.net.SocketInputStream.read(SocketInputStream.java:121)
	at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
	at sun.security.ssl.InputRecord.read(InputRecord.java:503)
	at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:954)
	at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:911)
	at sun.security.ssl.AppInputStream.read(AppInputStream.java:105)
	at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
	at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
	at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:260)
	at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
	at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
	at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:271)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:123)
	at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:682)
	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:486)
	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:463)
	... 50 more




Build Log:
[...truncated 8880 lines...]
   [junit4] Suite: org.apache.solr.TestDistributedMissingSort
   [junit4]   2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.TestDistributedMissingSort-84BC817DF13FEF5F-001/init-core-data-001
   [junit4]   2> 1686493 T5479 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
   [junit4]   2> 1686494 T5479 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /fm/db
   [junit4]   2> 1686497 T5479 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 1686500 T5479 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1686509 T5479 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 1686516 T5479 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:50973
   [junit4]   2> 1686520 T5479 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
   [junit4]   2> 1686521 T5479 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1686521 T5479 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr
   [junit4]   2> 1686522 T5479 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/'
   [junit4]   2> 1686561 T5479 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/solr.xml
   [junit4]   2> 1686582 T5479 oasc.CoreContainer.<init> New CoreContainer 610984075
   [junit4]   2> 1686583 T5479 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/]
   [junit4]   2> 1686583 T5479 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1686583 T5479 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: https
   [junit4]   2> 1686584 T5479 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1686584 T5479 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1686585 T5479 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 1686585 T5479 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1686585 T5479 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1686586 T5479 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1686586 T5479 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1686586 T5479 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1686589 T5479 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1686590 T5479 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1686591 T5479 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1686591 T5479 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1686597 T5489 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/'
   [junit4]   2> 1686598 T5489 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
   [junit4]   2> 1686599 T5489 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 1686600 T5489 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 1686652 T5489 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1686684 T5489 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1686687 T5489 oass.IndexSchema.readSchema Reading Solr Schema from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema-distributed-missing-sort.xml
   [junit4]   2> 1686690 T5489 oass.IndexSchema.readSchema [collection1] Schema name=test-distributed-missing-sort
   [junit4]   2> 1686702 T5489 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1686704 T5489 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/
   [junit4]   2> 1686704 T5489 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1686704 T5489 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/, dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.TestDistributedMissingSort-84BC817DF13FEF5F-001/tempDir-001/control/data/
   [junit4]   2> 1686704 T5489 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@47fc5fd9
   [junit4]   2> 1686706 T5489 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.TestDistributedMissingSort-84BC817DF13FEF5F-001/tempDir-001/control/data
   [junit4]   2> 1686706 T5489 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.TestDistributedMissingSort-84BC817DF13FEF5F-001/tempDir-001/control/data/index/
   [junit4]   2> 1686706 T5489 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.TestDistributedMissingSort-84BC817DF13FEF5F-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1686708 T5489 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.TestDistributedMissingSort-84BC817DF13FEF5F-001/tempDir-001/control/data/index
   [junit4]   2> 1686708 T5489 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=48, maxMergeAtOnceExplicit=18, maxMergedSegmentMB=82.3203125, floorSegmentMB=0.3359375, forceMergeDeletesPctAllowed=23.71552379778163, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1686710 T5489 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@57377192 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2934c08c)),segFN=segments_1,generation=1}
   [junit4]   2> 1686710 T5489 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1686710 T5489 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
   [junit4]   2> 1686721 T5489 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1686723 T5489 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1686723 T5489 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe-allfields"
   [junit4]   2> 1686724 T5489 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
   [junit4]   2> 1686724 T5489 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1686725 T5489 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1686726 T5489 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "uniq-fields"
   [junit4]   2> 1686727 T5489 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
   [junit4]   2> 1686727 T5489 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1686728 T5489 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1686730 T5489 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1686731 T5489 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1686732 T5489 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1686732 T5489 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1686732 T5489 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1686733 T5489 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1686734 T5489 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
   [junit4]   2> 1686734 T5489 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
   [junit4]   2> 1686735 T5489 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
   [junit4]   2> 1686735 T5489 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
   [junit4]   2> 1686736 T5489 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
   [junit4]   2> 1686737 T5489 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
   [junit4]   2> 1686738 T5489 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
   [junit4]   2> 1686738 T5489 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
   [junit4]   2> 1686738 T5489 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
   [junit4]   2> 1686739 T5489 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
   [junit4]   2> 1686742 T5489 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
   [junit4]   2> 1686742 T5489 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
   [junit4]   2> 1686743 T5489 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1686743 T5489 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
   [junit4]   2> 1686744 T5489 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
   [junit4]   2> 1686744 T5489 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1686745 T5489 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1686745 T5489 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
   [junit4]   2> 1686745 T5489 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
   [junit4]   2> 1686745 T5489 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
   [junit4]   2> 1686746 T5489 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1686747 T5489 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1686747 T5489 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1686748 T5489 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1686748 T5489 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1686749 T5489 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1686749 T5489 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1686750 T5489 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1686752 T5489 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
   [junit4]   2> 1686752 T5489 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
   [junit4]   2> 1686752 T5489 oasc.RequestHandlers.initHandlersFromConfig created /search-facet-def: solr.SearchHandler
   [junit4]   2> 1686753 T5489 oasc.RequestHandlers.initHandlersFromConfig created /search-facet-invariants: solr.SearchHandler
   [junit4]   2> 1686762 T5489 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1686764 T5489 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1686766 T5489 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1686768 T5489 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1686770 T5489 oasc.SolrCore.initDeprecatedSupport WARN solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
   [junit4]   2> 1686774 T5489 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1686774 T5489 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1686775 T5489 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=11, maxMergeAtOnceExplicit=11, maxMergedSegmentMB=99.8173828125, floorSegmentMB=1.998046875, forceMergeDeletesPctAllowed=21.786436757571565, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 1686775 T5489 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@57377192 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2934c08c)),segFN=segments_1,generation=1}
   [junit4]   2> 1686775 T5489 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1686776 T5489 oass.SolrIndexSearcher.<init> Opening Searcher@2b94cdd8[collection1] main
   [junit4]   2> 1686776 T5489 oasr.RestManager.init Initializing RestManager with initArgs: {storageIO=org.apache.solr.rest.ManagedResourceStorage$InMemoryStorageIO}
   [junit4]   2> 1686776 T5489 oasr.ManagedResourceStorage.load Reading _rest_managed.json using InMemoryStorage
   [junit4]   2> 1686777 T5489 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
   [junit4]   2> 1686777 T5489 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using InMemoryStorage
   [junit4]   2> 1686777 T5489 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1686777 T5489 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 1686788 T5489 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 1686842 T5489 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 1686842 T5490 oashc.SpellCheckComponent$SpellCheckerListener.newSearcher Loading spell index for spellchecker: default
   [junit4]   2> 1686844 T5490 oashc.SpellCheckComponent$SpellCheckerListener.newSearcher Loading spell index for spellchecker: direct
   [junit4]   2> 1686845 T5490 oashc.SpellCheckComponent$SpellCheckerListener.newSearcher Loading spell index for spellchecker: wordbreak
   [junit4]   2> 1686845 T5489 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1686845 T5490 oashc.SpellCheckComponent$SpellCheckerListener.newSearcher Loading spell index for spellchecker: multipleFields
   [junit4]   2> 1686847 T5479 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 1686848 T5479 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1686849 T5490 oashc.SpellCheckComponent$SpellCheckerListener.newSearcher Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 1686851 T5490 oashc.SpellCheckComponent$SpellCheckerListener.newSearcher Loading spell index for spellchecker: external
   [junit4]   2> 1686854 T5490 oashc.SpellCheckComponent$SpellCheckerListener.newSearcher Loading spell index for spellchecker: freq
   [junit4]   2> 1686856 T5479 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1686856 T5490 oashc.SpellCheckComponent$SpellCheckerListener.newSearcher Loading spell index for spellchecker: fqcn
   [junit4]   2> 1686867 T5479 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 1686871 T5490 oashc.SpellCheckComponent$SpellCheckerListener.newSearcher Loading spell index for spellchecker: perDict
   [junit4]   2> 1686872 T5479 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:50974
   [junit4]   2> 1686873 T5490 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2b94cdd8[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1686879 T5479 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
   [junit4]   2> 1686880 T5479 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1686880 T5479 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr
   [junit4]   2> 1686880 T5479 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/'
   [junit4]   2> 1686923 T5479 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/solr.xml
   [junit4]   2> 1686935 T5479 oasc.CoreContainer.<init> New CoreContainer 335063807
   [junit4]   2> 1686936 T5479 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/]
   [junit4]   2> 1686936 T5479 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1686937 T5479 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: https
   [junit4]   2> 1686937 T5479 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1686937 T5479 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1686938 T5479 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 1686939 T5479 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1686939 T5479 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1686939 T5479 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1686940 T5479 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1686940 T5479 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1686942 T5479 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1686944 T5479 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1686945 T5479 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1686945 T5479 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1686948 T5501 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/'
   [junit4]   2> 1686950 T5501 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
   [junit4]   2> 1686950 T5501 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 1686951 T5501 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 1686986 T5501 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1687013 T5501 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1687016 T5501 oass.IndexSchema.readSchema Reading Solr Schema from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema-distributed-missing-sort.xml
   [junit4]   2> 1687018 T5501 oass.IndexSchema.readSchema [collection1] Schema name=test-distributed-missing-sort
   [junit4]   2> 1687028 T5501 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1687029 T5501 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/
   [junit4]   2> 1687029 T5501 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1687030 T5501 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/, dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.TestDistributedMissingSort-84BC817DF13FEF5F-001/tempDir-001/shard0/data/
   [junit4]   2> 1687030 T5501 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@47fc5fd9
   [junit4]   2> 1687031 T5501 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.TestDistributedMissingSort-84BC817DF13FEF5F-001/tempDir-001/shard0/data
   [junit4]   2> 1687031 T5501 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.TestDistributedMissingSort-84BC817DF13FEF5F-001/tempDir-001/shard0/data/index/
   [junit4]   2> 1687031 T5501 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.TestDistributedMissingSort-84BC817DF13FEF5F-001/tempDir-001/shard0/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1687032 T5501 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.TestDistributedMissingSort-84BC817DF13FEF5F-001/tempDir-001/shard0/data/index
   [junit4]   2> 1687032 T5501 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=48, maxMergeAtOnceExplicit=18, maxMergedSegmentMB=82.3203125, floorSegmentMB=0.3359375, forceMergeDeletesPctAllowed=23.71552379778163, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1687033 T5501 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@41eaa228 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@16f5c918)),segFN=segments_1,generation=1}
   [junit4]   2> 1687033 T5501 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1687034 T5501 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
   [junit4]   2> 1687041 T5501 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1687041 T5501 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1687041 T5501 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe-allfields"
   [junit4]   2> 1687042 T5501 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
   [junit4]   2> 1687042 T5501 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1687042 T5501 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1687042 T5501 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "uniq-fields"
   [junit4]   2> 1687043 T5501 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
   [junit4]   2> 1687043 T5501 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1687043 T5501 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1687044 T5501 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1687044 T5501 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1687046 T5501 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1687046 T5501 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1687047 T5501 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1687047 T5501 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1687048 T5501 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
   [junit4]   2> 1687049 T5501 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
   [junit4]   2> 1687050 T5501 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
   [junit4]   2> 1687050 T5501 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
   [junit4]   2> 1687051 T5501 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
   [junit4]   2> 1687053 T5501 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
   [junit4]   2> 1687053 T5501 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
   [junit4]   2> 1687054 T5501 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
   [junit4]   2> 1687054 T5501 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
   [junit4]   2> 1687055 T5501 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
   [junit4]   2> 1687055 T5501 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
   [junit4]   2> 1687056 T5501 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
   [junit4]   2> 1687056 T5501 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1687057 T5501 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
   [junit4]   2> 1687057 T5501 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
   [junit4]   2> 1687058 T5501 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1687058 T5501 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1687059 T5501 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
   [junit4]   2> 1687060 T5501 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
   [junit4]   2> 1687060 T5501 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
   [junit4]   2> 1687060 T5501 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1687061 T5501 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1687061 T5501 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1687062 T5501 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1687063 T5501 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1687063 T5501 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1687063 T5501 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1687064 T5501 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1687064 T5501 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
   [junit4]   2> 1687065 T5501 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
   [junit4]   2> 1687066 T5501 oasc.RequestHandlers.initHandlersFromConfig created /search-facet-def: solr.SearchHandler
   [junit4]   2> 1687066 T5501 oasc.RequestHandlers.initHandlersFromConfig created /search-facet-invariants: solr.SearchHandler
   [junit4]   2> 1687068 T5501 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1687070 T5501 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1687071 T5501 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1687073 T5501 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1687074 T5501 oasc.SolrCore.initDeprecatedSupport WARN solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
   [junit4]   2> 1687081 T5501 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1687082 T5501 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1687083 T5501 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=11, maxMergeAtOnceExplicit=11, maxMergedSegmentMB=99.8173828125, floorSegmentMB=1.998046875, forceMergeDeletesPctAllowed=21.786436757571565, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 1687084 T5501 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@41eaa228 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@16f5c918)),segFN=segments_1,generation=1}
   [junit4]   2> 1687085 T5501 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1687086 T5501 oass.SolrIndexSearcher.<init> Opening Searcher@f00aea8[collection1] main
   [junit4]   2> 1687087 T5501 oasr.RestManager.init Initializing RestManager with initArgs: {storageIO=org.apache.solr.rest.ManagedResourceStorage$InMemoryStorageIO}
   [junit4]   2> 1687088 T5501 oasr.ManagedResourceStorage.load Reading _rest_managed.json using InMemoryStorage
   [junit4]   2> 1687088 T5501 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
   [junit4]   2> 1687088 T5501 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using InMemoryStorage
   [junit4]   2> 1687089 T5501 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1687089 T5501 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 1687108 T5501 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 1687153 T5501 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 1687154 T5502 oashc.SpellCheckComponent$SpellCheckerListener.newSearcher Loading spell index for spellchecker: default
   [junit4]   2> 1687155 T5502 oashc.SpellCheckComponent$SpellCheckerListener.newSearcher Loading spell index for spellchecker: direct
   [junit4]   2> 1687155 T5502 oashc.SpellCheckComponent$SpellCheckerListener.newSearcher Loading spell index for spellchecker: wordbreak
   [junit4]   2> 1687156 T5502 oashc.SpellCheckComponent$SpellCheckerListener.newSearcher Loading spell index for spellchecker: multipleFields
   [junit4]   2> 1687156 T5501 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1687158 T5502 oashc.SpellCheckComponent$SpellCheckerListener.newSearcher Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 1687159 T5479 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 1687160 T5479 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1687159 T5502 oashc.SpellCheckComponent$SpellCheckerListener.newSearcher Loading spell index for spellchecker: external
   [junit4]   2> 1687162 T5502 oashc.SpellCheckComponent$SpellCheckerListener.newSearcher Loading spell index for spellchecker: freq
   [junit4]   2> 1687165 T5502 oashc.SpellCheckComponent$SpellCheckerListener.newSearcher Loading spell index for spellchecker: fqcn
   [junit4]   2> 1687167 T5502 oashc.SpellCheckComponent$SpellCheckerListener.newSearcher Loading spell index for spellchecker: perDict
   [junit4]   2> 1687172 T5502 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@f00aea8[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> ASYNC  NEW_CORE C3907 name=collection1 org.apache.solr.core.SolrCore@53e0bc4d
   [junit4]   2> 1687221 T5486 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1488064045145653248)} 0 4
   [junit4]   2> ASYNC  NEW_CORE C3908 name=collection1 org.apache.solr.core.SolrCore@7668a5fb
   [junit4]   2> 1687262 T5497 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1488064045190742016)} 0 2
   [junit4]   2> 1687275 T5488 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[1 (1488064045199130624)]} 0 7
   [junit4]   2> 1687296 T5498 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[1 (1488064045219053568)]} 0 10
   [junit4]   2> 1687305 T5484 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[2 (1488064045237927936)]} 0 1
   [junit4]   2> 1687311 T5500 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[2 (1488064045243170816)]} 0 1
   [junit4]   2> 1687320 T5485 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[3 (1488064045252608000)]} 0 2
   [junit4]   2> 1687326 T5495 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[3 (1488064045259948032)]} 0 0
   [junit4]   2> 1687333 T5487 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[4 (1488064045267288064)]} 0 0
   [junit4]   2> 1687339 T5496 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[4 (1488064045273579520)]} 0 0
   [junit4]   2> 1687346 T5488 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[5 (1488064045279870976)]} 0 3
   [junit4]   2> 1687352 T5497 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[5 (1488064045286162432)]} 0 1
   [junit4]   2> 1687357 T5483 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[6 (1488064045292453888)]} 0 0
   [junit4]   2> 1687368 T5499 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[6 (1488064045302939648)]} 0 1
   [junit4]   2> 1687382 T5484 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[7 (1488064045317619712)]} 0 3
   [junit4]   2> 1687389 T5498 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[7 (1488064045326008320)]} 0 0
   [junit4]   2> 1687396 T5486 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[8 (1488064045332299776)]} 0 1
   [junit4]   2> 1687414 T5500 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[8 (1488064045348028416)]} 0 5
   [junit4]   2> 1687425 T5485 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[9 (1488064045359562752)]} 0 4
   [junit4]   2> 1687433 T5495 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[9 (1488064045372145664)]} 0 1
   [junit4]   2> 1687438 T5487 C3907 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1687452 T5487 C3907 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@57377192 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2934c08c)),segFN=segments_1,generation=1}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@57377192 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2934c08c)),segFN=segments_2,generation=2}
   [junit4]   2> 1687455 T5487 C3907 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
   [junit4]   2> 1687461 T5487 C3907 oass.SolrIndexSearcher.<init> Opening Searcher@103a5ca6[collection1] main
   [junit4]   2> 1687462 T5487 C3907 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 1687464 T5490 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@103a5ca6[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):c9)))}
   [junit4]   2> 1687465 T5487 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} {commit=} 0 27
   [junit4]   2> 1687469 T5496 C3908 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1687473 T5496 C3908 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@41eaa228 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@16f5c918)),segFN=segments_1,generation=1}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@41eaa228 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@16f5c918)),segFN=segments_2,generation=2}
   [junit4]   2> 1687474 T5496 C3908 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
   [junit4]   2> 1687477 T5496 C3908 oass.SolrIndexSearcher.<init> Opening Searcher@6d9ea3a0[collection1] main
   [junit4]   2> 1687478 T5496 C3908 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 1687481 T5502 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6d9ea3a0[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):c9)))}
   [junit4]   2> 1687481 T5496 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} {commit=} 0 12
   [junit4]   2> 1687491 T5488 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[10 (1488064045429817344)]} 0 3
   [junit4]   2> 1687502 T5497 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[10 (1488064045438205952)]} 0 6
   [junit4]   2> 1687508 T5483 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[11 (1488064045450788864)]} 0 0
   [junit4]   2> 1687515 T5499 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[11 (1488064045457080320)]} 0 1
   [junit4]   2> 1687521 T5484 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[12 (1488064045463371776)]} 0 2
   [junit4]   2> 1687531 T5498 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[12 (1488064045473857536)]} 0 2
   [junit4]   2> 1687537 T5486 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[13 (1488064045480148992)]} 0 1
   [junit4]   2> 1687546 T5500 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[13 (1488064045487489024)]} 0 3
   [junit4]   2> 1687551 T5485 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[14 (1488064045494829056)]} 0 1
   [junit4]   2> 1687560 T5495 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[14 (1488064045504266240)]} 0 1
   [junit4]   2> 1687566 T5487 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[15 (1488064045511606272)]} 0 0
   [junit4]   2> 1687573 T5496 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[15 (1488064045516849152)]} 0 2
   [junit4]   2> 1687579 T5488 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[16 (1488064045524189184)]} 0 2
   [junit4]   2> 1687585 T5497 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[16 (1488064045530480640)]} 0 1
   [junit4]   2> 1687593 T5484 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[17 (1488064045538869248)]} 0 3
   [junit4]   2> 1687601 T5498 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[17 (1488064045546209280)]} 0 3
   [junit4]   2> 1687606 T5486 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[100 (1488064045552500736)]} 0 1
   [junit4]   2> 1687612 T5500 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[100 (1488064045558792192)]} 0 1
   [junit4]   2> 1687627 T5485 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[101 (1488064045575569408)]} 0 0
   [junit4]   2> 1687634 T5495 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[101 (1488064045581860864)]} 0 2
   [junit4]   2> 1687642 T5487 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[102 (1488064045591298048)]} 0 0
   [junit4]   2> 1687648 T5496 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[102 (1488064045596540928)]} 0 1
   [junit4]   2> 1687653 T5488 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[103 (1488064045602832384)]} 0 0
   [junit4]   2> 1687660 T5497 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[103 (1488064045608075264)]} 0 2
   [junit4]   2> 1687665 T5483 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[104 (1488064045615415296)]} 0 0
   [junit4]   2> 1687670 T5499 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[104 (1488064045619609600)]} 0 1
   [junit4]   2> 1687674 T5484 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[105 (1488064045623803904)]} 0 1
   [junit4]   2> 1687679 T5498 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[105 (1488064045629046784)]} 0 1
   [junit4]   2> 1687684 T5486 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[106 (1488064045634289664)]} 0 1
   [junit4]   2> 1687689 T5500 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[106 (1488064045639532544)]} 0 1
   [junit4]   2> 1687695 T5485 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[107 (1488064045646872576)]} 0 0
   [junit4]   2> 1687700 T5496 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[107 (1488064045651066880)]} 0 1
   [junit4]   2> 1687706 T5487 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[108 (1488064045657358336)]} 0 2
   [junit4]   2> 1687711 T5497 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[108 (1488064045663649792)]} 0 0
   [junit4]   2> 1687718 T5488 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[109 (1488064045670989824)]} 0 0
   [junit4]   2> 1687724 T5499 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[109 (1488064045676232704)]} 0 1
   [junit4]   2> 1687729 T5484 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[110 (1488064045682524160)]} 0 0
   [junit4]   2> 1687735 T5498 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[110 (1488064045687767040)]} 0 1
   [junit4]   2> 1687742 T5486 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[111 (1488064045696155648)]} 0 1
   [junit4]   2> 1687748 T5495 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[111 (1488064045702447104)]} 0 0
   [junit4]   2> 1687756 T5485 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[112 (1488064045709787136)]} 0 1
   [junit4]   2> 1687762 T5500 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[112 (1488064045716078592)]} 0 1
   [junit4]   2> 1687768 T5487 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[113 (1488064045723418624)]} 0 1
   [junit4]   2> 1687776 T5496 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[113 (1488064045730758656)]} 0 1
   [junit4]   2> 1687785 T5488 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[114 (1488064045740195840)]} 0 1
   [junit4]   2> 1687791 T5497 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[114 (1488064045747535872)]} 0 1
   [junit4]   2> 1687798 T5483 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[115 (1488064045753827328)]} 0 1
   [junit4]   2> 1687804 T5499 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[115 (1488064045761167360)]} 0 0
   [junit4]   2> 1687811 T5484 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[116 (1488064045767458816)]} 0 1
   [junit4]   2> 1687817 T5498 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[116 (1488064045774798848)]} 0 0
   [junit4]   2> 1687822 T5486 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[117 (1488064045780041728)]} 0 0
   [junit4]   2> 1687829 T5495 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[117 (1488064045786333184)]} 0 1
   [junit4]   2> 1687848 T5485 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[118 (1488064045806256128)]} 0 1
   [junit4]   2> 1687856 T5500 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[118 (1488064045814644736)]} 0 1
   [junit4]   2> 1687862 T5487 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[119 (1488064045821984768)]} 0 0
   [junit4]   2> 1687869 T5496 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[119 (1488064045828276224)]} 0 1
   [junit4]   2> 1687878 T5488 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[120 (1488064045837713408)]} 0 2
   [junit4]   2> 1687884 T5497 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[120 (1488064045845053440)]} 0 0
   [junit4]   2> 1687890 T5483 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[121 (1488064045851344896)]} 0 0
   [junit4]   2> 1687895 T5499 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[121 (1488064045856587776)]} 0 0
   [junit4]   2> 1687902 T5484 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[122 (1488064045863927808)]} 0 0
   [junit4]   2> 1687908 T5498 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[122 (1488064045870219264)]} 0 0
   [junit4]   2> 1687915 T5486 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[123 (1488064045877559296)]} 0 0
   [junit4]   2> 1687921 T5495 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[123 (1488064045883850752)]} 0 0
   [junit4]   2> 1687931 T5485 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[124 (1488064045893287936)]} 0 1
   [junit4]   2> 1687936 T5500 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[124 (1488064045898530816)]} 0 1
   [junit4]   2> 1687942 T5487 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[125 (1488064045904822272)]} 0 1
   [junit4]   2> 1687947 T5496 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[125 (1488064045911113728)]} 0 0
   [junit4]   2> 1687963 T5488 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[126 (1488064045925793792)]} 0 4
   [junit4]   2> 1687975 T5497 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[126 (1488064045939425280)]} 0 1
   [junit4]   2> 1687979 T5483 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[127 (1488064045944668160)]} 0 1
   [junit4]   2> 1687985 T5499 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[127 (1488064045950959616)]} 0 1
   [junit4]   2> 1687991 T5484 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[128 (1488064045956202496)]} 0 1
   [junit4]   2> 1687995 T5498 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[128 (1488064045961445376)]} 0 0
   [junit4]   2> 1688001 T5486 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[129 (1488064045966688256)]} 0 1
   [junit4]   2> 1688010 T5495 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[129 (1488064045977174016)]} 0 0
   [junit4]   2> 1688016 T5485 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[130 (1488064045982416896)]} 0 1
   [junit4]   2> 1688027 T5500 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[130 (1488064045991854080)]} 0 5
   [junit4]   2> 1688039 T5487 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[131 (1488064046006534144)]} 0 1
   [junit4]   2> 1688046 T5496 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[131 (1488064046014922752)]} 0 0
   [junit4]   2> 1688052 T5488 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[132 (1488064046020165632)]} 0 1
   [junit4]   2> 1688056 T5497 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[132 (1488064046025408512)]} 0 0
   [junit4]   2> 1688062 T5483 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[133 (1488064046031699968)]} 0 0
   [junit4]   2> 1688074 T5499 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[133 (1488064046042185728)]} 0 4
   [junit4]   2> 1688084 T5484 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[134 (1488064046053720064)]} 0 1
   [junit4]   2> 1688091 T5498 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[134 (1488064046062108672)]} 0 1
   [junit4]   2> 1688097 T5486 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[135 (1488064046068400128)]} 0 1
   [junit4]   2> 1688102 T5500 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[135 (1488064046073643008)]} 0 1
   [junit4]   2> 1688106 T5485 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[136 (1488064046077837312)]} 0 0
   [junit4]   2> 1688112 T5496 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[136 (1488064046084128768)]} 0 0
   [junit4]   2> 1688119 T5487 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[137 (1488064046091468800)]} 0 1
   [junit4]   2> 1688123 T5497 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[137 (1488064046095663104)]} 0 0
   [junit4]   2> 1688129 T5483 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[138 (1488064046101954560)]} 0 0
   [junit4]   2> 1688134 T5499 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[138 (1488064046107197440)]} 0 1
   [junit4]   2> 1688145 T5484 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[139 (1488064046118731776)]} 0 1
   [junit4]   2> 1688150 T5495 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[139 (1488064046123974656)]} 0 1
   [junit4]   2> 1688157 T5486 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[140 (1488064046131314688)]} 0 0
   [junit4]   2> 1688165 T5498 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[140 (1488064046139703296)]} 0 0
   [junit4]   2> 1688170 T5485 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[141 (1488064046144946176)]} 0 0
   [junit4]   2> 1688175 T5500 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[141 (1488064046150189056)]} 0 0
   [junit4]   2> 1688183 T5487 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[142 (1488064046157529088)]} 0 1
   [junit4]   2> 1688190 T5496 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[142 (1488064046162771968)]} 0 3
   [junit4]   2> 1688201 T5488 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[143 (1488064046176403456)]} 0 1
   [junit4]   2> 1688205 T5497 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[143 (1488064046181646336)]} 0 0
   [junit4]   2> 1688214 T5483 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[144 (1488064046191083520)]} 0 1
   [junit4]   2> 1688222 T5499 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[144 (1488064046198423552)]} 0 1
   [junit4]   2> 1688228 T5484 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[145 (1488064046204715008)]} 0 1
   [junit4]   2> 1688232 T5495 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[145 (1488064046209957888)]} 0 0
   [junit4]   2> 1688238 T5486 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[146 (1488064046215200768)]} 0 1
   [junit4]   2> 1688242 T5498 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[146 (1488064046220443648)]} 0 0
   [junit4]   2> 1688246 T5485 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[147 (1488064046224637952)]} 0 0
   [junit4]   2> 1688251 T5500 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[147 (1488064046228832256)]} 0 1
   [junit4]   2> 1688256 T5487 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[148 (1488064046234075136)]} 0 0
   [junit4]   2> 1688260 T5496 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[148 (1488064046238269440)]} 0 1
   [junit4]   2> 1688266 T5488 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[149 (1488064046245609472)]} 0 1
   [junit4]   2> 1688271 T5497 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={wt=javabin&version=2} {add=[149 (1488064046249803776)]} 0 1
   [junit4]   2> 1688276 T5483 C3907 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1688290 T5483 C3907 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@57377192 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2934c08c)),segFN=segments_2,generation=2}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@57377192 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2934c08c)),segFN=segments_3,generation=3}
   [junit4]   2> 1688291 T5483 C3907 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
   [junit4]   2> 1688292 T5483 C3907 oass.SolrIndexSearcher.<init> Opening Searcher@3f07f462[collection1] main
   [junit4]   2> 1688293 T5483 C3907 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 1688296 T5490 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3f07f462[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):c9) Uninverting(_1(6.0.0):c58)))}
   [junit4]   2> 1688297 T5483 C3907 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} {commit=} 0 22
   [junit4]   2> 1688303 T5499 C3908 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1688317 T5499 C3908 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@41eaa228 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@16f5c918)),segFN=segments_2,generation=2}
   [junit4]   2> 		commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@41eaa228 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@16f5c918)),segFN=segments_3,generation=3}
   [junit4]   2> 1688317 T5499 C3908 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
   [junit4]   2> 1688319 T5499 C3908 oass.SolrIndexSearcher.<init> Opening Searcher@3ad16aa6[collection1] main
   [junit4]   2> 1688320 T5499 C3908 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 1688323 T5502 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3ad16aa6[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):c9) Uninverting(_1(6.0.0):c58)))}
   [junit4]   2> 1688324 T5499 C3908 oasup.LogUpdateProcessor.finish [collection1] webapp=/fm/db path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} {commit=} 0 21
   [junit4]   2> 1688353 T5484 C3907 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&sort=one_i1_ml+desc&rows=13&wt=javabin&version=2} hits=67 status=0 QTime=25 
   [junit4]   2> 1688421 T5496 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&fl=id&NOW=1419128462169&start=0&fsv=true&isShard=true&sort=one_i1_ml+desc&shard.url=https://127.0.0.1:50974/fm/db|[ff01::114]:33332/fm/db&rows=13&wt=javabin&version=2} hits=67 status=0 QTime=4 
   [junit4]   2> 1688437 T5497 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&NOW=1419128462169&ids=11,12,13,1,2,3,4,5,6,7,8,9,10&isShard=true&shard.url=https://127.0.0.1:50974/fm/db|[ff01::114]:33332/fm/db&rows=13&wt=javabin&version=2} status=0 QTime=1 
   [junit4]   2> 1688467 T5495 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&shards=https://127.0.0.1:50974/fm/db|[ff01::114]:33332/fm/db&sort=one_i1_ml+desc&rows=13&wt=javabin&version=2} hits=67 status=0 QTime=104 
   [junit4]   2> 1688497 T5486 C3907 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&sort=one_i1_ml+asc&rows=13&wt=javabin&version=2} hits=67 status=0 QTime=1 
   [junit4]   2> 1688520 T5500 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&fl=id&NOW=1419128462313&start=0&fsv=true&isShard=true&sort=one_i1_ml+asc&shard.url=[ff01::114]:33332/fm/db|https://127.0.0.1:50974/fm/db&rows=13&wt=javabin&version=2} hits=67 status=0 QTime=1 
   [junit4]   2> 1688552 T5496 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&NOW=1419128462313&ids=11,12,13,1,2,3,4,5,6,7,8,9,10&isShard=true&shard.url=[ff01::114]:33332/fm/db|https://127.0.0.1:50974/fm/db&rows=13&wt=javabin&version=2} status=0 QTime=1 
   [junit4]   2> 1688557 T5499 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&shards=[ff01::114]:33332/fm/db|https://127.0.0.1:50974/fm/db&sort=one_i1_ml+asc&rows=13&wt=javabin&version=2} hits=67 status=0 QTime=50 
   [junit4]   2> 1688580 T5485 C3907 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&sort=one_i1_ml+desc,id+asc&rows=200&wt=javabin&version=2} hits=67 status=0 QTime=1 
   [junit4]   2> 1688618 T5495 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&fl=id&NOW=1419128462410&start=0&fsv=true&isShard=true&sort=one_i1_ml+desc,id+asc&shard.url=[ff01::213]:33332/fm/db|[ff01::114]:33332/fm/db|https://127.0.0.1:50974/fm/db|[ff01::083]:33332/fm/db&rows=200&wt=javabin&version=2} hits=67 status=0 QTime=4 
   [junit4]   2> 1688674 T5500 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&NOW=1419128462410&ids=110,111,112,113,114,115,116,117,118,119,10,11,12,13,14,15,16,17,120,121,122,1,123,2,124,3,125,4,126,5,127,6,128,7,129,8,9,130,131,132,133,134,135,136,137,138,139,140,141,142,143,144,100,145,101,146,102,147,103,148,104,149,105,106,107,108,109&isShard=true&shard.url=[ff01::213]:33332/fm/db|[ff01::114]:33332/fm/db|https://127.0.0.1:50974/fm/db|[ff01::083]:33332/fm/db&rows=200&wt=javabin&version=2} status=0 QTime=15 
   [junit4]   2> 1688911 T5497 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&shards=[ff01::213]:33332/fm/db|[ff01::114]:33332/fm/db|https://127.0.0.1:50974/fm/db|[ff01::083]:33332/fm/db&sort=one_i1_ml+desc,id+asc&rows=200&wt=javabin&version=2} hits=67 status=0 QTime=307 
   [junit4]   2> 1688957 T5488 C3907 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&sort=one_i1_ml+asc,id+desc&rows=200&wt=javabin&version=2} hits=67 status=0 QTime=0 
   [junit4]   2> 1688994 T5495 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&fl=id&NOW=1419128462788&start=0&fsv=true&isShard=true&sort=one_i1_ml+asc,id+desc&shard.url=https://127.0.0.1:50974/fm/db&rows=200&wt=javabin&version=2} hits=67 status=0 QTime=3 
   [junit4]   2> 1689021 T5498 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&NOW=1419128462788&ids=110,111,112,113,114,115,116,117,118,119,10,11,12,13,14,15,16,17,120,121,122,1,123,2,124,3,125,4,126,5,127,6,128,7,129,8,9,130,131,132,133,134,135,136,137,138,139,140,141,142,143,100,144,101,145,102,146,103,147,104,148,105,149,106,107,108,109&isShard=true&shard.url=https://127.0.0.1:50974/fm/db&rows=200&wt=javabin&version=2} status=0 QTime=7 
   [junit4]   2> 1689030 T5499 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&shards=https://127.0.0.1:50974/fm/db&sort=one_i1_ml+asc,id+desc&rows=200&wt=javabin&version=2} hits=67 status=0 QTime=48 
   [junit4]   2> 1689057 T5483 C3907 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&sort=three_l1_ml+desc&rows=13&wt=javabin&version=2} hits=67 status=0 QTime=1 
   [junit4]   2> 1689076 T5500 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&fl=id&NOW=1419128462877&start=0&fsv=true&isShard=true&sort=three_l1_ml+desc&shard.url=https://127.0.0.1:50974/fm/db|[ff01::083]:33332/fm/db|[ff01::213]:33332/fm/db&rows=13&wt=javabin&version=2} hits=67 status=0 QTime=1 
   [junit4]   2> 1689084 T5497 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&NOW=1419128462877&ids=11,12,13,1,2,3,4,5,6,7,8,9,10&isShard=true&shard.url=https://127.0.0.1:50974/fm/db|[ff01::083]:33332/fm/db|[ff01::213]:33332/fm/db&rows=13&wt=javabin&version=2} status=0 QTime=2 
   [junit4]   2> 1689091 T5496 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&shards=https://127.0.0.1:50974/fm/db|[ff01::083]:33332/fm/db|[ff01::213]:33332/fm/db&sort=three_l1_ml+desc&rows=13&wt=javabin&version=2} hits=67 status=0 QTime=20 
   [junit4]   2> 1689125 T5486 C3907 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&sort=three_l1_ml+asc&rows=13&wt=javabin&version=2} hits=67 status=0 QTime=0 
   [junit4]   2> 1689154 T5498 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&fl=id&NOW=1419128462946&start=0&fsv=true&isShard=true&sort=three_l1_ml+asc&shard.url=https://127.0.0.1:50974/fm/db|[ff01::083]:33332/fm/db&rows=13&wt=javabin&version=2} hits=67 status=0 QTime=1 
   [junit4]   2> 1689176 T5499 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&NOW=1419128462946&ids=11,12,13,1,2,3,4,5,6,7,8,9,10&isShard=true&shard.url=https://127.0.0.1:50974/fm/db|[ff01::083]:33332/fm/db&rows=13&wt=javabin&version=2} status=0 QTime=1 
   [junit4]   2> 1689180 T5495 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&shards=https://127.0.0.1:50974/fm/db|[ff01::083]:33332/fm/db&sort=three_l1_ml+asc&rows=13&wt=javabin&version=2} hits=67 status=0 QTime=40 
   [junit4]   2> 1689230 T5487 C3907 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&sort=three_l1_ml+desc,id+asc&rows=200&wt=javabin&version=2} hits=67 status=0 QTime=2 
   [junit4]   2> 1689269 T5497 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&fl=id&NOW=1419128463070&start=0&fsv=true&isShard=true&sort=three_l1_ml+desc,id+asc&shard.url=https://127.0.0.1:50974/fm/db|[ff01::083]:33332/fm/db&rows=200&wt=javabin&version=2} hits=67 status=0 QTime=2 
   [junit4]   2> 1689283 T5496 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&NOW=1419128463070&ids=110,111,112,113,114,115,116,117,118,119,10,11,12,13,14,15,16,17,120,121,122,1,123,2,124,3,125,4,126,5,127,6,128,7,129,8,9,130,131,132,133,134,135,136,137,138,139,140,141,142,143,144,100,145,101,146,102,147,103,148,104,149,105,106,107,108,109&isShard=true&shard.url=https://127.0.0.1:50974/fm/db|[ff01::083]:33332/fm/db&rows=200&wt=javabin&version=2} status=0 QTime=5 
   [junit4]   2> 1689297 T5500 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&shards=https://127.0.0.1:50974/fm/db|[ff01::083]:33332/fm/db&sort=three_l1_ml+desc,id+asc&rows=200&wt=javabin&version=2} hits=67 status=0 QTime=33 
   [junit4]   2> 1689319 T5485 C3907 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&sort=three_l1_ml+asc,id+desc&rows=200&wt=javabin&version=2} hits=67 status=0 QTime=0 
   [junit4]   2> 1689351 T5495 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&fl=id&NOW=1419128463148&start=0&fsv=true&isShard=true&sort=three_l1_ml+asc,id+desc&shard.url=[ff01::114]:33332/fm/db|https://127.0.0.1:50974/fm/db|[ff01::083]:33332/fm/db&rows=200&wt=javabin&version=2} hits=67 status=0 QTime=1 
   [junit4]   2> 1689365 T5497 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&NOW=1419128463148&ids=110,111,112,113,114,115,116,117,118,119,10,11,12,13,14,15,16,17,120,121,122,1,123,2,124,3,125,4,126,5,127,6,128,7,129,8,9,130,131,132,133,134,135,136,137,138,139,140,141,142,143,100,144,101,145,102,146,103,147,104,148,105,149,106,107,108,109&isShard=true&shard.url=[ff01::114]:33332/fm/db|https://127.0.0.1:50974/fm/db|[ff01::083]:33332/fm/db&rows=200&wt=javabin&version=2} status=0 QTime=7 
   [junit4]   2> 1689372 T5498 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&shards=[ff01::114]:33332/fm/db|https://127.0.0.1:50974/fm/db|[ff01::083]:33332/fm/db&sort=three_l1_ml+asc,id+desc&rows=200&wt=javabin&version=2} hits=67 status=0 QTime=30 
   [junit4]   2> 1689383 T5488 C3907 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&sort=five_s1_ml+desc&rows=13&wt=javabin&version=2} hits=67 status=0 QTime=1 
   [junit4]   2> 1689393 T5500 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&fl=id&NOW=1419128463196&start=0&fsv=true&isShard=true&sort=five_s1_ml+desc&shard.url=https://127.0.0.1:50974/fm/db&rows=13&wt=javabin&version=2} hits=67 status=0 QTime=1 
   [junit4]   2> 1689399 T5499 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&NOW=1419128463196&ids=11,12,13,1,2,3,4,5,6,7,8,9,10&isShard=true&shard.url=https://127.0.0.1:50974/fm/db&rows=13&wt=javabin&version=2} status=0 QTime=1 
   [junit4]   2> 1689404 T5496 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&shards=https://127.0.0.1:50974/fm/db&sort=five_s1_ml+desc&rows=13&wt=javabin&version=2} hits=67 status=0 QTime=14 
   [junit4]   2> 1689414 T5484 C3907 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&sort=five_s1_ml+asc&rows=13&wt=javabin&version=2} hits=67 status=0 QTime=1 
   [junit4]   2> 1689423 T5497 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&fl=id&NOW=1419128463226&start=0&fsv=true&isShard=true&sort=five_s1_ml+asc&shard.url=https://127.0.0.1:50974/fm/db|[ff01::114]:33332/fm/db&rows=13&wt=javabin&version=2} hits=67 status=0 QTime=0 
   [junit4]   2> 1689428 T5498 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&NOW=1419128463226&ids=11,12,13,1,2,3,4,5,6,7,8,9,10&isShard=true&shard.url=https://127.0.0.1:50974/fm/db|[ff01::114]:33332/fm/db&rows=13&wt=javabin&version=2} status=0 QTime=1 
   [junit4]   2> 1689431 T5495 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&shards=https://127.0.0.1:50974/fm/db|[ff01::114]:33332/fm/db&sort=five_s1_ml+asc&rows=13&wt=javabin&version=2} hits=67 status=0 QTime=11 
   [junit4]   2> 1689437 T5483 C3907 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&sort=five_s1_ml+desc,id+asc&rows=200&wt=javabin&version=2} hits=67 status=0 QTime=1 
   [junit4]   2> 1689448 T5499 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&fl=id&NOW=1419128463250&start=0&fsv=true&isShard=true&sort=five_s1_ml+desc,id+asc&shard.url=[ff01::213]:33332/fm/db|https://127.0.0.1:50974/fm/db&rows=200&wt=javabin&version=2} hits=67 status=0 QTime=2 
   [junit4]   2> 1689465 T5496 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&NOW=1419128463250&ids=110,111,112,113,114,115,116,117,118,119,10,11,12,13,14,15,16,17,120,121,122,1,123,2,124,3,125,4,126,5,127,6,128,7,129,8,9,130,131,132,133,134,135,136,137,138,139,140,141,142,143,144,100,145,101,146,102,147,103,148,104,149,105,106,107,108,109&isShard=true&shard.url=[ff01::213]:33332/fm/db|https://127.0.0.1:50974/fm/db&rows=200&wt=javabin&version=2} status=0 QTime=5 
   [junit4]   2> 1689470 T5500 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&shards=[ff01::213]:33332/fm/db|https://127.0.0.1:50974/fm/db&sort=five_s1_ml+desc,id+asc&rows=200&wt=javabin&version=2} hits=67 status=0 QTime=26 
   [junit4]   2> 1689482 T5486 C3907 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&sort=five_s1_ml+asc,id+desc&rows=200&wt=javabin&version=2} hits=67 status=0 QTime=0 
   [junit4]   2> 1689493 T5498 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&fl=id&NOW=1419128463295&start=0&fsv=true&isShard=true&sort=five_s1_ml+asc,id+desc&shard.url=[ff01::083]:33332/fm/db|https://127.0.0.1:50974/fm/db|[ff01::114]:33332/fm/db&rows=200&wt=javabin&version=2} hits=67 status=0 QTime=1 
   [junit4]   2> 1689514 T5495 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&NOW=1419128463295&ids=110,111,112,113,114,115,116,117,118,119,10,11,12,13,14,15,16,17,120,121,122,1,123,2,124,3,125,4,126,5,127,6,128,7,129,8,9,130,131,132,133,134,135,136,137,138,139,140,141,142,143,100,144,101,145,102,146,103,147,104,148,105,149,106,107,108,109&isShard=true&shard.url=[ff01::083]:33332/fm/db|https://127.0.0.1:50974/fm/db|[ff01::114]:33332/fm/db&rows=200&wt=javabin&version=2} status=0 QTime=11 
   [junit4]   2> 1689524 T5497 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&shards=[ff01::083]:33332/fm/db|https://127.0.0.1:50974/fm/db|[ff01::114]:33332/fm/db&sort=five_s1_ml+asc,id+desc&rows=200&wt=javabin&version=2} hits=67 status=0 QTime=35 
   [junit4]   2> 1689537 T5485 C3907 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&sort=two_i1_mf+desc,id+asc&rows=200&wt=javabin&version=2} hits=67 status=0 QTime=1 
   [junit4]   2> 1689563 T5496 C3908 oasc.SolrCore.execute [collection1] webapp=/fm/db path=/select params={q=*:*&distrib=false&fl=i

[...truncated too long message...]

lr.TestDistributedMissingSort-84BC817DF13FEF5F-001/tempDir-001/shard1/data/index [CachedDir<<refCount=0;path=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.TestDistributedMissingSort-84BC817DF13FEF5F-001/tempDir-001/shard1/data/index;done=false>>]
   [junit4]   2> 1801920 T5479 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.TestDistributedMissingSort-84BC817DF13FEF5F-001/tempDir-001/shard1/data/index
   [junit4]   2> 1801921 T5479 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.TestDistributedMissingSort-84BC817DF13FEF5F-001/tempDir-001/shard1/data [CachedDir<<refCount=0;path=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.TestDistributedMissingSort-84BC817DF13FEF5F-001/tempDir-001/shard1/data;done=false>>]
   [junit4]   2> 1801922 T5479 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.TestDistributedMissingSort-84BC817DF13FEF5F-001/tempDir-001/shard1/data
   [junit4]   2> 1801923 T5479 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/fm/db,null}
   [junit4]   2> 1806814 T5479 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestDistributedMissingSort -Dtests.method=testDistribSearch -Dtests.seed=84BC817DF13FEF5F -Dtests.slow=true -Dtests.locale=es_BO -Dtests.timezone=Australia/NSW -Dtests.asserts=false -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR    120s | TestDistributedMissingSort.testDistribSearch <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: https://127.0.0.1:50978/fm/db
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([84BC817DF13FEF5F:55A0F6586608F63]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:578)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:213)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:209)
   [junit4]    > 	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:124)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.indexDoc(BaseDistributedSearchTestCase.java:438)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.indexr(BaseDistributedSearchTestCase.java:420)
   [junit4]    > 	at org.apache.solr.TestDistributedMissingSort.index(TestDistributedMissingSort.java:90)
   [junit4]    > 	at org.apache.solr.TestDistributedMissingSort.doTest(TestDistributedMissingSort.java:42)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:875)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]    > Caused by: java.net.SocketTimeoutException: Read timed out
   [junit4]    > 	at java.net.SocketInputStream.socketRead0(Native Method)
   [junit4]    > 	at java.net.SocketInputStream.read(SocketInputStream.java:150)
   [junit4]    > 	at java.net.SocketInputStream.read(SocketInputStream.java:121)
   [junit4]    > 	at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
   [junit4]    > 	at sun.security.ssl.InputRecord.read(InputRecord.java:503)
   [junit4]    > 	at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:954)
   [junit4]    > 	at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:911)
   [junit4]    > 	at sun.security.ssl.AppInputStream.read(AppInputStream.java:105)
   [junit4]    > 	at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
   [junit4]    > 	at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
   [junit4]    > 	at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
   [junit4]    > 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
   [junit4]    > 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
   [junit4]    > 	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:260)
   [junit4]    > 	at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
   [junit4]    > 	at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
   [junit4]    > 	at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
   [junit4]    > 	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:271)
   [junit4]    > 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:123)
   [junit4]    > 	at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:682)
   [junit4]    > 	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:486)
   [junit4]    > 	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:463)
   [junit4]    > 	... 50 more
   [junit4]   2> 1806852 T5479 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.TestDistributedMissingSort-84BC817DF13FEF5F-001
   [junit4]   2> NOTE: test params are: codec=Lucene50, sim=DefaultSimilarity, locale=es_BO, timezone=Australia/NSW
   [junit4]   2> NOTE: Mac OS X 10.8.5 x86_64/Oracle Corporation 1.8.0_20 (64-bit)/cpus=2,threads=1,free=222753032,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [OverseerRolesTest, BadIndexSchemaTest, TestXIncludeConfig, TestExtendedDismaxParser, TestFieldResource, HdfsSyncSliceTest, TestManagedResource, TestSimpleQParserPlugin, UpdateParamsTest, TestWordDelimiterFilterFactory, CoreContainerCoreInitFailuresTest, WordBreakSolrSpellCheckerTest, DateMathParserTest, TestRemoteStreaming, TestFuzzyAnalyzedSuggestions, HdfsRecoveryZkTest, TestRealTimeGet, TestLuceneMatchVersion, SliceStateTest, TestExceedMaxTermLength, QueryResultKeyTest, TestElisionMultitermQuery, TestManagedSynonymFilterFactory, XsltUpdateRequestHandlerTest, TestCloudSchemaless, TestFunctionQuery, MinimalSchemaTest, SimpleFacetsTest, TestSolrXmlPersistence, HdfsUnloadDistributedZkTest, TestDefaultSimilarityFactory, TestCSVLoader, TestStressUserVersions, TermVectorComponentTest, DefaultValueUpdateProcessorTest, TestBulkSchemaConcurrent, TestSolrDynamicMBean, TestCSVResponseWriter, TestComponentsName, CustomCollectionTest, QueryEqualityTest, TestDocBasedVersionConstraints, SuggestComponentTest, TestSolrQueryParserDefaultOperatorResource, TestIndexSearcher, TestManagedSchemaFieldTypeResource, ResourceLoaderTest, SampleTest, UUIDUpdateProcessorFallbackTest, CollectionsAPIAsyncDistributedZkTest, TestTrie, TestRequestStatusCollectionAPI, TestJmxMonitoredMap, PluginInfoTest, OpenCloseCoreStressTest, OverriddenZkACLAndCredentialsProvidersTest, TestSolrConfigHandlerConcurrent, BlockDirectoryTest, TestDistribDocBasedVersion, ResponseHeaderTest, TestCustomSort, ZkStateWriterTest, TestQuerySenderListener, TermsComponentTest, TestStressRecovery, TestQuerySenderNoQuery, TestSchemaResource, DocumentBuilderTest, HdfsWriteToMultipleCollectionsTest, TestCloudManagedSchema, TestCloudManagedSchemaConcurrent, TestReplicaProperties, SolrInfoMBeanTest, TestSolrConfigHandlerCloud, SyncSliceTest, TestSolrXml, TestDistributedMissingSort]
   [junit4] Completed in 120.39s, 1 test, 1 error <<< FAILURES!

[...truncated 1165 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:519: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:467: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:61: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/extra-targets.xml:39: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:187: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:510: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1349: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:956: There were test failures: 453 suites, 1850 tests, 1 error, 37 ignored (21 assumptions)

Total time: 164 minutes 3 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseG1GC (asserts: false)
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any