You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2015/08/23 02:17:54 UTC

[JENKINS-EA] Lucene-Solr-trunk-Linux (64bit/jdk1.9.0-ea-b78) - Build # 13963 - Still Failing!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/13963/
Java: 64bit/jdk1.9.0-ea-b78 -XX:-UseCompressedOops -XX:+UseG1GC

3 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.core.TestCoreDiscovery

Error Message:
ERROR: SolrIndexSearcher opens=27 closes=26

Stack Trace:
java.lang.AssertionError: ERROR: SolrIndexSearcher opens=27 closes=26
	at __randomizedtesting.SeedInfo.seed([4758337A9E221C3B]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:467)
	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:233)
	at sun.reflect.GeneratedMethodAccessor38.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:504)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:799)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:746)


FAILED:  junit.framework.TestSuite.org.apache.solr.core.TestCoreDiscovery

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.core.TestCoreDiscovery:     1) Thread[id=7719, name=searcherExecutor-3874-thread-1, state=WAITING, group=TGRP-TestCoreDiscovery]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:746)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.core.TestCoreDiscovery: 
   1) Thread[id=7719, name=searcherExecutor-3874-thread-1, state=WAITING, group=TGRP-TestCoreDiscovery]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:746)
	at __randomizedtesting.SeedInfo.seed([4758337A9E221C3B]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.core.TestCoreDiscovery

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=7719, name=searcherExecutor-3874-thread-1, state=WAITING, group=TGRP-TestCoreDiscovery]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:746)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=7719, name=searcherExecutor-3874-thread-1, state=WAITING, group=TGRP-TestCoreDiscovery]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:746)
	at __randomizedtesting.SeedInfo.seed([4758337A9E221C3B]:0)




Build Log:
[...truncated 10391 lines...]
   [junit4] Suite: org.apache.solr.core.TestCoreDiscovery
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/init-core-data-001
   [junit4]   2> 1016147 INFO  (SUITE-TestCoreDiscovery-seed#[4758337A9E221C3B]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 1016147 INFO  (SUITE-TestCoreDiscovery-seed#[4758337A9E221C3B]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 1016147 INFO  (SUITE-TestCoreDiscovery-seed#[4758337A9E221C3B]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 1016148 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testAlternateCoreDir
   [junit4]   2> 1016152 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1016152 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    ] o.a.s.c.SolrResourceLoader using system property solr.solr.home: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-001
   [junit4]   2> 1016152 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-001/'
   [junit4]   2> 1016163 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-001/solr.xml
   [junit4]   2> 1016168 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002
   [junit4]   2> 1016168 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    ] o.a.s.c.CoreContainer New CoreContainer 966874190
   [junit4]   2> 1016168 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-001/]
   [junit4]   2> 1016168 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    ] o.a.s.c.CoreContainer loading shared library: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-001/lib
   [junit4]   2> 1016169 WARN  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-001/lib).
   [junit4]   2> 1016175 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 600000,connTimeout : 60000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1016180 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 1016180 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    ] o.a.s.c.CoreContainer Allocating transient cache for 2 transient cores
   [junit4]   2> 1016182 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1016182 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1016182 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1016182 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1016182 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    ] o.a.s.c.CoresLocator Looking for core definitions underneath /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002
   [junit4]   2> 1016183 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=core2, config=solrconfig-minimal.xml, transient=false, schema=schema-tiny.xml, loadOnStartup=false, configSetProperties=configsetprops.json, instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core2, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core2/, dataDir=core2}
   [junit4]   2> 1016183 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    ] o.a.s.c.CoresLocator Found core core2 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core2/
   [junit4]   2> 1016183 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=core1, config=solrconfig-minimal.xml, transient=false, schema=schema-tiny.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core1, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core1/, dataDir=core1}
   [junit4]   2> 1016183 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    ] o.a.s.c.CoresLocator Found core core1 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core1/
   [junit4]   2> 1016183 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    ] o.a.s.c.CoresLocator Found 2 core definitions
   [junit4]   2> 1016183 INFO  (coreLoadExecutor-3819-thread-1) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core1/'
   [junit4]   2> 1016196 INFO  (coreLoadExecutor-3819-thread-1) [    ] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1016227 INFO  (coreLoadExecutor-3819-thread-1) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1016231 INFO  (coreLoadExecutor-3819-thread-1) [    ] o.a.s.c.Config Loaded SolrConfig: solrconfig-minimal.xml
   [junit4]   2> 1016231 INFO  (coreLoadExecutor-3819-thread-1) [    ] o.a.s.s.IndexSchema Reading Solr Schema from /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core1/conf/schema-tiny.xml
   [junit4]   2> 1016233 INFO  (coreLoadExecutor-3819-thread-1) [    ] o.a.s.s.IndexSchema [core1] Schema name=tiny
   [junit4]   2> 1016236 INFO  (coreLoadExecutor-3819-thread-1) [    ] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1016237 INFO  (coreLoadExecutor-3819-thread-1) [    ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core1/conf'
   [junit4]   2> 1016237 INFO  (coreLoadExecutor-3819-thread-1) [    ] o.a.s.c.CoreContainer Creating SolrCore 'core1' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core1/
   [junit4]   2> 1016237 INFO  (coreLoadExecutor-3819-thread-1) [    x:core1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1016237 INFO  (coreLoadExecutor-3819-thread-1) [    x:core1] o.a.s.c.SolrCore [[core1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core1/], dataDir=[null]
   [junit4]   2> 1016238 INFO  (coreLoadExecutor-3819-thread-1) [    x:core1] o.a.s.c.SolrCore JMX monitoring not detected for core: core1
   [junit4]   2> 1016238 INFO  (coreLoadExecutor-3819-thread-1) [    x:core1] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core1/core1
   [junit4]   2> 1016238 INFO  (coreLoadExecutor-3819-thread-1) [    x:core1] o.a.s.c.SolrCore New index directory detected: old=null new=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core1/core1/index/
   [junit4]   2> 1016238 WARN  (coreLoadExecutor-3819-thread-1) [    x:core1] o.a.s.c.SolrCore [core1] Solr index directory '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core1/core1/index' doesn't exist. Creating new index...
   [junit4]   2> 1016238 INFO  (coreLoadExecutor-3819-thread-1) [    x:core1] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core1/core1/index
   [junit4]   2> 1016238 INFO  (coreLoadExecutor-3819-thread-1) [    x:core1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=39, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6892659827952045]
   [junit4]   2> 1016239 INFO  (coreLoadExecutor-3819-thread-1) [    x:core1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@3e9d96d3 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@57d4b945),segFN=segments_1,generation=1}
   [junit4]   2> 1016239 INFO  (coreLoadExecutor-3819-thread-1) [    x:core1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1016239 INFO  (OldIndexDirectoryCleanupThreadForCore-core1) [    x:core1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core core1 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core1/core1/
   [junit4]   2> 1016239 WARN  (OldIndexDirectoryCleanupThreadForCore-core1) [    x:core1] o.a.s.c.DirectoryFactory /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core1/core1/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 1016240 INFO  (coreLoadExecutor-3819-thread-1) [    x:core1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1016242 INFO  (coreLoadExecutor-3819-thread-1) [    x:core1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1016242 INFO  (coreLoadExecutor-3819-thread-1) [    x:core1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1016243 INFO  (coreLoadExecutor-3819-thread-1) [    x:core1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1016243 INFO  (coreLoadExecutor-3819-thread-1) [    x:core1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1016244 INFO  (coreLoadExecutor-3819-thread-1) [    x:core1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,/update/csv,/update/json/docs,/admin/luke,/select,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 1016244 INFO  (coreLoadExecutor-3819-thread-1) [    x:core1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1016245 INFO  (coreLoadExecutor-3819-thread-1) [    x:core1] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 1016245 INFO  (coreLoadExecutor-3819-thread-1) [    x:core1] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 1016245 INFO  (coreLoadExecutor-3819-thread-1) [    x:core1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=16, maxMergeAtOnceExplicit=29, maxMergedSegmentMB=39.5341796875, floorSegmentMB=1.3779296875, forceMergeDeletesPctAllowed=28.433216539551545, segmentsPerTier=46.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 1016245 INFO  (coreLoadExecutor-3819-thread-1) [    x:core1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@3e9d96d3 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@57d4b945),segFN=segments_1,generation=1}
   [junit4]   2> 1016245 INFO  (coreLoadExecutor-3819-thread-1) [    x:core1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1016246 INFO  (coreLoadExecutor-3819-thread-1) [    x:core1] o.a.s.s.SolrIndexSearcher Opening Searcher@485f8a20[core1] main
   [junit4]   2> 1016246 INFO  (coreLoadExecutor-3819-thread-1) [    x:core1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core1/conf
   [junit4]   2> 1016246 INFO  (coreLoadExecutor-3819-thread-1) [    x:core1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core1/conf}
   [junit4]   2> 1016246 INFO  (coreLoadExecutor-3819-thread-1) [    x:core1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core1/conf
   [junit4]   2> 1016246 INFO  (coreLoadExecutor-3819-thread-1) [    x:core1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 1016247 INFO  (coreLoadExecutor-3819-thread-1) [    x:core1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1016247 INFO  (searcherExecutor-3820-thread-1-processing-x:core1) [    x:core1] o.a.s.c.SolrCore [core1] Registered new searcher Searcher@485f8a20[core1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1016247 INFO  (coreLoadExecutor-3819-thread-1) [    x:core1] o.a.s.c.CoreContainer registering core: core1
   [junit4]   2> 1016247 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core2/'
   [junit4]   2> 1016258 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    ] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1016260 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1016264 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    ] o.a.s.c.Config Loaded SolrConfig: solrconfig-minimal.xml
   [junit4]   2> 1016264 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    ] o.a.s.s.IndexSchema Reading Solr Schema from /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core2/conf/schema-tiny.xml
   [junit4]   2> 1016266 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    ] o.a.s.s.IndexSchema [core2] Schema name=tiny
   [junit4]   2> 1016268 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    ] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1016268 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core2/conf'
   [junit4]   2> 1016269 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    ] o.a.s.c.CoreContainer Creating SolrCore 'core2' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core2/
   [junit4]   2> 1016269 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1016269 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.SolrCore [[core2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core2/], dataDir=[null]
   [junit4]   2> 1016269 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.SolrCore JMX monitoring not detected for core: core2
   [junit4]   2> 1016270 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core2/core2
   [junit4]   2> 1016270 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.SolrCore New index directory detected: old=null new=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core2/core2/index/
   [junit4]   2> 1016270 WARN  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.SolrCore [core2] Solr index directory '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core2/core2/index' doesn't exist. Creating new index...
   [junit4]   2> 1016271 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core2/core2/index
   [junit4]   2> 1016271 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=31, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=46.578125, floorSegmentMB=1.7138671875, forceMergeDeletesPctAllowed=4.111239661779519, segmentsPerTier=32.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4591986830410101
   [junit4]   2> 1016271 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@2e2ca921 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@19ffc01e),segFN=segments_1,generation=1}
   [junit4]   2> 1016271 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1016272 INFO  (OldIndexDirectoryCleanupThreadForCore-core2) [    x:core2] o.a.s.c.SolrCore Looking for old index directories to cleanup for core core2 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core2/core2/
   [junit4]   2> 1016272 WARN  (OldIndexDirectoryCleanupThreadForCore-core2) [    x:core2] o.a.s.c.DirectoryFactory /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core2/core2/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 1016273 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1016274 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1016274 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1016275 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1016275 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1016276 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,/update/csv,/update/json/docs,/admin/luke,/select,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 1016276 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1016276 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 1016276 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 1016277 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=49, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=50.6767578125, floorSegmentMB=1.2060546875, forceMergeDeletesPctAllowed=4.109522966722574, segmentsPerTier=15.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7902302423037314
   [junit4]   2> 1016277 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@2e2ca921 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@19ffc01e),segFN=segments_1,generation=1}
   [junit4]   2> 1016277 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1016277 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.s.SolrIndexSearcher Opening Searcher@f2ecf00[core2] main
   [junit4]   2> 1016277 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core2/conf
   [junit4]   2> 1016277 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core2/conf}
   [junit4]   2> 1016277 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core2/conf
   [junit4]   2> 1016278 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 1016278 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1016278 INFO  (searcherExecutor-3824-thread-1-processing-x:core2) [    x:core2] o.a.s.c.SolrCore [core2] Registered new searcher Searcher@f2ecf00[core2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1016278 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.CoreContainer registering core: core2
   [junit4]   2> 1016278 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.CoreContainer Shutting down CoreContainer instance=966874190
   [junit4]   2> 1016278 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core1] o.a.s.c.SolrCore [core1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1f3fc45a
   [junit4]   2> 1016279 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core1] o.a.s.u.UpdateHandler closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 1016279 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core1] o.a.s.u.SolrCoreState Closing SolrCoreState
   [junit4]   2> 1016279 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 1016279 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
   [junit4]   2> 1016279 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core1] o.a.s.c.SolrCore [core1] Closing main searcher on request.
   [junit4]   2> 1016279 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core1] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 1016279 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core1] o.a.s.c.CachingDirectoryFactory looking to close /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core1/core1 [CachedDir<<refCount=0;path=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core1/core1;done=false>>]
   [junit4]   2> 1016279 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core1] o.a.s.c.CachingDirectoryFactory Closing directory: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core1/core1
   [junit4]   2> 1016279 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core1] o.a.s.c.CachingDirectoryFactory looking to close /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core1/core1/index [CachedDir<<refCount=0;path=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core1/core1/index;done=false>>]
   [junit4]   2> 1016280 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core1] o.a.s.c.CachingDirectoryFactory Closing directory: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core1/core1/index
   [junit4]   2> 1016280 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.SolrCore [core2]  CLOSING SolrCore org.apache.solr.core.SolrCore@3bb0491b
   [junit4]   2> 1016280 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.u.UpdateHandler closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 1016280 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.u.SolrCoreState Closing SolrCoreState
   [junit4]   2> 1016280 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 1016280 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
   [junit4]   2> 1016280 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.SolrCore [core2] Closing main searcher on request.
   [junit4]   2> 1016280 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 1016280 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.CachingDirectoryFactory looking to close /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core2/core2 [CachedDir<<refCount=0;path=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core2/core2;done=false>>]
   [junit4]   2> 1016280 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.CachingDirectoryFactory Closing directory: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core2/core2
   [junit4]   2> 1016280 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.CachingDirectoryFactory looking to close /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core2/core2/index [CachedDir<<refCount=0;path=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core2/core2/index;done=false>>]
   [junit4]   2> 1016281 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.CachingDirectoryFactory Closing directory: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-002/core2/core2/index
   [junit4]   2> 1016281 INFO  (TEST-TestCoreDiscovery.testAlternateCoreDir-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.SolrTestCaseJ4 ###Ending testAlternateCoreDir
   [junit4]   2> 1016283 INFO  (TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.SolrTestCaseJ4 ###Starting testTooManyTransientCores
   [junit4]   2> 1016290 INFO  (TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/'
   [junit4]   2> 1016299 INFO  (TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/solr.xml
   [junit4]   2> 1016302 INFO  (TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.CoresLocator Config-defined core root directory: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003
   [junit4]   2> 1016302 INFO  (TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.CoreContainer New CoreContainer 386935396
   [junit4]   2> 1016302 INFO  (TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/]
   [junit4]   2> 1016302 INFO  (TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.CoreContainer loading shared library: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/lib
   [junit4]   2> 1016303 WARN  (TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/lib).
   [junit4]   2> 1016307 INFO  (TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 600000,connTimeout : 60000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1016308 INFO  (TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 1016308 INFO  (TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.CoreContainer Allocating transient cache for 2 transient cores
   [junit4]   2> 1016308 INFO  (TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1016308 INFO  (TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1016309 INFO  (TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1016309 INFO  (TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1016309 INFO  (TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.CoresLocator Looking for core definitions underneath /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003
   [junit4]   2> 1016310 INFO  (TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.SolrCore Created CoreDescriptor: {name=coreT5, config=solrconfig-minimal.xml, transient=true, schema=schema-tiny.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT5, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT5/, dataDir=coreT5}
   [junit4]   2> 1016310 INFO  (TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.CoresLocator Found core coreT5 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT5/
   [junit4]   2> 1016311 INFO  (TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.SolrCore Created CoreDescriptor: {name=coreT1, config=solrconfig-minimal.xml, transient=true, schema=schema-tiny.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT1, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT1/, dataDir=coreT1}
   [junit4]   2> 1016311 INFO  (TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.CoresLocator Found core coreT1 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT1/
   [junit4]   2> 1016311 INFO  (TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.SolrCore Created CoreDescriptor: {name=coreLOS, config=solrconfig-minimal.xml, transient=false, schema=schema-tiny.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreLOS, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreLOS/, dataDir=coreLOS}
   [junit4]   2> 1016311 INFO  (TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.CoresLocator Found core coreLOS in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreLOS/
   [junit4]   2> 1016312 INFO  (TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.SolrCore Created CoreDescriptor: {name=coreT4, config=solrconfig-minimal.xml, transient=true, schema=schema-tiny.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT4, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT4/, dataDir=coreT4}
   [junit4]   2> 1016312 INFO  (TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.CoresLocator Found core coreT4 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT4/
   [junit4]   2> 1016312 INFO  (TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.SolrCore Created CoreDescriptor: {name=coreT2, config=solrconfig-minimal.xml, transient=true, schema=schema-tiny.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT2, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT2/, dataDir=coreT2}
   [junit4]   2> 1016312 INFO  (TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.CoresLocator Found core coreT2 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT2/
   [junit4]   2> 1016313 INFO  (TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.SolrCore Created CoreDescriptor: {name=coreT6, config=solrconfig-minimal.xml, transient=true, schema=schema-tiny.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT6, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT6/, dataDir=coreT6}
   [junit4]   2> 1016313 INFO  (TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.CoresLocator Found core coreT6 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT6/
   [junit4]   2> 1016313 INFO  (TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.SolrCore Created CoreDescriptor: {name=coreT3, config=solrconfig-minimal.xml, transient=true, schema=schema-tiny.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT3, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT3/, dataDir=coreT3}
   [junit4]   2> 1016313 INFO  (TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.CoresLocator Found core coreT3 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT3/
   [junit4]   2> 1016313 INFO  (TEST-TestCoreDiscovery.testTooManyTransientCores-seed#[4758337A9E221C3B]) [    x:core2] o.a.s.c.CoresLocator Found 7 core definitions
   [junit4]   2> 1016314 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:core2] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT5/'
   [junit4]   2> 1016314 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:core2] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreLOS/'
   [junit4]   2> 1016314 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:core2] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT1/'
   [junit4]   2> 1016327 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:core2] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1016329 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:core2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1016334 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:core2] o.a.s.c.Config Loaded SolrConfig: solrconfig-minimal.xml
   [junit4]   2> 1016334 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:core2] o.a.s.s.IndexSchema Reading Solr Schema from /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT1/conf/schema-tiny.xml
   [junit4]   2> 1016336 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:core2] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1016336 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:core2] o.a.s.s.IndexSchema [coreT1] Schema name=tiny
   [junit4]   2> 1016337 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:core2] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1016338 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:core2] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1016339 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:core2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1016340 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:core2] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT1/conf'
   [junit4]   2> 1016340 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:core2] o.a.s.c.CoreContainer Creating SolrCore 'coreT1' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT1/
   [junit4]   2> 1016340 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1016340 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT1] o.a.s.c.SolrCore [[coreT1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT1/], dataDir=[null]
   [junit4]   2> 1016340 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT1] o.a.s.c.SolrCore JMX monitoring not detected for core: coreT1
   [junit4]   2> 1016340 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:core2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1016340 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT1] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT1/coreT1
   [junit4]   2> 1016341 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT1] o.a.s.c.SolrCore New index directory detected: old=null new=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT1/coreT1/index/
   [junit4]   2> 1016341 WARN  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT1] o.a.s.c.SolrCore [coreT1] Solr index directory '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT1/coreT1/index' doesn't exist. Creating new index...
   [junit4]   2> 1016341 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT1] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT1/coreT1/index
   [junit4]   2> 1016341 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=39, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6892659827952045]
   [junit4]   2> 1016342 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@4250656 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@d803294),segFN=segments_1,generation=1}
   [junit4]   2> 1016342 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1016343 INFO  (OldIndexDirectoryCleanupThreadForCore-coreT1) [    x:coreT1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core coreT1 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT1/coreT1/
   [junit4]   2> 1016343 WARN  (OldIndexDirectoryCleanupThreadForCore-coreT1) [    x:coreT1] o.a.s.c.DirectoryFactory /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT1/coreT1/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 1016357 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1016358 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:core2] o.a.s.c.Config Loaded SolrConfig: solrconfig-minimal.xml
   [junit4]   2> 1016359 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:core2] o.a.s.s.IndexSchema Reading Solr Schema from /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT5/conf/schema-tiny.xml
   [junit4]   2> 1016359 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1016359 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1016359 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:core2] o.a.s.c.Config Loaded SolrConfig: solrconfig-minimal.xml
   [junit4]   2> 1016360 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:core2] o.a.s.s.IndexSchema Reading Solr Schema from /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreLOS/conf/schema-tiny.xml
   [junit4]   2> 1016360 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1016360 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1016361 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:core2] o.a.s.s.IndexSchema [coreT5] Schema name=tiny
   [junit4]   2> 1016361 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,/update/csv,/update/json/docs,/admin/luke,/select,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 1016361 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:core2] o.a.s.s.IndexSchema [coreLOS] Schema name=tiny
   [junit4]   2> 1016362 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1016362 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT1] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 1016362 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT1] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 1016362 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=16, maxMergeAtOnceExplicit=29, maxMergedSegmentMB=39.5341796875, floorSegmentMB=1.3779296875, forceMergeDeletesPctAllowed=28.433216539551545, segmentsPerTier=46.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 1016362 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@4250656 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@d803294),segFN=segments_1,generation=1}
   [junit4]   2> 1016362 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1016362 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT1] o.a.s.s.SolrIndexSearcher Opening Searcher@51cacaae[coreT1] main
   [junit4]   2> 1016363 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT1/conf
   [junit4]   2> 1016363 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT1/conf}
   [junit4]   2> 1016363 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT1/conf
   [junit4]   2> 1016363 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 1016363 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:core2] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1016363 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1016363 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT1] o.a.s.c.CoreContainer Opening transient core coreT1
   [junit4]   2> 1016364 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:core2] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1016364 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT1] o.a.s.c.CoreContainer registering core: coreT1
   [junit4]   2> 1016363 INFO  (searcherExecutor-3834-thread-1-processing-x:coreT1) [    x:coreT1] o.a.s.c.SolrCore [coreT1] Registered new searcher Searcher@51cacaae[coreT1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1016364 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:core2] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT4/'
   [junit4]   2> 1016364 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:core2] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT5/conf'
   [junit4]   2> 1016364 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:core2] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreLOS/conf'
   [junit4]   2> 1016364 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:core2] o.a.s.c.CoreContainer Creating SolrCore 'coreT5' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT5/
   [junit4]   2> 1016364 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:core2] o.a.s.c.CoreContainer Creating SolrCore 'coreLOS' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreLOS/
   [junit4]   2> 1016365 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:coreT5] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1016365 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:coreLOS] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1016365 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:coreT5] o.a.s.c.SolrCore [[coreT5] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT5/], dataDir=[null]
   [junit4]   2> 1016365 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:coreLOS] o.a.s.c.SolrCore [[coreLOS] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreLOS/], dataDir=[null]
   [junit4]   2> 1016365 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:coreLOS] o.a.s.c.SolrCore JMX monitoring not detected for core: coreLOS
   [junit4]   2> 1016365 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:coreT5] o.a.s.c.SolrCore JMX monitoring not detected for core: coreT5
   [junit4]   2> 1016366 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:coreLOS] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreLOS/coreLOS
   [junit4]   2> 1016366 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:coreT5] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT5/coreT5
   [junit4]   2> 1016366 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:coreLOS] o.a.s.c.SolrCore New index directory detected: old=null new=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreLOS/coreLOS/index/
   [junit4]   2> 1016367 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:coreT5] o.a.s.c.SolrCore New index directory detected: old=null new=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT5/coreT5/index/
   [junit4]   2> 1016367 WARN  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:coreLOS] o.a.s.c.SolrCore [coreLOS] Solr index directory '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreLOS/coreLOS/index' doesn't exist. Creating new index...
   [junit4]   2> 1016367 WARN  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:coreT5] o.a.s.c.SolrCore [coreT5] Solr index directory '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT5/coreT5/index' doesn't exist. Creating new index...
   [junit4]   2> 1016367 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:coreLOS] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreLOS/coreLOS/index
   [junit4]   2> 1016367 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:coreT5] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT5/coreT5/index
   [junit4]   2> 1016367 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:coreLOS] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=39, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6892659827952045]
   [junit4]   2> 1016367 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:coreT5] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=39, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6892659827952045]
   [junit4]   2> 1016368 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:coreLOS] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@1e1512d1 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1a595ea8),segFN=segments_1,generation=1}
   [junit4]   2> 1016368 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:coreLOS] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1016368 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:coreT5] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@1643447d lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@134c1740),segFN=segments_1,generation=1}
   [junit4]   2> 1016368 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:coreT5] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1016368 INFO  (OldIndexDirectoryCleanupThreadForCore-coreT5) [    x:coreT5] o.a.s.c.SolrCore Looking for old index directories to cleanup for core coreT5 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT5/coreT5/
   [junit4]   2> 1016369 WARN  (OldIndexDirectoryCleanupThreadForCore-coreT5) [    x:coreT5] o.a.s.c.DirectoryFactory /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT5/coreT5/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 1016369 INFO  (OldIndexDirectoryCleanupThreadForCore-coreLOS) [    x:coreLOS] o.a.s.c.SolrCore Looking for old index directories to cleanup for core coreLOS in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreLOS/coreLOS/
   [junit4]   2> 1016370 WARN  (OldIndexDirectoryCleanupThreadForCore-coreLOS) [    x:coreLOS] o.a.s.c.DirectoryFactory /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreLOS/coreLOS/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 1016370 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:coreT5] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1016370 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:coreLOS] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1016371 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:coreLOS] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1016371 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:coreT5] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1016372 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:coreLOS] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1016372 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:coreT5] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1016372 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:coreLOS] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1016372 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:coreT5] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1016373 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:coreLOS] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1016373 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:coreT5] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1016374 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:coreLOS] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,/update/csv,/update/json/docs,/admin/luke,/select,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 1016374 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:coreT5] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,/update/csv,/update/json/docs,/admin/luke,/select,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 1016374 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:coreLOS] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1016375 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:coreT5] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1016375 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:coreLOS] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 1016375 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:core2] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1016375 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:coreT5] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 1016375 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:coreLOS] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 1016375 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:coreT5] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 1016375 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:coreLOS] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=16, maxMergeAtOnceExplicit=29, maxMergedSegmentMB=39.5341796875, floorSegmentMB=1.3779296875, forceMergeDeletesPctAllowed=28.433216539551545, segmentsPerTier=46.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 1016375 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:coreT5] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=16, maxMergeAtOnceExplicit=29, maxMergedSegmentMB=39.5341796875, floorSegmentMB=1.3779296875, forceMergeDeletesPctAllowed=28.433216539551545, segmentsPerTier=46.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 1016375 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:coreLOS] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@1e1512d1 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1a595ea8),segFN=segments_1,generation=1}
   [junit4]   2> 1016376 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:coreT5] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@1643447d lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@134c1740),segFN=segments_1,generation=1}
   [junit4]   2> 1016376 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:coreT5] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1016376 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:coreLOS] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1016376 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:coreT5] o.a.s.s.SolrIndexSearcher Opening Searcher@4fc27d7b[coreT5] main
   [junit4]   2> 1016376 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:coreLOS] o.a.s.s.SolrIndexSearcher Opening Searcher@4ff71ee6[coreLOS] main
   [junit4]   2> 1016376 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:coreT5] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT5/conf
   [junit4]   2> 1016376 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:coreLOS] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreLOS/conf
   [junit4]   2> 1016376 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:coreLOS] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreLOS/conf}
   [junit4]   2> 1016376 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:coreT5] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT5/conf}
   [junit4]   2> 1016377 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:coreLOS] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreLOS/conf
   [junit4]   2> 1016377 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:core2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1016377 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:coreT5] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT5/conf
   [junit4]   2> 1016377 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:coreLOS] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 1016377 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:coreLOS] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1016377 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:coreT5] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 1016378 INFO  (searcherExecutor-3839-thread-1-processing-x:coreLOS) [    x:coreLOS] o.a.s.c.SolrCore [coreLOS] Registered new searcher Searcher@4ff71ee6[coreLOS] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1016378 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:coreT5] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1016378 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:coreLOS] o.a.s.c.CoreContainer registering core: coreLOS
   [junit4]   2> 1016378 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:coreT5] o.a.s.c.CoreContainer Opening transient core coreT5
   [junit4]   2> 1016378 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:core2] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT2/'
   [junit4]   2> 1016378 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:coreT5] o.a.s.c.CoreContainer registering core: coreT5
   [junit4]   2> 1016378 INFO  (searcherExecutor-3838-thread-1-processing-x:coreT5) [    x:coreT5] o.a.s.c.SolrCore [coreT5] Registered new searcher Searcher@4fc27d7b[coreT5] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1016379 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:core2] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT6/'
   [junit4]   2> 1016382 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:core2] o.a.s.c.Config Loaded SolrConfig: solrconfig-minimal.xml
   [junit4]   2> 1016382 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:core2] o.a.s.s.IndexSchema Reading Solr Schema from /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT4/conf/schema-tiny.xml
   [junit4]   2> 1016384 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:core2] o.a.s.s.IndexSchema [coreT4] Schema name=tiny
   [junit4]   2> 1016386 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:core2] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1016386 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:core2] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT4/conf'
   [junit4]   2> 1016387 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:core2] o.a.s.c.CoreContainer Creating SolrCore 'coreT4' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT4/
   [junit4]   2> 1016387 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT4] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1016387 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT4] o.a.s.c.SolrCore [[coreT4] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT4/], dataDir=[null]
   [junit4]   2> 1016387 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT4] o.a.s.c.SolrCore JMX monitoring not detected for core: coreT4
   [junit4]   2> 1016387 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT4] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT4/coreT4
   [junit4]   2> 1016387 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT4] o.a.s.c.SolrCore New index directory detected: old=null new=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT4/coreT4/index/
   [junit4]   2> 1016387 WARN  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT4] o.a.s.c.SolrCore [coreT4] Solr index directory '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT4/coreT4/index' doesn't exist. Creating new index...
   [junit4]   2> 1016388 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT4] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT4/coreT4/index
   [junit4]   2> 1016388 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT4] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=30, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 1016388 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT4] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@8d3a889 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7b458af3),segFN=segments_1,generation=1}
   [junit4]   2> 1016388 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT4] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1016391 INFO  (OldIndexDirectoryCleanupThreadForCore-coreT4) [    x:coreT4] o.a.s.c.SolrCore Looking for old index directories to cleanup for core coreT4 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT4/coreT4/
   [junit4]   2> 1016392 WARN  (OldIndexDirectoryCleanupThreadForCore-coreT4) [    x:coreT4] o.a.s.c.DirectoryFactory /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestCoreDiscovery_4758337A9E221C3B-001/tempDir-003/coreT4/coreT4/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 1016393 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:core2] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1016393 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT4] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1016394 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT4] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1016394 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT4] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1016395 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT4] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1016395 INFO  (coreLoadExecutor-3833-thread-3-processing-x:core2) [    x:core2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1016396 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT4] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1016396 INFO  (coreLoadExecutor-3833-thread-1-processing-x:core2) [    x:core2] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1016396 INFO  (coreLoadExecutor-3833-thread-2-processing-x:core2) [    x:coreT4] o.a.s.c.RequestHandlers Registered paths: /admin/mb

[...truncated too long message...]

 INFO  (SUITE-TestCoreDiscovery-seed#[4758337A9E221C3B]-worker) [    x:core3] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 1138693 ERROR (SUITE-TestCoreDiscovery-seed#[4758337A9E221C3B]-worker) [    x:core3] o.a.s.SolrTestCaseJ4 ERROR: SolrIndexSearcher opens=27 closes=26
   [junit4]   2> Aug 23, 2015 12:15:56 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> Aug 23, 2015 12:16:16 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.core.TestCoreDiscovery: 
   [junit4]   2>    1) Thread[id=7719, name=searcherExecutor-3874-thread-1, state=WAITING, group=TGRP-TestCoreDiscovery]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:746)
   [junit4]   2> Aug 23, 2015 12:16:16 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=7719, name=searcherExecutor-3874-thread-1, state=WAITING, group=TGRP-TestCoreDiscovery]
   [junit4]   2> Aug 23, 2015 12:16:19 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> SEVERE: There are still zombie threads that couldn't be terminated:
   [junit4]   2>    1) Thread[id=7719, name=searcherExecutor-3874-thread-1, state=WAITING, group=TGRP-TestCoreDiscovery]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:746)
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene53): {}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=yo_NG, timezone=America/Rainy_River
   [junit4]   2> NOTE: Linux 3.19.0-26-generic amd64/Oracle Corporation 1.9.0-ea (64-bit)/cpus=12,threads=2,free=327301968,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [TestReloadDeadlock, RankQueryTest, RegexBoostProcessorTest, TestIntervalFaceting, TestRecovery, TestRestoreCore, SolrIndexSplitterTest, SolrXmlInZkTest, AnalyticsQueryTest, TestSurroundQueryParser, DistributedExpandComponentTest, TestNRTOpen, AliasIntegrationTest, TestBlendedInfixSuggestions, SoftAutoCommitTest, PluginInfoTest, TestSolrCloudWithKerberosAlt, TestDocBasedVersionConstraints, DataDrivenBlockJoinTest, TestLeaderElectionZkExpiry, QueryParsingTest, CdcrReplicationHandlerTest, UUIDUpdateProcessorFallbackTest, CdcrRequestHandlerTest, TestDefaultSimilarityFactory, RecoveryZkTest, CollectionsAPIAsyncDistributedZkTest, SolrCoreCheckLockOnStartupTest, DocValuesTest, SimpleFacetsTest, PathHierarchyTokenizerFactoryTest, MoreLikeThisHandlerTest, TestJsonRequest, BadIndexSchemaTest, SolrTestCaseJ4Test, TestQueryTypes, TestFieldCollectionResource, SegmentsInfoRequestHandlerTest, TestDistributedMissingSort, HdfsThreadLeakTest, HdfsBasicDistributedZk2Test, TestCloudInspectUtil, TestExpandComponent, LeaderElectionTest, TestPivotHelperCode, CustomCollectionTest, MultiThreadedOCPTest, TestFastOutputStream, TermVectorComponentDistributedTest, SmileWriterTest, OutputWriterTest, TestFreeTextSuggestions, TestSolrJ, BufferStoreTest, TestZkChroot, ReplicationFactorTest, AsyncCallRequestStatusResponseTest, TestSolrXml, BlockDirectoryTest, ConcurrentDeleteAndCreateCollectionTest, TestImplicitCoreProperties, TestSolrConfigHandlerConcurrent, TestDefaultStatsCache, AsyncMigrateRouteKeyTest, TestManagedSchema, TestSolrQueryParser, ResponseLogComponentTest, TestLuceneMatchVersion, TestXIncludeConfig, DirectUpdateHandlerOptimizeTest, TestRestManager, RemoteQueryErrorTest, TestDocSet, TestUtils, DistributedQueryElevationComponentTest, AssignTest, XmlUpdateRequestHandlerTest, TestSolrDynamicMBean, TestGroupingSearch, SuggesterTest, TestSystemIdResolver, DistanceUnitsTest, SolrInfoMBeanTest, TestStandardQParsers, BitVectorTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, CollectionsAPIDistributedZkTest, BasicZkTest, FullSolrCloudDistribCmdsTest, TestJoin, TestCoreContainer, TestSolr4Spatial, SpellCheckComponentTest, PeerSyncTest, TestSort, TestBadConfig, OverseerCollectionProcessorTest, HighlighterTest, CurrencyFieldOpenExchangeTest, SimplePostToolTest, TestCoreDiscovery]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestCoreDiscovery -Dtests.seed=4758337A9E221C3B -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=yo_NG -Dtests.timezone=America/Rainy_River -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J2 | TestCoreDiscovery (suite) <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: ERROR: SolrIndexSearcher opens=27 closes=26
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([4758337A9E221C3B]:0)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:467)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:233)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:746)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.core.TestCoreDiscovery: 
   [junit4]    >    1) Thread[id=7719, name=searcherExecutor-3874-thread-1, state=WAITING, group=TGRP-TestCoreDiscovery]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:746)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([4758337A9E221C3B]:0)Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=7719, name=searcherExecutor-3874-thread-1, state=WAITING, group=TGRP-TestCoreDiscovery]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:746)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([4758337A9E221C3B]:0)
   [junit4] Completed [411/541] on J2 in 145.71s, 12 tests, 1 failure, 2 errors <<< FAILURES!

[...truncated 403 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:775: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:719: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:59: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:233: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:514: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1432: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:987: There were test failures: 541 suites, 2133 tests, 3 suite-level errors, 407 ignored (28 assumptions)

Total time: 40 minutes 28 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any