You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2015/07/15 06:26:12 UTC

[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0_45) - Build # 13465 - Failure!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/13465/
Java: 64bit/jdk1.8.0_45 -XX:+UseCompressedOops -XX:+UseG1GC

3 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.core.TestLazyCores

Error Message:
ERROR: SolrIndexSearcher opens=51 closes=50

Stack Trace:
java.lang.AssertionError: ERROR: SolrIndexSearcher opens=51 closes=50
	at __randomizedtesting.SeedInfo.seed([680F5D1EE70417EF]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:465)
	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:232)
	at sun.reflect.GeneratedMethodAccessor32.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:799)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.core.TestLazyCores

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.core.TestLazyCores:     1) Thread[id=8235, name=searcherExecutor-3585-thread-1, state=WAITING, group=TGRP-TestLazyCores]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.core.TestLazyCores: 
   1) Thread[id=8235, name=searcherExecutor-3585-thread-1, state=WAITING, group=TGRP-TestLazyCores]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
	at __randomizedtesting.SeedInfo.seed([680F5D1EE70417EF]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.core.TestLazyCores

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=8235, name=searcherExecutor-3585-thread-1, state=WAITING, group=TGRP-TestLazyCores]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=8235, name=searcherExecutor-3585-thread-1, state=WAITING, group=TGRP-TestLazyCores]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
	at __randomizedtesting.SeedInfo.seed([680F5D1EE70417EF]:0)




Build Log:
[...truncated 10847 lines...]
   [junit4] Suite: org.apache.solr.core.TestLazyCores
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/init-core-data-001
   [junit4]   2> 986798 INFO  (SUITE-TestLazyCores-seed#[680F5D1EE70417EF]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true)
   [junit4]   2> 986799 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testRace
   [junit4]   2> 986808 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/'
   [junit4]   2> 986817 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    ] o.a.s.c.CoreContainer New CoreContainer 1345426425
   [junit4]   2> 986817 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/]
   [junit4]   2> 986817 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    ] o.a.s.c.CoreContainer loading shared library: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/lib
   [junit4]   2> 986817 WARN  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/lib).
   [junit4]   2> 986821 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 600000,connTimeout : 60000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 986822 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 986822 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    ] o.a.s.c.CoreContainer Allocating transient cache for 4 transient cores
   [junit4]   2> 986824 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 986824 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 986824 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 986825 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=collection1, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection1/, dataDir=data/}
   [junit4]   2> 986825 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collectionLazy2, config=solrconfig.xml, transient=true, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=collection2, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection2/, dataDir=data/}
   [junit4]   2> 986825 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collectionLazy3, config=solrconfig.xml, transient=on, schema=schema.xml, loadOnStartup=false, configSetProperties=configsetprops.json, instanceDir=collection3, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection3/, dataDir=data/}
   [junit4]   2> 986825 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collectionLazy4, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=false, configSetProperties=configsetprops.json, instanceDir=collection4, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection4/, dataDir=data/}
   [junit4]   2> 986826 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collectionLazy5, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=collection5, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection5/, dataDir=data/}
   [junit4]   2> 986826 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collectionLazy6, config=solrconfig.xml, transient=true, schema=schema.xml, loadOnStartup=false, configSetProperties=configsetprops.json, instanceDir=collection6, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection6/, dataDir=data/}
   [junit4]   2> 986826 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collectionLazy7, config=solrconfig.xml, transient=true, schema=schema.xml, loadOnStartup=false, configSetProperties=configsetprops.json, instanceDir=collection7, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection7/, dataDir=data/}
   [junit4]   2> 986826 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collectionLazy8, config=solrconfig.xml, transient=true, schema=schema.xml, loadOnStartup=false, configSetProperties=configsetprops.json, instanceDir=collection8, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection8/, dataDir=data/}
   [junit4]   2> 986826 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collectionLazy9, config=solrconfig.xml, transient=true, schema=schema.xml, loadOnStartup=false, configSetProperties=configsetprops.json, instanceDir=collection9, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection9/, dataDir=data/}
   [junit4]   2> 986827 INFO  (coreLoadExecutor-3558-thread-2) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection2/'
   [junit4]   2> 986827 INFO  (coreLoadExecutor-3558-thread-3) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection5/'
   [junit4]   2> 986827 INFO  (coreLoadExecutor-3558-thread-1) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection1/'
   [junit4]   2> 986837 INFO  (coreLoadExecutor-3558-thread-2) [    ] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 986838 INFO  (coreLoadExecutor-3558-thread-2) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 986842 INFO  (coreLoadExecutor-3558-thread-2) [    ] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 986842 INFO  (coreLoadExecutor-3558-thread-3) [    ] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 986842 INFO  (coreLoadExecutor-3558-thread-2) [    ] o.a.s.s.IndexSchema Reading Solr Schema from /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection2/conf/schema.xml
   [junit4]   2> 986843 INFO  (coreLoadExecutor-3558-thread-2) [    ] o.a.s.s.IndexSchema [collectionLazy2] Schema name=tiny
   [junit4]   2> 986844 INFO  (coreLoadExecutor-3558-thread-1) [    ] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 986844 INFO  (coreLoadExecutor-3558-thread-3) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 986846 INFO  (coreLoadExecutor-3558-thread-2) [    ] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 986846 INFO  (coreLoadExecutor-3558-thread-1) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 986846 INFO  (coreLoadExecutor-3558-thread-2) [    ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties
   [junit4]   2> org.apache.solr.core.SolrResourceNotFoundException: Can't find resource 'configsetprops.json' in classpath or '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection2/conf'
   [junit4]   2> 	at org.apache.solr.core.SolrResourceLoader.openResource(SolrResourceLoader.java:363)
   [junit4]   2> 	at org.apache.solr.core.ConfigSetProperties.readFromResourceLoader(ConfigSetProperties.java:49)
   [junit4]   2> 	at org.apache.solr.core.ConfigSetService.createConfigSetProperties(ConfigSetService.java:114)
   [junit4]   2> 	at org.apache.solr.core.ConfigSetService.getConfig(ConfigSetService.java:76)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:668)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:397)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:388)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 986847 INFO  (coreLoadExecutor-3558-thread-2) [    ] o.a.s.c.CoreContainer Creating SolrCore 'collectionLazy2' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection2/
   [junit4]   2> 986847 INFO  (coreLoadExecutor-3558-thread-2) [    x:collectionLazy2] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 986847 INFO  (coreLoadExecutor-3558-thread-2) [    x:collectionLazy2] o.a.s.c.SolrCore [[collectionLazy2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection2/], dataDir=[null]
   [junit4]   2> 986847 INFO  (coreLoadExecutor-3558-thread-2) [    x:collectionLazy2] o.a.s.c.SolrCore JMX monitoring not detected for core: collectionLazy2
   [junit4]   2> 986848 INFO  (coreLoadExecutor-3558-thread-2) [    x:collectionLazy2] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection2/data
   [junit4]   2> 986848 INFO  (coreLoadExecutor-3558-thread-2) [    x:collectionLazy2] o.a.s.c.SolrCore New index directory detected: old=null new=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection2/data/index/
   [junit4]   2> 986848 WARN  (coreLoadExecutor-3558-thread-2) [    x:collectionLazy2] o.a.s.c.SolrCore [collectionLazy2] Solr index directory '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection2/data/index' doesn't exist. Creating new index...
   [junit4]   2> 986848 INFO  (coreLoadExecutor-3558-thread-2) [    x:collectionLazy2] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection2/data/index
   [junit4]   2> 986849 INFO  (coreLoadExecutor-3558-thread-2) [    x:collectionLazy2] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=50, maxMergeAtOnceExplicit=39, maxMergedSegmentMB=88.3974609375, floorSegmentMB=0.869140625, forceMergeDeletesPctAllowed=1.4509780801683203, segmentsPerTier=26.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 986849 INFO  (coreLoadExecutor-3558-thread-3) [    ] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 986849 INFO  (coreLoadExecutor-3558-thread-3) [    ] o.a.s.s.IndexSchema Reading Solr Schema from /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection5/conf/schema.xml
   [junit4]   2> 986849 INFO  (coreLoadExecutor-3558-thread-2) [    x:collectionLazy2] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@1f9a9afe lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@12b910e9),segFN=segments_1,generation=1}
   [junit4]   2> 986849 INFO  (coreLoadExecutor-3558-thread-2) [    x:collectionLazy2] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 986850 INFO  (OldIndexDirectoryCleanupThreadForCore-collectionLazy2) [    x:collectionLazy2] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collectionLazy2 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection2/data/
   [junit4]   2> 986850 WARN  (OldIndexDirectoryCleanupThreadForCore-collectionLazy2) [    x:collectionLazy2] o.a.s.c.DirectoryFactory /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection2/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 986850 INFO  (coreLoadExecutor-3558-thread-1) [    ] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 986850 INFO  (coreLoadExecutor-3558-thread-1) [    ] o.a.s.s.IndexSchema Reading Solr Schema from /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection1/conf/schema.xml
   [junit4]   2> 986851 INFO  (coreLoadExecutor-3558-thread-2) [    x:collectionLazy2] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 986851 INFO  (coreLoadExecutor-3558-thread-3) [    ] o.a.s.s.IndexSchema [collectionLazy5] Schema name=tiny
   [junit4]   2> 986853 INFO  (coreLoadExecutor-3558-thread-2) [    x:collectionLazy2] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 986854 INFO  (coreLoadExecutor-3558-thread-3) [    ] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 986854 INFO  (coreLoadExecutor-3558-thread-2) [    x:collectionLazy2] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 986854 INFO  (coreLoadExecutor-3558-thread-3) [    ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties
   [junit4]   2> org.apache.solr.core.SolrResourceNotFoundException: Can't find resource 'configsetprops.json' in classpath or '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection5/conf'
   [junit4]   2> 	at org.apache.solr.core.SolrResourceLoader.openResource(SolrResourceLoader.java:363)
   [junit4]   2> 	at org.apache.solr.core.ConfigSetProperties.readFromResourceLoader(ConfigSetProperties.java:49)
   [junit4]   2> 	at org.apache.solr.core.ConfigSetService.createConfigSetProperties(ConfigSetService.java:114)
   [junit4]   2> 	at org.apache.solr.core.ConfigSetService.getConfig(ConfigSetService.java:76)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:668)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:397)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:388)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 986855 INFO  (coreLoadExecutor-3558-thread-3) [    ] o.a.s.c.CoreContainer Creating SolrCore 'collectionLazy5' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection5/
   [junit4]   2> 986855 INFO  (coreLoadExecutor-3558-thread-3) [    x:collectionLazy5] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 986855 INFO  (coreLoadExecutor-3558-thread-3) [    x:collectionLazy5] o.a.s.c.SolrCore [[collectionLazy5] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection5/], dataDir=[null]
   [junit4]   2> 986855 INFO  (coreLoadExecutor-3558-thread-3) [    x:collectionLazy5] o.a.s.c.SolrCore JMX monitoring not detected for core: collectionLazy5
   [junit4]   2> 986855 INFO  (coreLoadExecutor-3558-thread-2) [    x:collectionLazy2] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 986856 INFO  (coreLoadExecutor-3558-thread-3) [    x:collectionLazy5] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection5/data
   [junit4]   2> 986856 INFO  (coreLoadExecutor-3558-thread-3) [    x:collectionLazy5] o.a.s.c.SolrCore New index directory detected: old=null new=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection5/data/index/
   [junit4]   2> 986856 WARN  (coreLoadExecutor-3558-thread-3) [    x:collectionLazy5] o.a.s.c.SolrCore [collectionLazy5] Solr index directory '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection5/data/index' doesn't exist. Creating new index...
   [junit4]   2> 986856 INFO  (coreLoadExecutor-3558-thread-2) [    x:collectionLazy2] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 986856 INFO  (coreLoadExecutor-3558-thread-3) [    x:collectionLazy5] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection5/data/index
   [junit4]   2> 986857 INFO  (coreLoadExecutor-3558-thread-3) [    x:collectionLazy5] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=50, maxMergeAtOnceExplicit=39, maxMergedSegmentMB=88.3974609375, floorSegmentMB=0.869140625, forceMergeDeletesPctAllowed=1.4509780801683203, segmentsPerTier=26.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 986857 INFO  (coreLoadExecutor-3558-thread-3) [    x:collectionLazy5] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@3a37cfb6 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@69786f62),segFN=segments_1,generation=1}
   [junit4]   2> 986857 INFO  (coreLoadExecutor-3558-thread-3) [    x:collectionLazy5] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 986857 INFO  (coreLoadExecutor-3558-thread-2) [    x:collectionLazy2] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,/update/csv,/update/json/docs,/admin/luke,/select,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 986857 INFO  (OldIndexDirectoryCleanupThreadForCore-collectionLazy5) [    x:collectionLazy5] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collectionLazy5 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection5/data/
   [junit4]   2> 986858 INFO  (coreLoadExecutor-3558-thread-2) [    x:collectionLazy2] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 986858 WARN  (OldIndexDirectoryCleanupThreadForCore-collectionLazy5) [    x:collectionLazy5] o.a.s.c.DirectoryFactory /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection5/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 986858 INFO  (coreLoadExecutor-3558-thread-2) [    x:collectionLazy2] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 986858 INFO  (coreLoadExecutor-3558-thread-2) [    x:collectionLazy2] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 986858 INFO  (coreLoadExecutor-3558-thread-2) [    x:collectionLazy2] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=15, maxMergeAtOnceExplicit=48, maxMergedSegmentMB=15.80078125, floorSegmentMB=0.88671875, forceMergeDeletesPctAllowed=19.80783794429808, segmentsPerTier=27.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 986859 INFO  (coreLoadExecutor-3558-thread-2) [    x:collectionLazy2] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@1f9a9afe lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@12b910e9),segFN=segments_1,generation=1}
   [junit4]   2> 986859 INFO  (coreLoadExecutor-3558-thread-2) [    x:collectionLazy2] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 986859 INFO  (coreLoadExecutor-3558-thread-3) [    x:collectionLazy5] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 986859 INFO  (coreLoadExecutor-3558-thread-2) [    x:collectionLazy2] o.a.s.s.SolrIndexSearcher Opening Searcher@282834c9[collectionLazy2] main
   [junit4]   2> 986859 INFO  (coreLoadExecutor-3558-thread-2) [    x:collectionLazy2] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection2/conf
   [junit4]   2> 986860 INFO  (coreLoadExecutor-3558-thread-2) [    x:collectionLazy2] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection2/conf}
   [junit4]   2> 986860 INFO  (coreLoadExecutor-3558-thread-2) [    x:collectionLazy2] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection2/conf
   [junit4]   2> 986861 INFO  (coreLoadExecutor-3558-thread-2) [    x:collectionLazy2] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 986861 INFO  (coreLoadExecutor-3558-thread-3) [    x:collectionLazy5] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 986861 INFO  (coreLoadExecutor-3558-thread-3) [    x:collectionLazy5] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 986862 INFO  (coreLoadExecutor-3558-thread-3) [    x:collectionLazy5] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 986863 INFO  (coreLoadExecutor-3558-thread-3) [    x:collectionLazy5] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 986861 INFO  (coreLoadExecutor-3558-thread-2) [    x:collectionLazy2] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 986864 INFO  (coreLoadExecutor-3558-thread-2) [    x:collectionLazy2] o.a.s.c.CoreContainer Opening transient core collectionLazy2
   [junit4]   2> 986864 INFO  (searcherExecutor-3559-thread-1-processing-x:collectionLazy2) [    x:collectionLazy2] o.a.s.c.SolrCore [collectionLazy2] Registered new searcher Searcher@282834c9[collectionLazy2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 986864 INFO  (coreLoadExecutor-3558-thread-3) [    x:collectionLazy5] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,/update/csv,/update/json/docs,/admin/luke,/select,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 986864 INFO  (coreLoadExecutor-3558-thread-2) [    x:collectionLazy2] o.a.s.c.CoreContainer registering core: collectionLazy2
   [junit4]   2> 986865 INFO  (coreLoadExecutor-3558-thread-3) [    x:collectionLazy5] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 986865 INFO  (coreLoadExecutor-3558-thread-3) [    x:collectionLazy5] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 986865 INFO  (coreLoadExecutor-3558-thread-3) [    x:collectionLazy5] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 986865 INFO  (coreLoadExecutor-3558-thread-3) [    x:collectionLazy5] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=15, maxMergeAtOnceExplicit=48, maxMergedSegmentMB=15.80078125, floorSegmentMB=0.88671875, forceMergeDeletesPctAllowed=19.80783794429808, segmentsPerTier=27.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 986866 INFO  (coreLoadExecutor-3558-thread-3) [    x:collectionLazy5] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@3a37cfb6 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@69786f62),segFN=segments_1,generation=1}
   [junit4]   2> 986866 INFO  (coreLoadExecutor-3558-thread-3) [    x:collectionLazy5] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 986866 INFO  (coreLoadExecutor-3558-thread-3) [    x:collectionLazy5] o.a.s.s.SolrIndexSearcher Opening Searcher@3eecba03[collectionLazy5] main
   [junit4]   2> 986866 INFO  (coreLoadExecutor-3558-thread-1) [    ] o.a.s.s.IndexSchema [collection1] Schema name=tiny
   [junit4]   2> 986866 INFO  (coreLoadExecutor-3558-thread-3) [    x:collectionLazy5] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection5/conf
   [junit4]   2> 986866 INFO  (coreLoadExecutor-3558-thread-3) [    x:collectionLazy5] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection5/conf}
   [junit4]   2> 986866 INFO  (coreLoadExecutor-3558-thread-3) [    x:collectionLazy5] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection5/conf
   [junit4]   2> 986867 INFO  (coreLoadExecutor-3558-thread-3) [    x:collectionLazy5] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 986867 INFO  (coreLoadExecutor-3558-thread-3) [    x:collectionLazy5] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 986867 INFO  (searcherExecutor-3560-thread-1-processing-x:collectionLazy5) [    x:collectionLazy5] o.a.s.c.SolrCore [collectionLazy5] Registered new searcher Searcher@3eecba03[collectionLazy5] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 986867 INFO  (coreLoadExecutor-3558-thread-3) [    x:collectionLazy5] o.a.s.c.CoreContainer registering core: collectionLazy5
   [junit4]   2> 986869 INFO  (coreLoadExecutor-3558-thread-1) [    ] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 986870 INFO  (coreLoadExecutor-3558-thread-1) [    ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties
   [junit4]   2> org.apache.solr.core.SolrResourceNotFoundException: Can't find resource 'configsetprops.json' in classpath or '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection1/conf'
   [junit4]   2> 	at org.apache.solr.core.SolrResourceLoader.openResource(SolrResourceLoader.java:363)
   [junit4]   2> 	at org.apache.solr.core.ConfigSetProperties.readFromResourceLoader(ConfigSetProperties.java:49)
   [junit4]   2> 	at org.apache.solr.core.ConfigSetService.createConfigSetProperties(ConfigSetService.java:114)
   [junit4]   2> 	at org.apache.solr.core.ConfigSetService.getConfig(ConfigSetService.java:76)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:668)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:397)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:388)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 986870 INFO  (coreLoadExecutor-3558-thread-1) [    ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection1/
   [junit4]   2> 986870 INFO  (coreLoadExecutor-3558-thread-1) [    x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 986871 INFO  (coreLoadExecutor-3558-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection1/], dataDir=[null]
   [junit4]   2> 986871 INFO  (coreLoadExecutor-3558-thread-1) [    x:collection1] o.a.s.c.SolrCore JMX monitoring not detected for core: collection1
   [junit4]   2> 986871 INFO  (coreLoadExecutor-3558-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection1/data
   [junit4]   2> 986871 INFO  (coreLoadExecutor-3558-thread-1) [    x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection1/data/index/
   [junit4]   2> 986872 WARN  (coreLoadExecutor-3558-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 986872 INFO  (coreLoadExecutor-3558-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection1/data/index
   [junit4]   2> 986873 INFO  (coreLoadExecutor-3558-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=50, maxMergeAtOnceExplicit=39, maxMergedSegmentMB=88.3974609375, floorSegmentMB=0.869140625, forceMergeDeletesPctAllowed=1.4509780801683203, segmentsPerTier=26.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 986873 INFO  (coreLoadExecutor-3558-thread-1) [    x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@b9b49db lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4064884),segFN=segments_1,generation=1}
   [junit4]   2> 986873 INFO  (coreLoadExecutor-3558-thread-1) [    x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 986874 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [    x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection1/data/
   [junit4]   2> 986874 WARN  (OldIndexDirectoryCleanupThreadForCore-collection1) [    x:collection1] o.a.s.c.DirectoryFactory /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 986875 INFO  (coreLoadExecutor-3558-thread-1) [    x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 986876 INFO  (coreLoadExecutor-3558-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 986877 INFO  (coreLoadExecutor-3558-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 986878 INFO  (coreLoadExecutor-3558-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 986879 INFO  (coreLoadExecutor-3558-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 986879 INFO  (coreLoadExecutor-3558-thread-1) [    x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,/update/csv,/update/json/docs,/admin/luke,/select,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 986880 INFO  (coreLoadExecutor-3558-thread-1) [    x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 986880 INFO  (coreLoadExecutor-3558-thread-1) [    x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 986881 INFO  (coreLoadExecutor-3558-thread-1) [    x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 986881 INFO  (coreLoadExecutor-3558-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=15, maxMergeAtOnceExplicit=48, maxMergedSegmentMB=15.80078125, floorSegmentMB=0.88671875, forceMergeDeletesPctAllowed=19.80783794429808, segmentsPerTier=27.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 986881 INFO  (coreLoadExecutor-3558-thread-1) [    x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@b9b49db lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4064884),segFN=segments_1,generation=1}
   [junit4]   2> 986881 INFO  (coreLoadExecutor-3558-thread-1) [    x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 986881 INFO  (coreLoadExecutor-3558-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@1f9b81ee[collection1] main
   [junit4]   2> 986882 INFO  (coreLoadExecutor-3558-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection1/conf
   [junit4]   2> 986882 INFO  (coreLoadExecutor-3558-thread-1) [    x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection1/conf}
   [junit4]   2> 986882 INFO  (coreLoadExecutor-3558-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection1/conf
   [junit4]   2> 986882 INFO  (coreLoadExecutor-3558-thread-1) [    x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 986882 INFO  (coreLoadExecutor-3558-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 986882 INFO  (searcherExecutor-3567-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1f9b81ee[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 986883 INFO  (coreLoadExecutor-3558-thread-1) [    x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 986885 INFO  (Thread-3121) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection3/'
   [junit4]   2> 986912 INFO  (Thread-3121) [    ] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 986914 INFO  (Thread-3121) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 986918 INFO  (Thread-3121) [    ] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 986919 INFO  (Thread-3121) [    ] o.a.s.s.IndexSchema Reading Solr Schema from /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection3/conf/schema.xml
   [junit4]   2> 986921 INFO  (Thread-3121) [    ] o.a.s.s.IndexSchema [collectionLazy3] Schema name=tiny
   [junit4]   2> 986923 INFO  (Thread-3121) [    ] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 986924 INFO  (Thread-3121) [    ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties
   [junit4]   2> org.apache.solr.core.SolrResourceNotFoundException: Can't find resource 'configsetprops.json' in classpath or '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection3/conf'
   [junit4]   2> 	at org.apache.solr.core.SolrResourceLoader.openResource(SolrResourceLoader.java:363)
   [junit4]   2> 	at org.apache.solr.core.ConfigSetProperties.readFromResourceLoader(ConfigSetProperties.java:49)
   [junit4]   2> 	at org.apache.solr.core.ConfigSetService.createConfigSetProperties(ConfigSetService.java:114)
   [junit4]   2> 	at org.apache.solr.core.ConfigSetService.getConfig(ConfigSetService.java:76)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:668)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:644)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:939)
   [junit4]   2> 	at org.apache.solr.core.TestLazyCores$2.run(TestLazyCores.java:264)
   [junit4]   2> 986924 INFO  (Thread-3121) [    ] o.a.s.c.CoreContainer Creating SolrCore 'collectionLazy3' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection3/
   [junit4]   2> 986924 INFO  (Thread-3121) [    x:collectionLazy3] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 986925 INFO  (Thread-3121) [    x:collectionLazy3] o.a.s.c.SolrCore [[collectionLazy3] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection3/], dataDir=[null]
   [junit4]   2> 986925 INFO  (Thread-3121) [    x:collectionLazy3] o.a.s.c.SolrCore JMX monitoring not detected for core: collectionLazy3
   [junit4]   2> 986925 INFO  (Thread-3121) [    x:collectionLazy3] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection3/data
   [junit4]   2> 986925 INFO  (Thread-3121) [    x:collectionLazy3] o.a.s.c.SolrCore New index directory detected: old=null new=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection3/data/index/
   [junit4]   2> 986925 WARN  (Thread-3121) [    x:collectionLazy3] o.a.s.c.SolrCore [collectionLazy3] Solr index directory '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection3/data/index' doesn't exist. Creating new index...
   [junit4]   2> 986925 INFO  (Thread-3121) [    x:collectionLazy3] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection3/data/index
   [junit4]   2> 986926 INFO  (Thread-3121) [    x:collectionLazy3] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=50, maxMergeAtOnceExplicit=39, maxMergedSegmentMB=88.3974609375, floorSegmentMB=0.869140625, forceMergeDeletesPctAllowed=1.4509780801683203, segmentsPerTier=26.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 986926 INFO  (Thread-3121) [    x:collectionLazy3] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@73d9c76d lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6b62fdd3),segFN=segments_1,generation=1}
   [junit4]   2> 986926 INFO  (Thread-3121) [    x:collectionLazy3] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 986926 INFO  (OldIndexDirectoryCleanupThreadForCore-collectionLazy3) [    x:collectionLazy3] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collectionLazy3 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection3/data/
   [junit4]   2> 986927 WARN  (OldIndexDirectoryCleanupThreadForCore-collectionLazy3) [    x:collectionLazy3] o.a.s.c.DirectoryFactory /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection3/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 986928 INFO  (Thread-3121) [    x:collectionLazy3] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 986929 INFO  (Thread-3121) [    x:collectionLazy3] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 986930 INFO  (Thread-3121) [    x:collectionLazy3] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 986930 INFO  (Thread-3121) [    x:collectionLazy3] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 986931 INFO  (Thread-3121) [    x:collectionLazy3] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 986932 INFO  (Thread-3121) [    x:collectionLazy3] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,/update/csv,/update/json/docs,/admin/luke,/select,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 986932 INFO  (Thread-3121) [    x:collectionLazy3] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 986933 INFO  (Thread-3121) [    x:collectionLazy3] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 986933 INFO  (Thread-3121) [    x:collectionLazy3] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 986933 INFO  (Thread-3121) [    x:collectionLazy3] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=15, maxMergeAtOnceExplicit=48, maxMergedSegmentMB=15.80078125, floorSegmentMB=0.88671875, forceMergeDeletesPctAllowed=19.80783794429808, segmentsPerTier=27.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 986933 INFO  (Thread-3121) [    x:collectionLazy3] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@73d9c76d lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6b62fdd3),segFN=segments_1,generation=1}
   [junit4]   2> 986933 INFO  (Thread-3121) [    x:collectionLazy3] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 986934 INFO  (Thread-3121) [    x:collectionLazy3] o.a.s.s.SolrIndexSearcher Opening Searcher@3f88a492[collectionLazy3] main
   [junit4]   2> 986934 INFO  (Thread-3121) [    x:collectionLazy3] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection3/conf
   [junit4]   2> 986934 INFO  (Thread-3121) [    x:collectionLazy3] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection3/conf}
   [junit4]   2> 986934 INFO  (Thread-3121) [    x:collectionLazy3] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection3/conf
   [junit4]   2> 986934 INFO  (Thread-3121) [    x:collectionLazy3] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 986934 INFO  (Thread-3121) [    x:collectionLazy3] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 986935 INFO  (searcherExecutor-3571-thread-1-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.c.SolrCore [collectionLazy3] Registered new searcher Searcher@3f88a492[collectionLazy3] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 986935 INFO  (Thread-3121) [    x:collectionLazy3] o.a.s.c.CoreContainer Opening transient core collectionLazy3
   [junit4]   2> 986935 INFO  (Thread-3121) [    x:collectionLazy3] o.a.s.c.CoreContainer registering core: collectionLazy3
   [junit4]   2> 986939 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1345426425
   [junit4]   2> 986939 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collectionLazy5] o.a.s.c.SolrCore [collectionLazy5]  CLOSING SolrCore org.apache.solr.core.SolrCore@302d32d7
   [junit4]   2> 986940 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collectionLazy5] o.a.s.u.UpdateHandler closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 986940 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collectionLazy5] o.a.s.u.SolrCoreState Closing SolrCoreState
   [junit4]   2> 986940 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collectionLazy5] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 986940 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collectionLazy5] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
   [junit4]   2> 986941 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collectionLazy5] o.a.s.c.SolrCore [collectionLazy5] Closing main searcher on request.
   [junit4]   2> 986941 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collectionLazy5] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 986941 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collectionLazy5] o.a.s.c.CachingDirectoryFactory looking to close /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection5/data [CachedDir<<refCount=0;path=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection5/data;done=false>>]
   [junit4]   2> 986941 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collectionLazy5] o.a.s.c.CachingDirectoryFactory Closing directory: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection5/data
   [junit4]   2> 986941 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collectionLazy5] o.a.s.c.CachingDirectoryFactory looking to close /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection5/data/index [CachedDir<<refCount=0;path=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection5/data/index;done=false>>]
   [junit4]   2> 986941 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collectionLazy5] o.a.s.c.CachingDirectoryFactory Closing directory: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection5/data/index
   [junit4]   2> 986941 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@6345f456
   [junit4]   2> 986941 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collection1] o.a.s.u.UpdateHandler closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 986942 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collection1] o.a.s.u.SolrCoreState Closing SolrCoreState
   [junit4]   2> 986942 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collection1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 986942 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
   [junit4]   2> 986942 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request.
   [junit4]   2> 986943 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 986943 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection1/data/index [CachedDir<<refCount=0;path=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection1/data/index;done=false>>]
   [junit4]   2> 986943 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection1/data/index
   [junit4]   2> 986943 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection1/data [CachedDir<<refCount=0;path=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection1/data;done=false>>]
   [junit4]   2> 986943 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection1/data
   [junit4]   2> 986943 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collectionLazy2] o.a.s.c.SolrCore [collectionLazy2]  CLOSING SolrCore org.apache.solr.core.SolrCore@330743e6
   [junit4]   2> 986943 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collectionLazy2] o.a.s.u.UpdateHandler closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 986943 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collectionLazy2] o.a.s.u.SolrCoreState Closing SolrCoreState
   [junit4]   2> 986944 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collectionLazy2] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 986944 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collectionLazy2] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
   [junit4]   2> 986945 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collectionLazy2] o.a.s.c.SolrCore [collectionLazy2] Closing main searcher on request.
   [junit4]   2> 986945 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collectionLazy2] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 986945 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collectionLazy2] o.a.s.c.CachingDirectoryFactory looking to close /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection2/data [CachedDir<<refCount=0;path=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection2/data;done=false>>]
   [junit4]   2> 986945 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collectionLazy2] o.a.s.c.CachingDirectoryFactory Closing directory: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection2/data
   [junit4]   2> 986945 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collectionLazy2] o.a.s.c.CachingDirectoryFactory looking to close /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection2/data/index [CachedDir<<refCount=0;path=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection2/data/index;done=false>>]
   [junit4]   2> 986945 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collectionLazy2] o.a.s.c.CachingDirectoryFactory Closing directory: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection2/data/index
   [junit4]   2> 986945 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collectionLazy3] o.a.s.c.SolrCore [collectionLazy3]  CLOSING SolrCore org.apache.solr.core.SolrCore@153ffac2
   [junit4]   2> 986946 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collectionLazy3] o.a.s.u.UpdateHandler closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 986946 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collectionLazy3] o.a.s.u.SolrCoreState Closing SolrCoreState
   [junit4]   2> 986946 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collectionLazy3] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 986946 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collectionLazy3] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
   [junit4]   2> 986946 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collectionLazy3] o.a.s.c.SolrCore [collectionLazy3] Closing main searcher on request.
   [junit4]   2> 986947 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collectionLazy3] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 986947 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collectionLazy3] o.a.s.c.CachingDirectoryFactory looking to close /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection3/data [CachedDir<<refCount=0;path=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection3/data;done=false>>]
   [junit4]   2> 986947 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collectionLazy3] o.a.s.c.CachingDirectoryFactory Closing directory: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection3/data
   [junit4]   2> 986947 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collectionLazy3] o.a.s.c.CachingDirectoryFactory looking to close /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection3/data/index [CachedDir<<refCount=0;path=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection3/data/index;done=false>>]
   [junit4]   2> 986947 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collectionLazy3] o.a.s.c.CachingDirectoryFactory Closing directory: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-001/collection3/data/index
   [junit4]   2> 986947 INFO  (TEST-TestLazyCores.testRace-seed#[680F5D1EE70417EF]) [    x:collectionLazy3] o.a.s.SolrTestCaseJ4 ###Ending testRace
   [junit4]   2> 986949 INFO  (TEST-TestLazyCores.testCachingLimit-seed#[680F5D1EE70417EF]) [    x:collectionLazy3] o.a.s.SolrTestCaseJ4 ###Starting testCachingLimit
   [junit4]   2> 986958 INFO  (TEST-TestLazyCores.testCachingLimit-seed#[680F5D1EE70417EF]) [    x:collectionLazy3] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-002/'
   [junit4]   2> 986967 INFO  (TEST-TestLazyCores.testCachingLimit-seed#[680F5D1EE70417EF]) [    x:collectionLazy3] o.a.s.c.CoreContainer New CoreContainer 666679095
   [junit4]   2> 986967 INFO  (TEST-TestLazyCores.testCachingLimit-seed#[680F5D1EE70417EF]) [    x:collectionLazy3] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-002/]
   [junit4]   2> 986967 INFO  (TEST-TestLazyCores.testCachingLimit-seed#[680F5D1EE70417EF]) [    x:collectionLazy3] o.a.s.c.CoreContainer loading shared library: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-002/lib
   [junit4]   2> 986967 WARN  (TEST-TestLazyCores.testCachingLimit-seed#[680F5D1EE70417EF]) [    x:collectionLazy3] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-002/lib).
   [junit4]   2> 986972 INFO  (TEST-TestLazyCores.testCachingLimit-seed#[680F5D1EE70417EF]) [    x:collectionLazy3] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 600000,connTimeout : 60000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 986974 INFO  (TEST-TestLazyCores.testCachingLimit-seed#[680F5D1EE70417EF]) [    x:collectionLazy3] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 986974 INFO  (TEST-TestLazyCores.testCachingLimit-seed#[680F5D1EE70417EF]) [    x:collectionLazy3] o.a.s.c.CoreContainer Allocating transient cache for 4 transient cores
   [junit4]   2> 986974 INFO  (TEST-TestLazyCores.testCachingLimit-seed#[680F5D1EE70417EF]) [    x:collectionLazy3] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 986974 INFO  (TEST-TestLazyCores.testCachingLimit-seed#[680F5D1EE70417EF]) [    x:collectionLazy3] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 986975 INFO  (TEST-TestLazyCores.testCachingLimit-seed#[680F5D1EE70417EF]) [    x:collectionLazy3] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 986975 INFO  (TEST-TestLazyCores.testCachingLimit-seed#[680F5D1EE70417EF]) [    x:collectionLazy3] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=collection1, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-002/collection1/, dataDir=data/}
   [junit4]   2> 986975 INFO  (TEST-TestLazyCores.testCachingLimit-seed#[680F5D1EE70417EF]) [    x:collectionLazy3] o.a.s.c.SolrCore Created CoreDescriptor: {name=collectionLazy2, config=solrconfig.xml, transient=true, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=collection2, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-002/collection2/, dataDir=data/}
   [junit4]   2> 986976 INFO  (TEST-TestLazyCores.testCachingLimit-seed#[680F5D1EE70417EF]) [    x:collectionLazy3] o.a.s.c.SolrCore Created CoreDescriptor: {name=collectionLazy3, config=solrconfig.xml, transient=on, schema=schema.xml, loadOnStartup=false, configSetProperties=configsetprops.json, instanceDir=collection3, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-002/collection3/, dataDir=data/}
   [junit4]   2> 986976 INFO  (TEST-TestLazyCores.testCachingLimit-seed#[680F5D1EE70417EF]) [    x:collectionLazy3] o.a.s.c.SolrCore Created CoreDescriptor: {name=collectionLazy4, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=false, configSetProperties=configsetprops.json, instanceDir=collection4, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-002/collection4/, dataDir=data/}
   [junit4]   2> 986976 INFO  (TEST-TestLazyCores.testCachingLimit-seed#[680F5D1EE70417EF]) [    x:collectionLazy3] o.a.s.c.SolrCore Created CoreDescriptor: {name=collectionLazy5, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=collection5, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-002/collection5/, dataDir=data/}
   [junit4]   2> 986976 INFO  (TEST-TestLazyCores.testCachingLimit-seed#[680F5D1EE70417EF]) [    x:collectionLazy3] o.a.s.c.SolrCore Created CoreDescriptor: {name=collectionLazy6, config=solrconfig.xml, transient=true, schema=schema.xml, loadOnStartup=false, configSetProperties=configsetprops.json, instanceDir=collection6, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-002/collection6/, dataDir=data/}
   [junit4]   2> 986977 INFO  (TEST-TestLazyCores.testCachingLimit-seed#[680F5D1EE70417EF]) [    x:collectionLazy3] o.a.s.c.SolrCore Created CoreDescriptor: {name=collectionLazy7, config=solrconfig.xml, transient=true, schema=schema.xml, loadOnStartup=false, configSetProperties=configsetprops.json, instanceDir=collection7, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-002/collection7/, dataDir=data/}
   [junit4]   2> 986977 INFO  (TEST-TestLazyCores.testCachingLimit-seed#[680F5D1EE70417EF]) [    x:collectionLazy3] o.a.s.c.SolrCore Created CoreDescriptor: {name=collectionLazy8, config=solrconfig.xml, transient=true, schema=schema.xml, loadOnStartup=false, configSetProperties=configsetprops.json, instanceDir=collection8, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-002/collection8/, dataDir=data/}
   [junit4]   2> 986977 INFO  (TEST-TestLazyCores.testCachingLimit-seed#[680F5D1EE70417EF]) [    x:collectionLazy3] o.a.s.c.SolrCore Created CoreDescriptor: {name=collectionLazy9, config=solrconfig.xml, transient=true, schema=schema.xml, loadOnStartup=false, configSetProperties=configsetprops.json, instanceDir=collection9, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-002/collection9/, dataDir=data/}
   [junit4]   2> 986978 INFO  (coreLoadExecutor-3580-thread-1-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-002/collection1/'
   [junit4]   2> 986978 INFO  (coreLoadExecutor-3580-thread-3-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-002/collection5/'
   [junit4]   2> 986978 INFO  (coreLoadExecutor-3580-thread-2-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-002/collection2/'
   [junit4]   2> 986990 INFO  (coreLoadExecutor-3580-thread-1-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 986993 INFO  (coreLoadExecutor-3580-thread-1-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 987011 INFO  (coreLoadExecutor-3580-thread-3-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 987012 INFO  (coreLoadExecutor-3580-thread-1-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 987013 INFO  (coreLoadExecutor-3580-thread-1-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.s.IndexSchema Reading Solr Schema from /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-002/collection1/conf/schema.xml
   [junit4]   2> 987013 INFO  (coreLoadExecutor-3580-thread-2-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 987014 INFO  (coreLoadExecutor-3580-thread-3-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 987014 INFO  (coreLoadExecutor-3580-thread-1-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.s.IndexSchema [collection1] Schema name=tiny
   [junit4]   2> 987015 INFO  (coreLoadExecutor-3580-thread-2-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 987017 INFO  (coreLoadExecutor-3580-thread-1-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 987018 INFO  (coreLoadExecutor-3580-thread-1-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties
   [junit4]   2> org.apache.solr.core.SolrResourceNotFoundException: Can't find resource 'configsetprops.json' in classpath or '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-002/collection1/conf'
   [junit4]   2> 	at org.apache.solr.core.SolrResourceLoader.openResource(SolrResourceLoader.java:363)
   [junit4]   2> 	at org.apache.solr.core.ConfigSetProperties.readFromResourceLoader(ConfigSetProperties.java:49)
   [junit4]   2> 	at org.apache.solr.core.ConfigSetService.createConfigSetProperties(ConfigSetService.java:114)
   [junit4]   2> 	at org.apache.solr.core.ConfigSetService.getConfig(ConfigSetService.java:76)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:668)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:397)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:388)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 987018 INFO  (coreLoadExecutor-3580-thread-1-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-002/collection1/
   [junit4]   2> 987018 INFO  (coreLoadExecutor-3580-thread-1-processing-x:collectionLazy3) [    x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 987018 INFO  (coreLoadExecutor-3580-thread-1-processing-x:collectionLazy3) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-002/collection1/], dataDir=[null]
   [junit4]   2> 987018 INFO  (coreLoadExecutor-3580-thread-1-processing-x:collectionLazy3) [    x:collection1] o.a.s.c.SolrCore JMX monitoring not detected for core: collection1
   [junit4]   2> 987019 INFO  (coreLoadExecutor-3580-thread-1-processing-x:collectionLazy3) [    x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-002/collection1/data
   [junit4]   2> 987019 INFO  (coreLoadExecutor-3580-thread-1-processing-x:collectionLazy3) [    x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-002/collection1/data/index/
   [junit4]   2> 987019 WARN  (coreLoadExecutor-3580-thread-1-processing-x:collectionLazy3) [    x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-002/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 987019 INFO  (coreLoadExecutor-3580-thread-1-processing-x:collectionLazy3) [    x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-002/collection1/data/index
   [junit4]   2> 987019 INFO  (coreLoadExecutor-3580-thread-1-processing-x:collectionLazy3) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=50, maxMergeAtOnceExplicit=39, maxMergedSegmentMB=88.3974609375, floorSegmentMB=0.869140625, forceMergeDeletesPctAllowed=1.4509780801683203, segmentsPerTier=26.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 987019 INFO  (coreLoadExecutor-3580-thread-3-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 987020 INFO  (coreLoadExecutor-3580-thread-1-processing-x:collectionLazy3) [    x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@7ab7c803 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@295d6813),segFN=segments_1,generation=1}
   [junit4]   2> 987020 INFO  (coreLoadExecutor-3580-thread-1-processing-x:collectionLazy3) [    x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 987020 INFO  (coreLoadExecutor-3580-thread-3-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.s.IndexSchema Reading Solr Schema from /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-002/collection5/conf/schema.xml
   [junit4]   2> 987020 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [    x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-002/collection1/data/
   [junit4]   2> 987020 WARN  (OldIndexDirectoryCleanupThreadForCore-collection1) [    x:collection1] o.a.s.c.DirectoryFactory /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-002/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 987020 INFO  (coreLoadExecutor-3580-thread-2-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 987021 INFO  (coreLoadExecutor-3580-thread-2-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.s.IndexSchema Reading Solr Schema from /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-002/collection2/conf/schema.xml
   [junit4]   2> 987021 INFO  (coreLoadExecutor-3580-thread-1-processing-x:collectionLazy3) [    x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 987022 INFO  (coreLoadExecutor-3580-thread-3-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.s.IndexSchema [collectionLazy5] Schema name=tiny
   [junit4]   2> 987022 INFO  (coreLoadExecutor-3580-thread-1-processing-x:collectionLazy3) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 987022 INFO  (coreLoadExecutor-3580-thread-2-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.s.IndexSchema [collectionLazy2] Schema name=tiny
   [junit4]   2> 987023 INFO  (coreLoadExecutor-3580-thread-1-processing-x:collectionLazy3) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 987023 INFO  (coreLoadExecutor-3580-thread-1-processing-x:collectionLazy3) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 987024 INFO  (coreLoadExecutor-3580-thread-1-processing-x:collectionLazy3) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 987024 INFO  (coreLoadExecutor-3580-thread-3-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 987024 INFO  (coreLoadExecutor-3580-thread-2-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 987024 INFO  (coreLoadExecutor-3580-thread-1-processing-x:collectionLazy3) [    x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,/update/csv,/update/json/docs,/admin/luke,/select,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 987025 INFO  (coreLoadExecutor-3580-thread-1-processing-x:collectionLazy3) [    x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 987025 INFO  (coreLoadExecutor-3580-thread-3-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties
   [junit4]   2> org.apache.solr.core.SolrResourceNotFoundException: Can't find resource 'configsetprops.json' in classpath or '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_680F5D1EE70417EF-001/tempDir-002/collection5/conf'
   [junit4]   2> 	at org.apache.solr.core.SolrResourceLoader.openResource(SolrResourceLoader.java:363)
   [junit4]   2> 	at org.apache.solr.core.ConfigSetProperties.readFromResourceLoader(ConfigSetProperties.java:49)
   [junit4]   2> 	at org.apache.solr.core.ConfigSetService.createConfigSetProperties(ConfigSetService.java:114)
   [junit4]   2> 	at org.apache.solr.core.ConfigSetService.getConfig(ConfigSetService.java:76)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:668)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:397)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:388)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:156)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [j

[...truncated too long message...]

OR: SolrIndexSearcher opens=51 closes=50
   [junit4]   2> Jul 15, 2015 4:24:40 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> Jul 15, 2015 4:25:00 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.core.TestLazyCores: 
   [junit4]   2>    1) Thread[id=8235, name=searcherExecutor-3585-thread-1, state=WAITING, group=TGRP-TestLazyCores]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Jul 15, 2015 4:25:00 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=8235, name=searcherExecutor-3585-thread-1, state=WAITING, group=TGRP-TestLazyCores]
   [junit4]   2> Jul 15, 2015 4:25:03 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> SEVERE: There are still zombie threads that couldn't be terminated:
   [junit4]   2>    1) Thread[id=8235, name=searcherExecutor-3585-thread-1, state=WAITING, group=TGRP-TestLazyCores]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> NOTE: test params are: codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY, chunkSize=9, maxDocsPerChunk=3, blockSize=3), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, chunkSize=9, blockSize=3)), sim=DefaultSimilarity, locale=hu, timezone=Australia/ACT
   [junit4]   2> NOTE: Linux 3.16.0-41-generic amd64/Oracle Corporation 1.8.0_45 (64-bit)/cpus=12,threads=2,free=180998248,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [TestCustomSort, TestCustomDocTransformer, TestFieldTypeResource, DistributedSuggestComponentTest, XmlUpdateRequestHandlerTest, RegexBoostProcessorTest, TestRecovery, NumericFieldsTest, ResponseLogComponentTest, TestBM25SimilarityFactory, TestSolrXml, TestQueryTypes, TestUtils, TestExactSharedStatsCache, TestRawResponseWriter, SOLR749Test, SmileWriterTest, StatsComponentTest, TestSystemIdResolver, SoftAutoCommitTest, PolyFieldTest, TestCSVResponseWriter, TestDocSet, DocExpirationUpdateProcessorFactoryTest, TestCopyFieldCollectionResource, TestInitParams, TestBinaryResponseWriter, CollectionTooManyReplicasTest, TestLuceneMatchVersion, TestDynamicLoading, TestTrie, HdfsNNFailoverTest, SimpleFacetsTest, TestReloadAndDeleteDocs, SpellCheckCollatorTest, RecoveryZkTest, TestSQLHandler, TestPseudoReturnFields, TestExactStatsCache, TestMiniSolrCloudClusterSSL, CursorPagingTest, TestMaxScoreQueryParser, TestImplicitCoreProperties, TestManagedResource, TestShortCircuitedRequests, PluginInfoTest, OverriddenZkACLAndCredentialsProvidersTest, LeaderElectionTest, RemoteQueryErrorTest, AsyncMigrateRouteKeyTest, TestCursorMarkWithoutUniqueKey, CdcrVersionReplicationTest, TestXIncludeConfig, TestReplicationHandlerBackup, SolrInfoMBeanTest, TestNoOpRegenerator, TestQuerySenderNoQuery, TestRebalanceLeaders, TestClassNameShortening, SolrCoreCheckLockOnStartupTest, HdfsBasicDistributedZkTest, TestSolrCloudWithKerberosAlt, CloudMLTQParserTest, DistanceUnitsTest, AutoCommitTest, TestRequestStatusCollectionAPI, OpenExchangeRatesOrgProviderTest, DirectUpdateHandlerTest, TestJsonRequest, UUIDUpdateProcessorFallbackTest, TestShardHandlerFactory, TestHdfsUpdateLog, TestSearcherReuse, NotRequiredUniqueKeyTest, TestPivotHelperCode, QueryParsingTest, TestStressReorder, QueryEqualityTest, MultiThreadedOCPTest, TestDefaultSimilarityFactory, AnalyticsMergeStrategyTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, OpenCloseCoreStressTest, OverseerTest, BasicZkTest, FullSolrCloudDistribCmdsTest, ZkCLITest, ShardRoutingCustomTest, TestDistributedGrouping, TestHashPartitioner, TermVectorComponentDistributedTest, ZkControllerTest, TestJoin, TestReload, TestStressVersions, HardAutoCommitTest, TestSolr4Spatial, SpellCheckComponentTest, TestGroupingSearch, SolrCmdDistributorTest, QueryElevationComponentTest, TestSort, BasicFunctionalityTest, TestLazyCores]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestLazyCores -Dtests.seed=680F5D1EE70417EF -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=hu -Dtests.timezone=Australia/ACT -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   0.00s J2 | TestLazyCores (suite) <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: ERROR: SolrIndexSearcher opens=51 closes=50
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([680F5D1EE70417EF]:0)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:465)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:232)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.core.TestLazyCores: 
   [junit4]    >    1) Thread[id=8235, name=searcherExecutor-3585-thread-1, state=WAITING, group=TGRP-TestLazyCores]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([680F5D1EE70417EF]:0)Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=8235, name=searcherExecutor-3585-thread-1, state=WAITING, group=TGRP-TestLazyCores]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([680F5D1EE70417EF]:0)
   [junit4] Completed [399/517] on J2 in 146.13s, 7 tests, 1 failure, 2 errors <<< FAILURES!

[...truncated 381 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:526: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:474: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:61: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:39: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:230: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:513: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1426: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:981: There were test failures: 517 suites, 2032 tests, 3 suite-level errors, 452 ignored (25 assumptions)

Total time: 38 minutes 38 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any