You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2015/07/31 07:19:52 UTC

[JENKINS-EA] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0_60-ea-b24) - Build # 13671 - Still Failing!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/13671/
Java: 64bit/jdk1.8.0_60-ea-b24 -XX:+UseCompressedOops -XX:+UseParallelGC

3 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.core.TestLazyCores

Error Message:
ERROR: SolrIndexSearcher opens=51 closes=50

Stack Trace:
java.lang.AssertionError: ERROR: SolrIndexSearcher opens=51 closes=50
	at __randomizedtesting.SeedInfo.seed([FF2D41215DD9DB3D]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:472)
	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:238)
	at sun.reflect.GeneratedMethodAccessor38.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:799)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.core.TestLazyCores

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.core.TestLazyCores:     1) Thread[id=5416, name=searcherExecutor-2424-thread-1, state=WAITING, group=TGRP-TestLazyCores]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.core.TestLazyCores: 
   1) Thread[id=5416, name=searcherExecutor-2424-thread-1, state=WAITING, group=TGRP-TestLazyCores]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
	at __randomizedtesting.SeedInfo.seed([FF2D41215DD9DB3D]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.core.TestLazyCores

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=5416, name=searcherExecutor-2424-thread-1, state=WAITING, group=TGRP-TestLazyCores]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=5416, name=searcherExecutor-2424-thread-1, state=WAITING, group=TGRP-TestLazyCores]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
	at __randomizedtesting.SeedInfo.seed([FF2D41215DD9DB3D]:0)




Build Log:
[...truncated 10360 lines...]
   [junit4] Suite: org.apache.solr.core.TestLazyCores
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/init-core-data-001
   [junit4]   2> 696569 INFO  (SUITE-TestLazyCores-seed#[FF2D41215DD9DB3D]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 696571 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testRace
   [junit4]   2> 696584 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/'
   [junit4]   2> 696598 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    ] o.a.s.c.CoreContainer New CoreContainer 1950684901
   [junit4]   2> 696598 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/]
   [junit4]   2> 696598 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    ] o.a.s.c.CoreContainer loading shared library: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/lib
   [junit4]   2> 696599 WARN  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/lib).
   [junit4]   2> 696605 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 600000,connTimeout : 60000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 696607 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 696607 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    ] o.a.s.c.CoreContainer Allocating transient cache for 4 transient cores
   [junit4]   2> 696609 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 696609 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 696609 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 696610 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=collection1, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection1/, dataDir=data/}
   [junit4]   2> 696610 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collectionLazy2, config=solrconfig.xml, transient=true, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=collection2, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection2/, dataDir=data/}
   [junit4]   2> 696610 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collectionLazy3, config=solrconfig.xml, transient=on, schema=schema.xml, loadOnStartup=false, configSetProperties=configsetprops.json, instanceDir=collection3, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection3/, dataDir=data/}
   [junit4]   2> 696610 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collectionLazy4, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=false, configSetProperties=configsetprops.json, instanceDir=collection4, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection4/, dataDir=data/}
   [junit4]   2> 696611 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collectionLazy5, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=collection5, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection5/, dataDir=data/}
   [junit4]   2> 696611 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collectionLazy6, config=solrconfig.xml, transient=true, schema=schema.xml, loadOnStartup=false, configSetProperties=configsetprops.json, instanceDir=collection6, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection6/, dataDir=data/}
   [junit4]   2> 696611 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collectionLazy7, config=solrconfig.xml, transient=true, schema=schema.xml, loadOnStartup=false, configSetProperties=configsetprops.json, instanceDir=collection7, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection7/, dataDir=data/}
   [junit4]   2> 696611 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collectionLazy8, config=solrconfig.xml, transient=true, schema=schema.xml, loadOnStartup=false, configSetProperties=configsetprops.json, instanceDir=collection8, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection8/, dataDir=data/}
   [junit4]   2> 696612 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collectionLazy9, config=solrconfig.xml, transient=true, schema=schema.xml, loadOnStartup=false, configSetProperties=configsetprops.json, instanceDir=collection9, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection9/, dataDir=data/}
   [junit4]   2> 696612 INFO  (coreLoadExecutor-2336-thread-1) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection1/'
   [junit4]   2> 696613 INFO  (coreLoadExecutor-2336-thread-2) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection2/'
   [junit4]   2> 696613 INFO  (coreLoadExecutor-2336-thread-3) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection5/'
   [junit4]   2> 696633 INFO  (coreLoadExecutor-2336-thread-1) [    ] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 696635 INFO  (coreLoadExecutor-2336-thread-2) [    ] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 696636 INFO  (coreLoadExecutor-2336-thread-1) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 696638 INFO  (coreLoadExecutor-2336-thread-2) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 696655 INFO  (coreLoadExecutor-2336-thread-1) [    ] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 696656 INFO  (coreLoadExecutor-2336-thread-1) [    ] o.a.s.s.IndexSchema Reading Solr Schema from /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection1/conf/schema.xml
   [junit4]   2> 696657 INFO  (coreLoadExecutor-2336-thread-2) [    ] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 696657 INFO  (coreLoadExecutor-2336-thread-3) [    ] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 696657 INFO  (coreLoadExecutor-2336-thread-2) [    ] o.a.s.s.IndexSchema Reading Solr Schema from /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection2/conf/schema.xml
   [junit4]   2> 696657 INFO  (coreLoadExecutor-2336-thread-1) [    ] o.a.s.s.IndexSchema [collection1] Schema name=tiny
   [junit4]   2> 696659 INFO  (coreLoadExecutor-2336-thread-2) [    ] o.a.s.s.IndexSchema [collectionLazy2] Schema name=tiny
   [junit4]   2> 696659 INFO  (coreLoadExecutor-2336-thread-3) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 696660 INFO  (coreLoadExecutor-2336-thread-1) [    ] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 696661 INFO  (coreLoadExecutor-2336-thread-1) [    ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection1/conf'
   [junit4]   2> 696661 INFO  (coreLoadExecutor-2336-thread-1) [    ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection1/
   [junit4]   2> 696661 INFO  (coreLoadExecutor-2336-thread-2) [    ] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 696661 INFO  (coreLoadExecutor-2336-thread-1) [    x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 696662 INFO  (coreLoadExecutor-2336-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection1/], dataDir=[null]
   [junit4]   2> 696662 INFO  (coreLoadExecutor-2336-thread-1) [    x:collection1] o.a.s.c.SolrCore JMX monitoring not detected for core: collection1
   [junit4]   2> 696662 INFO  (coreLoadExecutor-2336-thread-2) [    ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection2/conf'
   [junit4]   2> 696662 INFO  (coreLoadExecutor-2336-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection1/data
   [junit4]   2> 696662 INFO  (coreLoadExecutor-2336-thread-2) [    ] o.a.s.c.CoreContainer Creating SolrCore 'collectionLazy2' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection2/
   [junit4]   2> 696663 INFO  (coreLoadExecutor-2336-thread-1) [    x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection1/data/index/
   [junit4]   2> 696663 INFO  (coreLoadExecutor-2336-thread-2) [    x:collectionLazy2] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 696663 WARN  (coreLoadExecutor-2336-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 696663 INFO  (coreLoadExecutor-2336-thread-2) [    x:collectionLazy2] o.a.s.c.SolrCore [[collectionLazy2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection2/], dataDir=[null]
   [junit4]   2> 696663 INFO  (coreLoadExecutor-2336-thread-2) [    x:collectionLazy2] o.a.s.c.SolrCore JMX monitoring not detected for core: collectionLazy2
   [junit4]   2> 696663 INFO  (coreLoadExecutor-2336-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection1/data/index
   [junit4]   2> 696664 INFO  (coreLoadExecutor-2336-thread-2) [    x:collectionLazy2] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection2/data
   [junit4]   2> 696664 INFO  (coreLoadExecutor-2336-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=18, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=29.34375, floorSegmentMB=0.6826171875, forceMergeDeletesPctAllowed=14.854206829152934, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7750812435374898
   [junit4]   2> 696664 INFO  (coreLoadExecutor-2336-thread-2) [    x:collectionLazy2] o.a.s.c.SolrCore New index directory detected: old=null new=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection2/data/index/
   [junit4]   2> 696664 WARN  (coreLoadExecutor-2336-thread-2) [    x:collectionLazy2] o.a.s.c.SolrCore [collectionLazy2] Solr index directory '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection2/data/index' doesn't exist. Creating new index...
   [junit4]   2> 696664 INFO  (coreLoadExecutor-2336-thread-2) [    x:collectionLazy2] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection2/data/index
   [junit4]   2> 696664 INFO  (coreLoadExecutor-2336-thread-1) [    x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@ad73785 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@57cf2d06),segFN=segments_1,generation=1}
   [junit4]   2> 696664 INFO  (coreLoadExecutor-2336-thread-2) [    x:collectionLazy2] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=18, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=29.34375, floorSegmentMB=0.6826171875, forceMergeDeletesPctAllowed=14.854206829152934, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7750812435374898
   [junit4]   2> 696664 INFO  (coreLoadExecutor-2336-thread-1) [    x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 696665 INFO  (coreLoadExecutor-2336-thread-2) [    x:collectionLazy2] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@55ec8f7e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1fb51ca4),segFN=segments_1,generation=1}
   [junit4]   2> 696665 INFO  (coreLoadExecutor-2336-thread-2) [    x:collectionLazy2] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 696665 INFO  (coreLoadExecutor-2336-thread-3) [    ] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 696665 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [    x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection1/data/
   [junit4]   2> 696665 INFO  (coreLoadExecutor-2336-thread-3) [    ] o.a.s.s.IndexSchema Reading Solr Schema from /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection5/conf/schema.xml
   [junit4]   2> 696666 WARN  (OldIndexDirectoryCleanupThreadForCore-collection1) [    x:collection1] o.a.s.c.DirectoryFactory /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 696666 INFO  (coreLoadExecutor-2336-thread-1) [    x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 696668 INFO  (coreLoadExecutor-2336-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 696668 INFO  (coreLoadExecutor-2336-thread-3) [    ] o.a.s.s.IndexSchema [collectionLazy5] Schema name=tiny
   [junit4]   2> 696668 INFO  (coreLoadExecutor-2336-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 696669 INFO  (coreLoadExecutor-2336-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 696670 INFO  (coreLoadExecutor-2336-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 696670 INFO  (coreLoadExecutor-2336-thread-3) [    ] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 696671 INFO  (coreLoadExecutor-2336-thread-3) [    ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection5/conf'
   [junit4]   2> 696671 INFO  (coreLoadExecutor-2336-thread-1) [    x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,/update/csv,/update/json/docs,/admin/luke,/select,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 696671 INFO  (coreLoadExecutor-2336-thread-3) [    ] o.a.s.c.CoreContainer Creating SolrCore 'collectionLazy5' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection5/
   [junit4]   2> 696671 INFO  (coreLoadExecutor-2336-thread-3) [    x:collectionLazy5] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 696671 INFO  (coreLoadExecutor-2336-thread-1) [    x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 696671 INFO  (coreLoadExecutor-2336-thread-3) [    x:collectionLazy5] o.a.s.c.SolrCore [[collectionLazy5] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection5/], dataDir=[null]
   [junit4]   2> 696671 INFO  (coreLoadExecutor-2336-thread-3) [    x:collectionLazy5] o.a.s.c.SolrCore JMX monitoring not detected for core: collectionLazy5
   [junit4]   2> 696672 INFO  (coreLoadExecutor-2336-thread-3) [    x:collectionLazy5] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection5/data
   [junit4]   2> 696672 INFO  (coreLoadExecutor-2336-thread-3) [    x:collectionLazy5] o.a.s.c.SolrCore New index directory detected: old=null new=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection5/data/index/
   [junit4]   2> 696672 WARN  (coreLoadExecutor-2336-thread-3) [    x:collectionLazy5] o.a.s.c.SolrCore [collectionLazy5] Solr index directory '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection5/data/index' doesn't exist. Creating new index...
   [junit4]   2> 696672 INFO  (coreLoadExecutor-2336-thread-3) [    x:collectionLazy5] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection5/data/index
   [junit4]   2> 696672 INFO  (coreLoadExecutor-2336-thread-3) [    x:collectionLazy5] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=18, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=29.34375, floorSegmentMB=0.6826171875, forceMergeDeletesPctAllowed=14.854206829152934, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7750812435374898
   [junit4]   2> 696673 INFO  (coreLoadExecutor-2336-thread-3) [    x:collectionLazy5] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@6897d382 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@161006ae),segFN=segments_1,generation=1}
   [junit4]   2> 696673 INFO  (coreLoadExecutor-2336-thread-3) [    x:collectionLazy5] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 696676 INFO  (OldIndexDirectoryCleanupThreadForCore-collectionLazy2) [    x:collectionLazy2] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collectionLazy2 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection2/data/
   [junit4]   2> 696677 INFO  (coreLoadExecutor-2336-thread-1) [    x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 696677 INFO  (coreLoadExecutor-2336-thread-1) [    x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 696677 INFO  (coreLoadExecutor-2336-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=47, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=78.765625, floorSegmentMB=1.7919921875, forceMergeDeletesPctAllowed=8.701696338379366, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.25925400298019585
   [junit4]   2> 696677 INFO  (coreLoadExecutor-2336-thread-1) [    x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@ad73785 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@57cf2d06),segFN=segments_1,generation=1}
   [junit4]   2> 696678 INFO  (coreLoadExecutor-2336-thread-1) [    x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 696678 INFO  (coreLoadExecutor-2336-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@4f2b0bb3[collection1] main
   [junit4]   2> 696678 INFO  (coreLoadExecutor-2336-thread-2) [    x:collectionLazy2] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 696678 INFO  (OldIndexDirectoryCleanupThreadForCore-collectionLazy5) [    x:collectionLazy5] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collectionLazy5 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection5/data/
   [junit4]   2> 696678 WARN  (OldIndexDirectoryCleanupThreadForCore-collectionLazy2) [    x:collectionLazy2] o.a.s.c.DirectoryFactory /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection2/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 696678 INFO  (coreLoadExecutor-2336-thread-3) [    x:collectionLazy5] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 696679 INFO  (coreLoadExecutor-2336-thread-2) [    x:collectionLazy2] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 696680 INFO  (coreLoadExecutor-2336-thread-3) [    x:collectionLazy5] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 696680 INFO  (coreLoadExecutor-2336-thread-2) [    x:collectionLazy2] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 696680 INFO  (coreLoadExecutor-2336-thread-3) [    x:collectionLazy5] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 696681 INFO  (coreLoadExecutor-2336-thread-2) [    x:collectionLazy2] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 696681 INFO  (coreLoadExecutor-2336-thread-3) [    x:collectionLazy5] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 696681 INFO  (coreLoadExecutor-2336-thread-2) [    x:collectionLazy2] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 696682 INFO  (coreLoadExecutor-2336-thread-3) [    x:collectionLazy5] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 696682 INFO  (coreLoadExecutor-2336-thread-2) [    x:collectionLazy2] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,/update/csv,/update/json/docs,/admin/luke,/select,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 696683 INFO  (coreLoadExecutor-2336-thread-3) [    x:collectionLazy5] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,/update/csv,/update/json/docs,/admin/luke,/select,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 696683 INFO  (coreLoadExecutor-2336-thread-2) [    x:collectionLazy2] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 696683 INFO  (coreLoadExecutor-2336-thread-3) [    x:collectionLazy5] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 696683 INFO  (coreLoadExecutor-2336-thread-2) [    x:collectionLazy2] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 696679 WARN  (OldIndexDirectoryCleanupThreadForCore-collectionLazy5) [    x:collectionLazy5] o.a.s.c.DirectoryFactory /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection5/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 696678 INFO  (coreLoadExecutor-2336-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection1/conf
   [junit4]   2> 696683 INFO  (coreLoadExecutor-2336-thread-1) [    x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection1/conf}
   [junit4]   2> 696684 INFO  (coreLoadExecutor-2336-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection1/conf
   [junit4]   2> 696684 INFO  (coreLoadExecutor-2336-thread-1) [    x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 696684 INFO  (coreLoadExecutor-2336-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 696683 INFO  (coreLoadExecutor-2336-thread-2) [    x:collectionLazy2] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 696684 INFO  (coreLoadExecutor-2336-thread-2) [    x:collectionLazy2] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=47, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=78.765625, floorSegmentMB=1.7919921875, forceMergeDeletesPctAllowed=8.701696338379366, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.25925400298019585
   [junit4]   2> 696685 INFO  (coreLoadExecutor-2336-thread-2) [    x:collectionLazy2] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@55ec8f7e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1fb51ca4),segFN=segments_1,generation=1}
   [junit4]   2> 696685 INFO  (coreLoadExecutor-2336-thread-2) [    x:collectionLazy2] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 696685 INFO  (coreLoadExecutor-2336-thread-2) [    x:collectionLazy2] o.a.s.s.SolrIndexSearcher Opening Searcher@730e0d36[collectionLazy2] main
   [junit4]   2> 696685 INFO  (coreLoadExecutor-2336-thread-2) [    x:collectionLazy2] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection2/conf
   [junit4]   2> 696686 INFO  (coreLoadExecutor-2336-thread-2) [    x:collectionLazy2] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection2/conf}
   [junit4]   2> 696686 INFO  (coreLoadExecutor-2336-thread-2) [    x:collectionLazy2] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection2/conf
   [junit4]   2> 696686 INFO  (coreLoadExecutor-2336-thread-2) [    x:collectionLazy2] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 696687 INFO  (coreLoadExecutor-2336-thread-2) [    x:collectionLazy2] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 696688 INFO  (searcherExecutor-2337-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@4f2b0bb3[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 696689 INFO  (coreLoadExecutor-2336-thread-3) [    x:collectionLazy5] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 696689 INFO  (coreLoadExecutor-2336-thread-3) [    x:collectionLazy5] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 696689 INFO  (coreLoadExecutor-2336-thread-1) [    x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 696689 INFO  (coreLoadExecutor-2336-thread-3) [    x:collectionLazy5] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=47, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=78.765625, floorSegmentMB=1.7919921875, forceMergeDeletesPctAllowed=8.701696338379366, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.25925400298019585
   [junit4]   2> 696689 INFO  (coreLoadExecutor-2336-thread-2) [    x:collectionLazy2] o.a.s.c.CoreContainer Opening transient core collectionLazy2
   [junit4]   2> 696689 INFO  (coreLoadExecutor-2336-thread-3) [    x:collectionLazy5] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@6897d382 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@161006ae),segFN=segments_1,generation=1}
   [junit4]   2> 696689 INFO  (coreLoadExecutor-2336-thread-2) [    x:collectionLazy2] o.a.s.c.CoreContainer registering core: collectionLazy2
   [junit4]   2> 696689 INFO  (searcherExecutor-2338-thread-1-processing-x:collectionLazy2) [    x:collectionLazy2] o.a.s.c.SolrCore [collectionLazy2] Registered new searcher Searcher@730e0d36[collectionLazy2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 696689 INFO  (coreLoadExecutor-2336-thread-3) [    x:collectionLazy5] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 696690 INFO  (coreLoadExecutor-2336-thread-3) [    x:collectionLazy5] o.a.s.s.SolrIndexSearcher Opening Searcher@5f8c67d8[collectionLazy5] main
   [junit4]   2> 696690 INFO  (coreLoadExecutor-2336-thread-3) [    x:collectionLazy5] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection5/conf
   [junit4]   2> 696690 INFO  (coreLoadExecutor-2336-thread-3) [    x:collectionLazy5] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection5/conf}
   [junit4]   2> 696691 INFO  (coreLoadExecutor-2336-thread-3) [    x:collectionLazy5] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection5/conf
   [junit4]   2> 696691 INFO  (coreLoadExecutor-2336-thread-3) [    x:collectionLazy5] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 696691 INFO  (coreLoadExecutor-2336-thread-3) [    x:collectionLazy5] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 696691 INFO  (coreLoadExecutor-2336-thread-3) [    x:collectionLazy5] o.a.s.c.CoreContainer registering core: collectionLazy5
   [junit4]   2> 696693 INFO  (searcherExecutor-2340-thread-1-processing-x:collectionLazy5) [    x:collectionLazy5] o.a.s.c.SolrCore [collectionLazy5] Registered new searcher Searcher@5f8c67d8[collectionLazy5] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 696693 INFO  (Thread-2459) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection3/'
   [junit4]   2> 696706 INFO  (Thread-2459) [    ] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 696708 INFO  (Thread-2459) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 696713 INFO  (Thread-2459) [    ] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 696713 INFO  (Thread-2459) [    ] o.a.s.s.IndexSchema Reading Solr Schema from /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection3/conf/schema.xml
   [junit4]   2> 696715 INFO  (Thread-2459) [    ] o.a.s.s.IndexSchema [collectionLazy3] Schema name=tiny
   [junit4]   2> 696717 INFO  (Thread-2459) [    ] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 696718 INFO  (Thread-2459) [    ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection3/conf'
   [junit4]   2> 696718 INFO  (Thread-2459) [    ] o.a.s.c.CoreContainer Creating SolrCore 'collectionLazy3' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection3/
   [junit4]   2> 696718 INFO  (Thread-2459) [    x:collectionLazy3] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 696718 INFO  (Thread-2459) [    x:collectionLazy3] o.a.s.c.SolrCore [[collectionLazy3] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection3/], dataDir=[null]
   [junit4]   2> 696718 INFO  (Thread-2459) [    x:collectionLazy3] o.a.s.c.SolrCore JMX monitoring not detected for core: collectionLazy3
   [junit4]   2> 696723 INFO  (Thread-2459) [    x:collectionLazy3] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection3/data
   [junit4]   2> 696723 INFO  (Thread-2459) [    x:collectionLazy3] o.a.s.c.SolrCore New index directory detected: old=null new=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection3/data/index/
   [junit4]   2> 696723 WARN  (Thread-2459) [    x:collectionLazy3] o.a.s.c.SolrCore [collectionLazy3] Solr index directory '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection3/data/index' doesn't exist. Creating new index...
   [junit4]   2> 696724 INFO  (Thread-2459) [    x:collectionLazy3] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection3/data/index
   [junit4]   2> 696724 INFO  (Thread-2459) [    x:collectionLazy3] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=18, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=29.34375, floorSegmentMB=0.6826171875, forceMergeDeletesPctAllowed=14.854206829152934, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7750812435374898
   [junit4]   2> 696724 INFO  (Thread-2459) [    x:collectionLazy3] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@75a15094 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6b09bb53),segFN=segments_1,generation=1}
   [junit4]   2> 696724 INFO  (Thread-2459) [    x:collectionLazy3] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 696724 INFO  (OldIndexDirectoryCleanupThreadForCore-collectionLazy3) [    x:collectionLazy3] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collectionLazy3 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection3/data/
   [junit4]   2> 696725 WARN  (OldIndexDirectoryCleanupThreadForCore-collectionLazy3) [    x:collectionLazy3] o.a.s.c.DirectoryFactory /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection3/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 696725 INFO  (Thread-2459) [    x:collectionLazy3] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 696726 INFO  (Thread-2459) [    x:collectionLazy3] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 696727 INFO  (Thread-2459) [    x:collectionLazy3] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 696727 INFO  (Thread-2459) [    x:collectionLazy3] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 696728 INFO  (Thread-2459) [    x:collectionLazy3] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 696729 INFO  (Thread-2459) [    x:collectionLazy3] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,/update/csv,/update/json/docs,/admin/luke,/select,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 696729 INFO  (Thread-2459) [    x:collectionLazy3] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 696729 INFO  (Thread-2459) [    x:collectionLazy3] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 696729 INFO  (Thread-2459) [    x:collectionLazy3] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 696729 INFO  (Thread-2459) [    x:collectionLazy3] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=47, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=78.765625, floorSegmentMB=1.7919921875, forceMergeDeletesPctAllowed=8.701696338379366, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.25925400298019585
   [junit4]   2> 696730 INFO  (Thread-2459) [    x:collectionLazy3] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@75a15094 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6b09bb53),segFN=segments_1,generation=1}
   [junit4]   2> 696730 INFO  (Thread-2459) [    x:collectionLazy3] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 696730 INFO  (Thread-2459) [    x:collectionLazy3] o.a.s.s.SolrIndexSearcher Opening Searcher@7cf15f05[collectionLazy3] main
   [junit4]   2> 696730 INFO  (Thread-2459) [    x:collectionLazy3] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection3/conf
   [junit4]   2> 696730 INFO  (Thread-2459) [    x:collectionLazy3] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection3/conf}
   [junit4]   2> 696730 INFO  (Thread-2459) [    x:collectionLazy3] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection3/conf
   [junit4]   2> 696730 INFO  (Thread-2459) [    x:collectionLazy3] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 696730 INFO  (Thread-2459) [    x:collectionLazy3] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 696731 INFO  (Thread-2459) [    x:collectionLazy3] o.a.s.c.CoreContainer Opening transient core collectionLazy3
   [junit4]   2> 696731 INFO  (searcherExecutor-2349-thread-1-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.c.SolrCore [collectionLazy3] Registered new searcher Searcher@7cf15f05[collectionLazy3] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 696731 INFO  (Thread-2459) [    x:collectionLazy3] o.a.s.c.CoreContainer registering core: collectionLazy3
   [junit4]   2> 696734 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1950684901
   [junit4]   2> 696734 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@36c38af1
   [junit4]   2> 696735 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collection1] o.a.s.u.UpdateHandler closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 696735 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collection1] o.a.s.u.SolrCoreState Closing SolrCoreState
   [junit4]   2> 696735 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collection1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 696735 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
   [junit4]   2> 696736 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request.
   [junit4]   2> 696736 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 696736 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection1/data/index [CachedDir<<refCount=0;path=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection1/data/index;done=false>>]
   [junit4]   2> 696736 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection1/data/index
   [junit4]   2> 696736 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection1/data [CachedDir<<refCount=0;path=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection1/data;done=false>>]
   [junit4]   2> 696736 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection1/data
   [junit4]   2> 696736 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy5] o.a.s.c.SolrCore [collectionLazy5]  CLOSING SolrCore org.apache.solr.core.SolrCore@5e2a8020
   [junit4]   2> 696737 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy5] o.a.s.u.UpdateHandler closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 696737 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy5] o.a.s.u.SolrCoreState Closing SolrCoreState
   [junit4]   2> 696737 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy5] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 696737 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy5] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
   [junit4]   2> 696738 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy5] o.a.s.c.SolrCore [collectionLazy5] Closing main searcher on request.
   [junit4]   2> 696738 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy5] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 696738 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy5] o.a.s.c.CachingDirectoryFactory looking to close /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection5/data/index [CachedDir<<refCount=0;path=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection5/data/index;done=false>>]
   [junit4]   2> 696738 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy5] o.a.s.c.CachingDirectoryFactory Closing directory: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection5/data/index
   [junit4]   2> 696738 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy5] o.a.s.c.CachingDirectoryFactory looking to close /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection5/data [CachedDir<<refCount=0;path=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection5/data;done=false>>]
   [junit4]   2> 696738 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy5] o.a.s.c.CachingDirectoryFactory Closing directory: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection5/data
   [junit4]   2> 696739 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy2] o.a.s.c.SolrCore [collectionLazy2]  CLOSING SolrCore org.apache.solr.core.SolrCore@4118f50d
   [junit4]   2> 696739 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy2] o.a.s.u.UpdateHandler closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 696739 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy2] o.a.s.u.SolrCoreState Closing SolrCoreState
   [junit4]   2> 696739 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy2] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 696739 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy2] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
   [junit4]   2> 696740 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy2] o.a.s.c.SolrCore [collectionLazy2] Closing main searcher on request.
   [junit4]   2> 696740 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy2] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 696740 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy2] o.a.s.c.CachingDirectoryFactory looking to close /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection2/data/index [CachedDir<<refCount=0;path=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection2/data/index;done=false>>]
   [junit4]   2> 696740 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy2] o.a.s.c.CachingDirectoryFactory Closing directory: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection2/data/index
   [junit4]   2> 696740 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy2] o.a.s.c.CachingDirectoryFactory looking to close /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection2/data [CachedDir<<refCount=0;path=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection2/data;done=false>>]
   [junit4]   2> 696740 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy2] o.a.s.c.CachingDirectoryFactory Closing directory: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection2/data
   [junit4]   2> 696740 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.c.SolrCore [collectionLazy3]  CLOSING SolrCore org.apache.solr.core.SolrCore@1986bfed
   [junit4]   2> 696740 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.u.UpdateHandler closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 696741 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.u.SolrCoreState Closing SolrCoreState
   [junit4]   2> 696741 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 696741 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
   [junit4]   2> 696741 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.c.SolrCore [collectionLazy3] Closing main searcher on request.
   [junit4]   2> 696741 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 696742 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.c.CachingDirectoryFactory looking to close /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection3/data [CachedDir<<refCount=0;path=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection3/data;done=false>>]
   [junit4]   2> 696742 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.c.CachingDirectoryFactory Closing directory: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection3/data
   [junit4]   2> 696742 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.c.CachingDirectoryFactory looking to close /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection3/data/index [CachedDir<<refCount=0;path=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection3/data/index;done=false>>]
   [junit4]   2> 696742 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.c.CachingDirectoryFactory Closing directory: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-001/collection3/data/index
   [junit4]   2> 696742 INFO  (TEST-TestLazyCores.testRace-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.SolrTestCaseJ4 ###Ending testRace
   [junit4]   2> 696743 INFO  (TEST-TestLazyCores.testBadConfigsGenerateErrors-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.SolrTestCaseJ4 ###Starting testBadConfigsGenerateErrors
   [junit4]   2> 696753 INFO  (TEST-TestLazyCores.testBadConfigsGenerateErrors-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/'
   [junit4]   2> 696762 INFO  (TEST-TestLazyCores.testBadConfigsGenerateErrors-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/solr.xml
   [junit4]   2> 696765 INFO  (TEST-TestLazyCores.testBadConfigsGenerateErrors-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.c.CoresLocator Config-defined core root directory: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002
   [junit4]   2> 696765 INFO  (TEST-TestLazyCores.testBadConfigsGenerateErrors-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.c.CoreContainer New CoreContainer 1197891392
   [junit4]   2> 696765 INFO  (TEST-TestLazyCores.testBadConfigsGenerateErrors-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/]
   [junit4]   2> 696765 INFO  (TEST-TestLazyCores.testBadConfigsGenerateErrors-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.c.CoreContainer loading shared library: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/lib
   [junit4]   2> 696765 WARN  (TEST-TestLazyCores.testBadConfigsGenerateErrors-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/lib).
   [junit4]   2> 696769 INFO  (TEST-TestLazyCores.testBadConfigsGenerateErrors-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 600000,connTimeout : 60000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 696771 INFO  (TEST-TestLazyCores.testBadConfigsGenerateErrors-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 696771 INFO  (TEST-TestLazyCores.testBadConfigsGenerateErrors-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 696771 INFO  (TEST-TestLazyCores.testBadConfigsGenerateErrors-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 696771 INFO  (TEST-TestLazyCores.testBadConfigsGenerateErrors-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 696771 INFO  (TEST-TestLazyCores.testBadConfigsGenerateErrors-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.c.CoresLocator Looking for core definitions underneath /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002
   [junit4]   2> 696772 INFO  (TEST-TestLazyCores.testBadConfigsGenerateErrors-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.c.SolrCore Created CoreDescriptor: {name=core2, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/core2, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/core2/, dataDir=data/}
   [junit4]   2> 696772 INFO  (TEST-TestLazyCores.testBadConfigsGenerateErrors-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.c.CoresLocator Found core core2 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/core2/
   [junit4]   2> 696772 INFO  (TEST-TestLazyCores.testBadConfigsGenerateErrors-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.c.SolrCore Created CoreDescriptor: {name=badConfig2, config=solrconfig.xml, transient=true, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/badConfig2, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/badConfig2/, dataDir=data/}
   [junit4]   2> 696772 INFO  (TEST-TestLazyCores.testBadConfigsGenerateErrors-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.c.CoresLocator Found core badConfig2 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/badConfig2/
   [junit4]   2> 696773 INFO  (TEST-TestLazyCores.testBadConfigsGenerateErrors-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.c.SolrCore Created CoreDescriptor: {name=core1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/core1, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/core1/, dataDir=data/}
   [junit4]   2> 696773 INFO  (TEST-TestLazyCores.testBadConfigsGenerateErrors-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.c.CoresLocator Found core core1 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/core1/
   [junit4]   2> 696773 INFO  (TEST-TestLazyCores.testBadConfigsGenerateErrors-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.c.SolrCore Created CoreDescriptor: {name=badSchema1, config=solrconfig.xml, transient=true, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/badSchema1, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/badSchema1/, dataDir=data/}
   [junit4]   2> 696773 INFO  (TEST-TestLazyCores.testBadConfigsGenerateErrors-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.c.CoresLocator Found core badSchema1 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/badSchema1/
   [junit4]   2> 696773 INFO  (TEST-TestLazyCores.testBadConfigsGenerateErrors-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.c.SolrCore Created CoreDescriptor: {name=badConfig1, config=solrconfig.xml, transient=true, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/badConfig1, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/badConfig1/, dataDir=data/}
   [junit4]   2> 696773 INFO  (TEST-TestLazyCores.testBadConfigsGenerateErrors-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.c.CoresLocator Found core badConfig1 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/badConfig1/
   [junit4]   2> 696774 INFO  (TEST-TestLazyCores.testBadConfigsGenerateErrors-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.c.SolrCore Created CoreDescriptor: {name=badSchema2, config=solrconfig.xml, transient=true, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/badSchema2, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/badSchema2/, dataDir=data/}
   [junit4]   2> 696774 INFO  (TEST-TestLazyCores.testBadConfigsGenerateErrors-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.c.CoresLocator Found core badSchema2 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/badSchema2/
   [junit4]   2> 696774 INFO  (TEST-TestLazyCores.testBadConfigsGenerateErrors-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.c.CoresLocator Found 6 core definitions
   [junit4]   2> 696774 INFO  (coreLoadExecutor-2358-thread-1-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/core2/'
   [junit4]   2> 696774 INFO  (coreLoadExecutor-2358-thread-2-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/badConfig2/'
   [junit4]   2> 696775 INFO  (coreLoadExecutor-2358-thread-3-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/core1/'
   [junit4]   2> 696788 INFO  (coreLoadExecutor-2358-thread-1-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 696791 INFO  (coreLoadExecutor-2358-thread-1-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 696792 INFO  (coreLoadExecutor-2358-thread-3-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 696814 INFO  (coreLoadExecutor-2358-thread-1-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 696815 INFO  (coreLoadExecutor-2358-thread-1-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.s.IndexSchema Reading Solr Schema from /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/core2/conf/schema.xml
   [junit4]   2> 696815 INFO  (coreLoadExecutor-2358-thread-3-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 696816 INFO  (coreLoadExecutor-2358-thread-1-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.s.IndexSchema [core2] Schema name=tiny
   [junit4]   2> 696818 INFO  (coreLoadExecutor-2358-thread-1-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 696820 INFO  (coreLoadExecutor-2358-thread-1-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/core2/conf'
   [junit4]   2> 696820 INFO  (coreLoadExecutor-2358-thread-1-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.c.CoreContainer Creating SolrCore 'core2' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/core2/
   [junit4]   2> 696820 INFO  (coreLoadExecutor-2358-thread-1-processing-x:collectionLazy3) [    x:core2] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 696820 INFO  (coreLoadExecutor-2358-thread-3-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 696820 INFO  (coreLoadExecutor-2358-thread-1-processing-x:collectionLazy3) [    x:core2] o.a.s.c.SolrCore [[core2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/core2/], dataDir=[null]
   [junit4]   2> 696820 INFO  (coreLoadExecutor-2358-thread-3-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.s.IndexSchema Reading Solr Schema from /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/core1/conf/schema.xml
   [junit4]   2> 696821 INFO  (coreLoadExecutor-2358-thread-1-processing-x:collectionLazy3) [    x:core2] o.a.s.c.SolrCore JMX monitoring not detected for core: core2
   [junit4]   2> 696821 INFO  (coreLoadExecutor-2358-thread-1-processing-x:collectionLazy3) [    x:core2] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/core2/data
   [junit4]   2> 696821 INFO  (coreLoadExecutor-2358-thread-1-processing-x:collectionLazy3) [    x:core2] o.a.s.c.SolrCore New index directory detected: old=null new=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/core2/data/index/
   [junit4]   2> 696821 WARN  (coreLoadExecutor-2358-thread-1-processing-x:collectionLazy3) [    x:core2] o.a.s.c.SolrCore [core2] Solr index directory '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/core2/data/index' doesn't exist. Creating new index...
   [junit4]   2> 696821 INFO  (coreLoadExecutor-2358-thread-1-processing-x:collectionLazy3) [    x:core2] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/core2/data/index
   [junit4]   2> 696822 INFO  (coreLoadExecutor-2358-thread-1-processing-x:collectionLazy3) [    x:core2] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=18, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=29.34375, floorSegmentMB=0.6826171875, forceMergeDeletesPctAllowed=14.854206829152934, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7750812435374898
   [junit4]   2> 696822 INFO  (coreLoadExecutor-2358-thread-1-processing-x:collectionLazy3) [    x:core2] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@d4d2487 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@59875361),segFN=segments_1,generation=1}
   [junit4]   2> 696822 INFO  (coreLoadExecutor-2358-thread-1-processing-x:collectionLazy3) [    x:core2] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 696823 INFO  (coreLoadExecutor-2358-thread-3-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.s.IndexSchema [core1] Schema name=tiny
   [junit4]   2> 696823 INFO  (OldIndexDirectoryCleanupThreadForCore-core2) [    x:core2] o.a.s.c.SolrCore Looking for old index directories to cleanup for core core2 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/core2/data/
   [junit4]   2> 696823 WARN  (OldIndexDirectoryCleanupThreadForCore-core2) [    x:core2] o.a.s.c.DirectoryFactory /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/core2/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 696824 INFO  (coreLoadExecutor-2358-thread-2-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.c.Config Ignoring exception matching \QSAXParseException\E
   [junit4]   2> 696824 ERROR (coreLoadExecutor-2358-thread-2-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.c.CoreContainer Error creating core [badConfig2]: Could not load conf for core badConfig2: Error loading solr config from /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/badConfig2/conf/solrconfig.xml
   [junit4]   2> org.apache.solr.common.SolrException: Could not load conf for core badConfig2: Error loading solr config from /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/badConfig2/conf/solrconfig.xml
   [junit4]   2> 	at org.apache.solr.core.ConfigSetService.getConfig(ConfigSetService.java:82)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:668)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:397)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:388)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:209)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: org.apache.solr.common.SolrException: Error loading solr config from /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/badConfig2/conf/solrconfig.xml
   [junit4]   2> 	at org.apache.solr.core.SolrConfig.readFromResourceLoader(SolrConfig.java:184)
   [junit4]   2> 	at org.apache.solr.core.ConfigSetService.createSolrConfig(ConfigSetService.java:94)
   [junit4]   2> 	at org.apache.solr.core.ConfigSetService.getConfig(ConfigSetService.java:74)
   [junit4]   2> 	... 8 more
   [junit4]   2> Caused by: org.apache.solr.common.SolrException: org.xml.sax.SAXParseException; systemId: solrres:/solrconfig.xml; lineNumber: 55; columnNumber: 5; The element type "reqsthalr" must be terminated by the matching end-tag "</reqsthalr>".
   [junit4]   2> 	at org.apache.solr.core.Config.<init>(Config.java:156)
   [junit4]   2> 	at org.apache.solr.core.Config.<init>(Config.java:92)
   [junit4]   2> 	at org.apache.solr.core.SolrConfig.<init>(SolrConfig.java:199)
   [junit4]   2> 	at org.apache.solr.core.SolrConfig.readFromResourceLoader(SolrConfig.java:176)
   [junit4]   2> 	... 10 more
   [junit4]   2> Caused by: org.xml.sax.SAXParseException; systemId: solrres:/solrconfig.xml; lineNumber: 55; columnNumber: 5; The element type "reqsthalr" must be terminated by the matching end-tag "</reqsthalr>".
   [junit4]   2> 	at com.sun.org.apache.xerces.internal.util.ErrorHandlerWrapper.createSAXParseException(ErrorHandlerWrapper.java:203)
   [junit4]   2> 	at com.sun.org.apache.xerces.internal.util.ErrorHandlerWrapper.fatalError(ErrorHandlerWrapper.java:177)
   [junit4]   2> 	at com.sun.org.apache.xerces.internal.impl.XMLErrorReporter.reportError(XMLErrorReporter.java:441)
   [junit4]   2> 	at com.sun.org.apache.xerces.internal.impl.XMLErrorReporter.reportError(XMLErrorReporter.java:368)
   [junit4]   2> 	at com.sun.org.apache.xerces.internal.impl.XMLScanner.reportFatalError(XMLScanner.java:1437)
   [junit4]   2> 	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanEndElement(XMLDocumentFragmentScannerImpl.java:1749)
   [junit4]   2> 	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl$FragmentContentDriver.next(XMLDocumentFragmentScannerImpl.java:2973)
   [junit4]   2> 	at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(XMLDocumentScannerImpl.java:606)
   [junit4]   2> 	at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(XMLNSDocumentScannerImpl.java:117)
   [junit4]   2> 	at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(XMLDocumentFragmentScannerImpl.java:510)
   [junit4]   2> 	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:848)
   [junit4]   2> 	at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(XML11Configuration.java:777)
   [junit4]   2> 	at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(XMLParser.java:141)
   [junit4]   2> 	at com.sun.org.apache.xerces.internal.parsers.DOMParser.parse(DOMParser.java:243)
   [junit4]   2> 	at com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderImpl.parse(DocumentBuilderImpl.java:348)
   [junit4]   2> 	at org.apache.solr.core.Config.<init>(Config.java:145)
   [junit4]   2> 	... 13 more
   [junit4]   2> 696825 INFO  (coreLoadExecutor-2358-thread-3-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 696826 INFO  (coreLoadExecutor-2358-thread-2-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/badSchema1/'
   [junit4]   2> 696826 INFO  (coreLoadExecutor-2358-thread-1-processing-x:collectionLazy3) [    x:core2] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 696826 INFO  (coreLoadExecutor-2358-thread-3-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/core1/conf'
   [junit4]   2> 696826 INFO  (coreLoadExecutor-2358-thread-3-processing-x:collectionLazy3) [    x:collectionLazy3] o.a.s.c.CoreContainer Creating SolrCore 'core1' using configuration from instancedir /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/core1/
   [junit4]   2> 696826 INFO  (coreLoadExecutor-2358-thread-3-processing-x:collectionLazy3) [    x:core1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 696827 INFO  (coreLoadExecutor-2358-thread-3-processing-x:collectionLazy3) [    x:core1] o.a.s.c.SolrCore [[core1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/core1/], dataDir=[null]
   [junit4]   2> 696827 INFO  (coreLoadExecutor-2358-thread-3-processing-x:collectionLazy3) [    x:core1] o.a.s.c.SolrCore JMX monitoring not detected for core: core1
   [junit4]   2> 696827 INFO  (coreLoadExecutor-2358-thread-3-processing-x:collectionLazy3) [    x:core1] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-002/core1/data
   [junit4]   2> 696827 INFO  (coreLoadExecutor-2358-thread-3-processing-x:collectionLazy3) [    x:core1] o.a.s.c.SolrCore

[...truncated too long message...]

test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-007/collection3/data
   [junit4]   2> 698433 INFO  (TEST-TestLazyCores.testLazyLoad-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.c.CachingDirectoryFactory looking to close /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-007/collection3/data/index [CachedDir<<refCount=0;path=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-007/collection3/data/index;done=false>>]
   [junit4]   2> 698433 INFO  (TEST-TestLazyCores.testLazyLoad-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.c.CachingDirectoryFactory Closing directory: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_FF2D41215DD9DB3D-001/tempDir-007/collection3/data/index
   [junit4]   2> 698434 INFO  (TEST-TestLazyCores.testLazyLoad-seed#[FF2D41215DD9DB3D]) [    x:collectionLazy3] o.a.s.SolrTestCaseJ4 ###Ending testLazyLoad
   [junit4]   2> 698434 INFO  (SUITE-TestLazyCores-seed#[FF2D41215DD9DB3D]-worker) [    x:collectionLazy3] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> 698434 INFO  (SUITE-TestLazyCores-seed#[FF2D41215DD9DB3D]-worker) [    x:collectionLazy3] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1840416958
   [junit4]   2> 819445 ERROR (SUITE-TestLazyCores-seed#[FF2D41215DD9DB3D]-worker) [    x:collectionLazy3] o.a.s.SolrTestCaseJ4 ERROR: SolrIndexSearcher opens=51 closes=50
   [junit4]   2> Jul 31, 2015 5:18:18 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> Jul 31, 2015 5:18:38 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.core.TestLazyCores: 
   [junit4]   2>    1) Thread[id=5416, name=searcherExecutor-2424-thread-1, state=WAITING, group=TGRP-TestLazyCores]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Jul 31, 2015 5:18:38 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=5416, name=searcherExecutor-2424-thread-1, state=WAITING, group=TGRP-TestLazyCores]
   [junit4]   2> Jul 31, 2015 5:18:41 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> SEVERE: There are still zombie threads that couldn't be terminated:
   [junit4]   2>    1) Thread[id=5416, name=searcherExecutor-2424-thread-1, state=WAITING, group=TGRP-TestLazyCores]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene53): {v_t=PostingsFormat(name=MockRandom), id=PostingsFormat(name=MockRandom), v_s=BlockTreeOrds(blocksize=128), v_f=PostingsFormat(name=Direct)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=pl, timezone=PNT
   [junit4]   2> NOTE: Linux 3.16.0-44-generic amd64/Oracle Corporation 1.8.0_60-ea (64-bit)/cpus=12,threads=2,free=31403856,total=531628032
   [junit4]   2> NOTE: All tests run in this JVM: [CSVRequestHandlerTest, RequestLoggingTest, TestReplicationHandler, DateMathParserTest, DocValuesMissingTest, AnalyticsMergeStrategyTest, DistributedIntervalFacetingTest, OverseerStatusTest, ChangedSchemaMergeTest, TestSolrQueryParserDefaultOperatorResource, TestRandomFaceting, ZkNodePropsTest, ClusterStateTest, BasicZkTest, TestSolrIndexConfig, HdfsDirectoryTest, TestReqParamsAPI, AsyncMigrateRouteKeyTest, MultiTermTest, FastVectorHighlighterTest, HdfsBasicDistributedZkTest, SyncSliceTest, TestFaceting, RankQueryTest, CdcrReplicationHandlerTest, TestSolr4Spatial, TestSimpleTrackingShardHandler, MergeStrategyTest, TestMiniSolrCloudClusterSSL, TestBlendedInfixSuggestions, TestJsonRequest, MultiThreadedOCPTest, DeleteInactiveReplicaTest, TestRestoreCore, TestUpdate, TestLRUStatsCache, BasicDistributedZkTest, RemoteQueryErrorTest, DistributedSpellCheckComponentTest, TestShardHandlerFactory, TestBlobHandler, TestRangeQuery, TestPivotHelperCode, TestFieldTypeResource, TestLazyCores]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestLazyCores -Dtests.seed=FF2D41215DD9DB3D -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=pl -Dtests.timezone=PNT -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   0.00s J0 | TestLazyCores (suite) <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: ERROR: SolrIndexSearcher opens=51 closes=50
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([FF2D41215DD9DB3D]:0)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:472)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:238)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.core.TestLazyCores: 
   [junit4]    >    1) Thread[id=5416, name=searcherExecutor-2424-thread-1, state=WAITING, group=TGRP-TestLazyCores]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([FF2D41215DD9DB3D]:0)Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=5416, name=searcherExecutor-2424-thread-1, state=WAITING, group=TGRP-TestLazyCores]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([FF2D41215DD9DB3D]:0)
   [junit4] Completed [276/528] on J0 in 146.04s, 7 tests, 1 failure, 2 errors <<< FAILURES!

[...truncated 779 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:717: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:661: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:59: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:230: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:518: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1429: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:984: There were test failures: 528 suites, 2081 tests, 3 suite-level errors, 642 ignored (25 assumptions)

Total time: 33 minutes 12 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any