You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2016/03/30 06:43:01 UTC

[JENKINS] Lucene-Solr-Tests-master - Build # 1050 - Still Failing

Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/1050/

3 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.core.TestLazyCores

Error Message:
ObjectTracker found 4 object(s) that were not released!!! [MockDirectoryWrapper, SolrCore, MDCAwareThreadPoolExecutor, MockDirectoryWrapper]

Stack Trace:
java.lang.AssertionError: ObjectTracker found 4 object(s) that were not released!!! [MockDirectoryWrapper, SolrCore, MDCAwareThreadPoolExecutor, MockDirectoryWrapper]
	at __randomizedtesting.SeedInfo.seed([6F9D598323A0D2E7]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNull(Assert.java:551)
	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:238)
	at sun.reflect.GeneratedMethodAccessor19.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.core.TestLazyCores

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.core.TestLazyCores:     1) Thread[id=1749, name=searcherExecutor-924-thread-1, state=WAITING, group=TGRP-TestLazyCores]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.core.TestLazyCores: 
   1) Thread[id=1749, name=searcherExecutor-924-thread-1, state=WAITING, group=TGRP-TestLazyCores]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
	at __randomizedtesting.SeedInfo.seed([6F9D598323A0D2E7]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.core.TestLazyCores

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=1749, name=searcherExecutor-924-thread-1, state=WAITING, group=TGRP-TestLazyCores]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=1749, name=searcherExecutor-924-thread-1, state=WAITING, group=TGRP-TestLazyCores]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
	at __randomizedtesting.SeedInfo.seed([6F9D598323A0D2E7]:0)




Build Log:
[...truncated 10902 lines...]
   [junit4] Suite: org.apache.solr.core.TestLazyCores
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/init-core-data-001
   [junit4]   2> 314338 INFO  (SUITE-TestLazyCores-seed#[6F9D598323A0D2E7]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true)
   [junit4]   2> 314348 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testCreateTransientFromAdmin
   [junit4]   2> 314377 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001'
   [junit4]   2> 314378 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 314378 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 314378 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    ] o.a.s.c.CoreContainer New CoreContainer 449777162
   [junit4]   2> 314378 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001]
   [junit4]   2> 314378 WARN  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/lib
   [junit4]   2> 314378 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 600000,connTimeout : 60000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 314397 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 314397 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    ] o.a.s.c.SolrCores Allocating transient cache for 4 transient cores
   [junit4]   2> 314398 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 314398 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 314399 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 314399 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 314399 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, configSetProperties=configsetprops.json, transient=false, dataDir=data/}
   [junit4]   2> 314399 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection2, config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, configSetProperties=configsetprops.json, transient=true, dataDir=data/}
   [junit4]   2> 314400 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection3, config=solrconfig.xml, loadOnStartup=false, schema=schema.xml, configSetProperties=configsetprops.json, transient=on, dataDir=data/}
   [junit4]   2> 314400 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection4, config=solrconfig.xml, loadOnStartup=false, schema=schema.xml, configSetProperties=configsetprops.json, transient=false, dataDir=data/}
   [junit4]   2> 314400 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection5, config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, configSetProperties=configsetprops.json, transient=false, dataDir=data/}
   [junit4]   2> 314400 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection6, config=solrconfig.xml, loadOnStartup=false, schema=schema.xml, configSetProperties=configsetprops.json, transient=true, dataDir=data/}
   [junit4]   2> 314400 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection7, config=solrconfig.xml, loadOnStartup=false, schema=schema.xml, configSetProperties=configsetprops.json, transient=true, dataDir=data/}
   [junit4]   2> 314400 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection8, config=solrconfig.xml, loadOnStartup=false, schema=schema.xml, configSetProperties=configsetprops.json, transient=true, dataDir=data/}
   [junit4]   2> 314400 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection9, config=solrconfig.xml, loadOnStartup=false, schema=schema.xml, configSetProperties=configsetprops.json, transient=true, dataDir=data/}
   [junit4]   2> 314412 INFO  (coreLoadExecutor-823-thread-1) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection1'
   [junit4]   2> 314424 INFO  (coreLoadExecutor-823-thread-1) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 314424 INFO  (coreLoadExecutor-823-thread-1) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 314412 INFO  (coreLoadExecutor-823-thread-2) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection2'
   [junit4]   2> 314426 INFO  (coreLoadExecutor-823-thread-2) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 314426 INFO  (coreLoadExecutor-823-thread-2) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 314412 INFO  (coreLoadExecutor-823-thread-3) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection5'
   [junit4]   2> 314427 INFO  (coreLoadExecutor-823-thread-3) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 314427 INFO  (coreLoadExecutor-823-thread-3) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 314472 INFO  (coreLoadExecutor-823-thread-1) [    ] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 314473 INFO  (coreLoadExecutor-823-thread-2) [    ] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 314475 WARN  (coreLoadExecutor-823-thread-2) [    ] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 314475 INFO  (coreLoadExecutor-823-thread-2) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 314479 INFO  (coreLoadExecutor-823-thread-3) [    ] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 314481 WARN  (coreLoadExecutor-823-thread-1) [    ] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 314578 INFO  (coreLoadExecutor-823-thread-1) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 314580 WARN  (coreLoadExecutor-823-thread-3) [    ] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 314580 INFO  (coreLoadExecutor-823-thread-3) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 314582 INFO  (coreLoadExecutor-823-thread-2) [    ] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 314584 INFO  (coreLoadExecutor-823-thread-2) [    ] o.a.s.s.IndexSchema [collection2] Schema name=tiny
   [junit4]   2> 314585 INFO  (coreLoadExecutor-823-thread-1) [    ] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 314586 INFO  (coreLoadExecutor-823-thread-2) [    ] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 314587 INFO  (coreLoadExecutor-823-thread-1) [    ] o.a.s.s.IndexSchema [collection1] Schema name=tiny
   [junit4]   2> 314587 INFO  (coreLoadExecutor-823-thread-2) [    ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection2'
   [junit4]   2> 314587 INFO  (coreLoadExecutor-823-thread-2) [    ] o.a.s.c.CoreContainer Creating SolrCore 'collection2' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection2
   [junit4]   2> 314587 INFO  (coreLoadExecutor-823-thread-2) [    x:collection2] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 314587 INFO  (coreLoadExecutor-823-thread-2) [    x:collection2] o.a.s.c.SolrCore [[collection2] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection2], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection2/data/]
   [junit4]   2> 314587 INFO  (coreLoadExecutor-823-thread-2) [    x:collection2] o.a.s.c.SolrCore JMX monitoring not detected for core: collection2
   [junit4]   2> 314588 INFO  (coreLoadExecutor-823-thread-2) [    x:collection2] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection2/data
   [junit4]   2> 314588 INFO  (coreLoadExecutor-823-thread-2) [    x:collection2] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection2/data/index/
   [junit4]   2> 314588 WARN  (coreLoadExecutor-823-thread-2) [    x:collection2] o.a.s.c.SolrCore [collection2] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection2/data/index' doesn't exist. Creating new index...
   [junit4]   2> 314588 INFO  (coreLoadExecutor-823-thread-2) [    x:collection2] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection2/data/index
   [junit4]   2> 314588 INFO  (coreLoadExecutor-823-thread-2) [    x:collection2] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=48, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5745080320822264]
   [junit4]   2> 314588 INFO  (coreLoadExecutor-823-thread-2) [    x:collection2] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@2cb18f19 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@287eded8),segFN=segments_1,generation=1}
   [junit4]   2> 314588 INFO  (coreLoadExecutor-823-thread-2) [    x:collection2] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 314590 INFO  (coreLoadExecutor-823-thread-2) [    x:collection2] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 314590 INFO  (coreLoadExecutor-823-thread-3) [    ] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 314591 INFO  (coreLoadExecutor-823-thread-2) [    x:collection2] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 314591 INFO  (coreLoadExecutor-823-thread-2) [    x:collection2] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 314592 INFO  (coreLoadExecutor-823-thread-2) [    x:collection2] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 314592 INFO  (coreLoadExecutor-823-thread-2) [    x:collection2] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 314593 INFO  (coreLoadExecutor-823-thread-2) [    x:collection2] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/select,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/ping,/admin/threads,/update,/admin/file
   [junit4]   2> 314593 INFO  (coreLoadExecutor-823-thread-2) [    x:collection2] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 314593 INFO  (OldIndexDirectoryCleanupThreadForCore-collection2) [    x:collection2] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection2 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection2/data/
   [junit4]   2> 314594 WARN  (OldIndexDirectoryCleanupThreadForCore-collection2) [    x:collection2] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection2/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 314594 INFO  (coreLoadExecutor-823-thread-3) [    ] o.a.s.s.IndexSchema [collection5] Schema name=tiny
   [junit4]   2> 314598 INFO  (coreLoadExecutor-823-thread-3) [    ] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 314598 INFO  (coreLoadExecutor-823-thread-3) [    ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection5'
   [junit4]   2> 314598 INFO  (coreLoadExecutor-823-thread-3) [    ] o.a.s.c.CoreContainer Creating SolrCore 'collection5' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection5
   [junit4]   2> 314599 INFO  (coreLoadExecutor-823-thread-3) [    x:collection5] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 314599 INFO  (coreLoadExecutor-823-thread-3) [    x:collection5] o.a.s.c.SolrCore [[collection5] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection5], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection5/data/]
   [junit4]   2> 314599 INFO  (coreLoadExecutor-823-thread-3) [    x:collection5] o.a.s.c.SolrCore JMX monitoring not detected for core: collection5
   [junit4]   2> 314599 INFO  (coreLoadExecutor-823-thread-3) [    x:collection5] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection5/data
   [junit4]   2> 314600 INFO  (coreLoadExecutor-823-thread-1) [    ] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 314600 INFO  (coreLoadExecutor-823-thread-1) [    ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection1'
   [junit4]   2> 314600 INFO  (coreLoadExecutor-823-thread-1) [    ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection1
   [junit4]   2> 314600 INFO  (coreLoadExecutor-823-thread-1) [    x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 314601 INFO  (coreLoadExecutor-823-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection1/data/]
   [junit4]   2> 314601 INFO  (coreLoadExecutor-823-thread-1) [    x:collection1] o.a.s.c.SolrCore JMX monitoring not detected for core: collection1
   [junit4]   2> 314601 INFO  (coreLoadExecutor-823-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection1/data
   [junit4]   2> 314601 INFO  (coreLoadExecutor-823-thread-3) [    x:collection5] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection5/data/index/
   [junit4]   2> 314601 WARN  (coreLoadExecutor-823-thread-3) [    x:collection5] o.a.s.c.SolrCore [collection5] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection5/data/index' doesn't exist. Creating new index...
   [junit4]   2> 314601 INFO  (coreLoadExecutor-823-thread-3) [    x:collection5] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection5/data/index
   [junit4]   2> 314601 INFO  (coreLoadExecutor-823-thread-3) [    x:collection5] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=48, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5745080320822264]
   [junit4]   2> 314601 INFO  (coreLoadExecutor-823-thread-1) [    x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection1/data/index/
   [junit4]   2> 314601 WARN  (coreLoadExecutor-823-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 314602 INFO  (coreLoadExecutor-823-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection1/data/index
   [junit4]   2> 314602 INFO  (coreLoadExecutor-823-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=48, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5745080320822264]
   [junit4]   2> 314609 INFO  (coreLoadExecutor-823-thread-2) [    x:collection2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 314609 INFO  (coreLoadExecutor-823-thread-2) [    x:collection2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 314610 INFO  (coreLoadExecutor-823-thread-2) [    x:collection2] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=66.62109375, floorSegmentMB=0.7412109375, forceMergeDeletesPctAllowed=5.9749367267994895, segmentsPerTier=24.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 314610 INFO  (coreLoadExecutor-823-thread-2) [    x:collection2] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@2cb18f19 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@287eded8),segFN=segments_1,generation=1}
   [junit4]   2> 314611 INFO  (coreLoadExecutor-823-thread-2) [    x:collection2] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 314611 INFO  (coreLoadExecutor-823-thread-2) [    x:collection2] o.a.s.s.SolrIndexSearcher Opening [Searcher@703f0194[collection2] main]
   [junit4]   2> 314611 INFO  (coreLoadExecutor-823-thread-2) [    x:collection2] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection2/conf
   [junit4]   2> 314611 INFO  (coreLoadExecutor-823-thread-2) [    x:collection2] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection2/conf}
   [junit4]   2> 314611 INFO  (coreLoadExecutor-823-thread-2) [    x:collection2] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection2/conf
   [junit4]   2> 314611 INFO  (coreLoadExecutor-823-thread-2) [    x:collection2] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 314611 INFO  (coreLoadExecutor-823-thread-2) [    x:collection2] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 314611 INFO  (coreLoadExecutor-823-thread-2) [    x:collection2] o.a.s.c.SolrCores Opening transient core collection2
   [junit4]   2> 314611 INFO  (coreLoadExecutor-823-thread-2) [    x:collection2] o.a.s.c.CoreContainer registering core: collection2
   [junit4]   2> 314612 INFO  (searcherExecutor-824-thread-1-processing-x:collection2) [    x:collection2] o.a.s.c.SolrCore [collection2] Registered new searcher Searcher@703f0194[collection2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 314612 INFO  (coreLoadExecutor-823-thread-3) [    x:collection5] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@566e5720 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2f05f9a0),segFN=segments_1,generation=1}
   [junit4]   2> 314612 INFO  (coreLoadExecutor-823-thread-3) [    x:collection5] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 314612 INFO  (coreLoadExecutor-823-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@3ab48e8 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4226d1be),segFN=segments_1,generation=1}
   [junit4]   2> 314612 INFO  (coreLoadExecutor-823-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 314613 INFO  (coreLoadExecutor-823-thread-3) [    x:collection5] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 314614 INFO  (coreLoadExecutor-823-thread-3) [    x:collection5] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 314615 INFO  (coreLoadExecutor-823-thread-3) [    x:collection5] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 314615 INFO  (coreLoadExecutor-823-thread-3) [    x:collection5] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 314616 INFO  (coreLoadExecutor-823-thread-3) [    x:collection5] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 314617 INFO  (coreLoadExecutor-823-thread-3) [    x:collection5] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/select,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/ping,/admin/threads,/update,/admin/file
   [junit4]   2> 314617 INFO  (coreLoadExecutor-823-thread-3) [    x:collection5] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 314617 INFO  (OldIndexDirectoryCleanupThreadForCore-collection5) [    x:collection5] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection5 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection5/data/
   [junit4]   2> 314617 INFO  (coreLoadExecutor-823-thread-3) [    x:collection5] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 314617 INFO  (coreLoadExecutor-823-thread-3) [    x:collection5] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 314617 WARN  (OldIndexDirectoryCleanupThreadForCore-collection5) [    x:collection5] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection5/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 314618 INFO  (coreLoadExecutor-823-thread-3) [    x:collection5] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=66.62109375, floorSegmentMB=0.7412109375, forceMergeDeletesPctAllowed=5.9749367267994895, segmentsPerTier=24.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 314624 INFO  (coreLoadExecutor-823-thread-3) [    x:collection5] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@566e5720 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2f05f9a0),segFN=segments_1,generation=1}
   [junit4]   2> 314624 INFO  (coreLoadExecutor-823-thread-3) [    x:collection5] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 314624 INFO  (coreLoadExecutor-823-thread-3) [    x:collection5] o.a.s.s.SolrIndexSearcher Opening [Searcher@1c773e95[collection5] main]
   [junit4]   2> 314624 INFO  (coreLoadExecutor-823-thread-3) [    x:collection5] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection5/conf
   [junit4]   2> 314624 INFO  (coreLoadExecutor-823-thread-3) [    x:collection5] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection5/conf}
   [junit4]   2> 314624 INFO  (coreLoadExecutor-823-thread-3) [    x:collection5] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection5/conf
   [junit4]   2> 314624 INFO  (coreLoadExecutor-823-thread-3) [    x:collection5] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 314624 INFO  (coreLoadExecutor-823-thread-3) [    x:collection5] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 314625 INFO  (coreLoadExecutor-823-thread-3) [    x:collection5] o.a.s.c.CoreContainer registering core: collection5
   [junit4]   2> 314625 INFO  (searcherExecutor-826-thread-1-processing-x:collection5) [    x:collection5] o.a.s.c.SolrCore [collection5] Registered new searcher Searcher@1c773e95[collection5] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 314626 INFO  (coreLoadExecutor-823-thread-1) [    x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 314627 INFO  (coreLoadExecutor-823-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 314627 INFO  (coreLoadExecutor-823-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 314632 INFO  (coreLoadExecutor-823-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 314632 INFO  (coreLoadExecutor-823-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 314633 INFO  (coreLoadExecutor-823-thread-1) [    x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/select,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/ping,/admin/threads,/update,/admin/file
   [junit4]   2> 314633 INFO  (coreLoadExecutor-823-thread-1) [    x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 314633 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [    x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection1/data/
   [junit4]   2> 314634 WARN  (OldIndexDirectoryCleanupThreadForCore-collection1) [    x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 314640 INFO  (coreLoadExecutor-823-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 314640 INFO  (coreLoadExecutor-823-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 314640 INFO  (coreLoadExecutor-823-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=66.62109375, floorSegmentMB=0.7412109375, forceMergeDeletesPctAllowed=5.9749367267994895, segmentsPerTier=24.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 314640 INFO  (coreLoadExecutor-823-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@3ab48e8 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4226d1be),segFN=segments_1,generation=1}
   [junit4]   2> 314640 INFO  (coreLoadExecutor-823-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 314640 INFO  (coreLoadExecutor-823-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6de7e5f4[collection1] main]
   [junit4]   2> 314640 INFO  (coreLoadExecutor-823-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection1/conf
   [junit4]   2> 314640 INFO  (coreLoadExecutor-823-thread-1) [    x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection1/conf}
   [junit4]   2> 314641 INFO  (coreLoadExecutor-823-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/collection1/conf
   [junit4]   2> 314641 INFO  (coreLoadExecutor-823-thread-1) [    x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 314641 INFO  (coreLoadExecutor-823-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 314641 INFO  (coreLoadExecutor-823-thread-1) [    x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 314644 INFO  (searcherExecutor-827-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@6de7e5f4[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 314648 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    ] o.a.s.h.a.CoreAdminOperation core create command loadOnStartup=true&transient=true&name=core1&action=CREATE&wt=xml
   [junit4]   2> 314648 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=core1, config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, configSetProperties=configsetprops.json, transient=true, dataDir=data/}
   [junit4]   2> 314648 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core1'
   [junit4]   2> 314648 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 314648 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 314656 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    ] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 314658 WARN  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    ] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 314658 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 314663 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    ] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 314673 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    ] o.a.s.s.IndexSchema [core1] Schema name=tiny
   [junit4]   2> 314675 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    ] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 314696 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core1'
   [junit4]   2> 314696 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    ] o.a.s.c.CoreContainer Creating SolrCore 'core1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core1
   [junit4]   2> 314696 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 314696 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.c.SolrCore [[core1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core1/data/]
   [junit4]   2> 314696 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.c.SolrCore JMX monitoring not detected for core: core1
   [junit4]   2> 314697 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core1/data
   [junit4]   2> 314697 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core1/data/index/
   [junit4]   2> 314697 WARN  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.c.SolrCore [core1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 314697 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core1/data/index
   [junit4]   2> 314697 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=35, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.31290779835953975]
   [junit4]   2> 314698 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@6c1995ff lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3e49fa16),segFN=segments_1,generation=1}
   [junit4]   2> 314698 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 314701 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 314701 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 314702 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 314702 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 314703 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 314704 INFO  (OldIndexDirectoryCleanupThreadForCore-core1) [    x:core1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core core1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core1/data/
   [junit4]   2> 314704 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/select,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/ping,/admin/threads,/update,/admin/file
   [junit4]   2> 314704 WARN  (OldIndexDirectoryCleanupThreadForCore-core1) [    x:core1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 314704 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 314708 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 314708 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 314708 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=15, maxMergeAtOnceExplicit=48, maxMergedSegmentMB=8.728515625, floorSegmentMB=1.9853515625, forceMergeDeletesPctAllowed=0.8303365534509932, segmentsPerTier=40.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 314708 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@6c1995ff lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3e49fa16),segFN=segments_1,generation=1}
   [junit4]   2> 314708 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 314708 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.s.SolrIndexSearcher Opening [Searcher@67dffcd9[core1] main]
   [junit4]   2> 314708 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core1/conf
   [junit4]   2> 314708 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core1/conf}
   [junit4]   2> 314708 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core1/conf
   [junit4]   2> 314709 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 314709 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 314709 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.c.SolrCores Opening transient core core1
   [junit4]   2> 314709 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.c.CoreContainer registering core: core1
   [junit4]   2> 314709 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.h.a.CoreAdminOperation core create command loadOnStartup=false&transient=true&name=core2&action=CREATE&wt=xml
   [junit4]   2> 314709 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=core2, config=solrconfig.xml, loadOnStartup=false, schema=schema.xml, configSetProperties=configsetprops.json, transient=true, dataDir=data/}
   [junit4]   2> 314709 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core2'
   [junit4]   2> 314709 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 314709 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 314712 INFO  (searcherExecutor-837-thread-1-processing-x:core1) [    x:core1] o.a.s.c.SolrCore [core1] Registered new searcher Searcher@67dffcd9[core1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 314713 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 314715 WARN  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 314715 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 314723 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 314725 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.s.IndexSchema [core2] Schema name=tiny
   [junit4]   2> 314736 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 314737 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core2'
   [junit4]   2> 314737 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core1] o.a.s.c.CoreContainer Creating SolrCore 'core2' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core2
   [junit4]   2> 314737 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 314737 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.c.SolrCore [[core2] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core2], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core2/data/]
   [junit4]   2> 314737 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.c.SolrCore JMX monitoring not detected for core: core2
   [junit4]   2> 314738 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core2/data
   [junit4]   2> 314740 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core2/data/index/
   [junit4]   2> 314740 WARN  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.c.SolrCore [core2] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core2/data/index' doesn't exist. Creating new index...
   [junit4]   2> 314740 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core2/data/index
   [junit4]   2> 314740 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=43, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.820767628508733]
   [junit4]   2> 314742 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@43eb9c71 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@60abee82),segFN=segments_1,generation=1}
   [junit4]   2> 314742 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 314745 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 314745 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 314746 INFO  (OldIndexDirectoryCleanupThreadForCore-core2) [    x:core2] o.a.s.c.SolrCore Looking for old index directories to cleanup for core core2 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core2/data/
   [junit4]   2> 314746 WARN  (OldIndexDirectoryCleanupThreadForCore-core2) [    x:core2] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core2/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 314751 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 314755 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 314756 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 314757 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/select,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/ping,/admin/threads,/update,/admin/file
   [junit4]   2> 314757 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 314760 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 314760 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 314760 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=17, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7499017211074636]
   [junit4]   2> 314760 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@43eb9c71 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@60abee82),segFN=segments_1,generation=1}
   [junit4]   2> 314760 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 314760 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.s.SolrIndexSearcher Opening [Searcher@bae6d4a[core2] main]
   [junit4]   2> 314760 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core2/conf
   [junit4]   2> 314760 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core2/conf}
   [junit4]   2> 314760 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core2/conf
   [junit4]   2> 314761 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 314761 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 314761 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.c.SolrCores Opening transient core core2
   [junit4]   2> 314761 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.c.CoreContainer registering core: core2
   [junit4]   2> 314761 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.h.a.CoreAdminOperation core create command loadOnStartup=true&transient=true&name=core3&action=CREATE&wt=xml
   [junit4]   2> 314761 INFO  (searcherExecutor-842-thread-1-processing-x:core2) [    x:core2] o.a.s.c.SolrCore [core2] Registered new searcher Searcher@bae6d4a[core2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 314763 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=core3, config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, configSetProperties=configsetprops.json, transient=true, dataDir=data/}
   [junit4]   2> 314763 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core3'
   [junit4]   2> 314764 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 314764 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 314767 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 314769 WARN  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 314769 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 314830 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 314832 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.s.IndexSchema [core3] Schema name=tiny
   [junit4]   2> 314834 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 314835 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core3'
   [junit4]   2> 314835 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core2] o.a.s.c.CoreContainer Creating SolrCore 'core3' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core3
   [junit4]   2> 314835 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 314835 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.c.SolrCore [[core3] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core3], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core3/data/]
   [junit4]   2> 314836 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.c.SolrCore JMX monitoring not detected for core: core3
   [junit4]   2> 314836 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core3/data
   [junit4]   2> 314836 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core3/data/index/
   [junit4]   2> 314836 WARN  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.c.SolrCore [core3] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core3/data/index' doesn't exist. Creating new index...
   [junit4]   2> 314836 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core3/data/index
   [junit4]   2> 314837 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=26, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=90.09765625, floorSegmentMB=1.462890625, forceMergeDeletesPctAllowed=23.473798088106133, segmentsPerTier=31.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.31615081375106274
   [junit4]   2> 314837 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@483183fc lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@688c57eb),segFN=segments_1,generation=1}
   [junit4]   2> 314837 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 314839 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 314839 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 314840 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 314840 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 314841 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 314842 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/select,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/ping,/admin/threads,/update,/admin/file
   [junit4]   2> 314842 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 314844 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 314844 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 314844 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=49, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1715183411572129]
   [junit4]   2> 314844 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@483183fc lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@688c57eb),segFN=segments_1,generation=1}
   [junit4]   2> 314844 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 314844 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.s.SolrIndexSearcher Opening [Searcher@4dbeffa8[core3] main]
   [junit4]   2> 314844 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core3/conf
   [junit4]   2> 314844 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core3/conf}
   [junit4]   2> 314844 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core3/conf
   [junit4]   2> 314845 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 314845 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 314845 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.c.SolrCores Opening transient core core3
   [junit4]   2> 314845 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.c.CoreContainer registering core: core3
   [junit4]   2> 314845 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.h.a.CoreAdminOperation core create command loadOnStartup=false&transient=true&name=core4&action=CREATE&wt=xml
   [junit4]   2> 314845 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=core4, config=solrconfig.xml, loadOnStartup=false, schema=schema.xml, configSetProperties=configsetprops.json, transient=true, dataDir=data/}
   [junit4]   2> 314845 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core4'
   [junit4]   2> 314845 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 314845 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 314850 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 314854 INFO  (OldIndexDirectoryCleanupThreadForCore-core3) [    x:core3] o.a.s.c.SolrCore Looking for old index directories to cleanup for core core3 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core3/data/
   [junit4]   2> 314854 WARN  (OldIndexDirectoryCleanupThreadForCore-core3) [    x:core3] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core3/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 314868 WARN  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 314868 INFO  (searcherExecutor-847-thread-1-processing-x:core3) [    x:core3] o.a.s.c.SolrCore [core3] Registered new searcher Searcher@4dbeffa8[core3] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 314868 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 314872 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 314874 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.s.IndexSchema [core4] Schema name=tiny
   [junit4]   2> 314876 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 314877 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core4'
   [junit4]   2> 314877 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core3] o.a.s.c.CoreContainer Creating SolrCore 'core4' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core4
   [junit4]   2> 314877 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core4] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 314877 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core4] o.a.s.c.SolrCore [[core4] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core4], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core4/data/]
   [junit4]   2> 314877 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core4] o.a.s.c.SolrCore JMX monitoring not detected for core: core4
   [junit4]   2> 314878 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core4] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core4/data
   [junit4]   2> 314878 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core4] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core4/data/index/
   [junit4]   2> 314878 WARN  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core4] o.a.s.c.SolrCore [core4] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core4/data/index' doesn't exist. Creating new index...
   [junit4]   2> 314878 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core4] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core4/data/index
   [junit4]   2> 314879 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core4] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=27, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=27.3310546875, floorSegmentMB=0.671875, forceMergeDeletesPctAllowed=1.6922200706090729, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 314879 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core4] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@8e4ef03 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@ac8bb6f),segFN=segments_1,generation=1}
   [junit4]   2> 314879 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core4] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 314888 INFO  (OldIndexDirectoryCleanupThreadForCore-core4) [    x:core4] o.a.s.c.SolrCore Looking for old index directories to cleanup for core core4 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core4/data/
   [junit4]   2> 314888 WARN  (OldIndexDirectoryCleanupThreadForCore-core4) [    x:core4] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.core.TestLazyCores_6F9D598323A0D2E7-001/tempDir-001/core4/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 314896 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core4] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 314897 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core4] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 314898 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core4] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 314898 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core4] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 314899 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core4] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 314900 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core4] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/select,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/ping,/admin/threads,/update,/admin/file
   [junit4]   2> 314900 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core4] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 314904 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 314904 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 314908 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core4] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=80.583984375, floorSegmentMB=2.08203125, forceMergeDeletesPctAllowed=20.105408655983435, segmentsPerTier=16.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 314908 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core4] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@8e4ef03 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@ac8bb6f),segFN=segments_1,generation=1}
   [junit4]   2> 314908 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core4] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 314908 INFO  (TEST-TestLazyCores.testCreateTransientFromAdmin-seed#[6F9D598323A0D2E7]) [    x:core4] o.a.s.s.SolrIndexSearcher Opening [Searcher@179dc0fd[core4]

[...truncated too long message...]

nit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException
   [junit4]   2> 	at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
   [junit4]   2> 	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:347)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:294)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:512)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:719)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:646)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:815)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.access$000(CoreContainer.java:88)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:468)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:459)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> Mar 30, 2016 4:20:49 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> Mar 30, 2016 4:21:09 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.core.TestLazyCores: 
   [junit4]   2>    1) Thread[id=1749, name=searcherExecutor-924-thread-1, state=WAITING, group=TGRP-TestLazyCores]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Mar 30, 2016 4:21:09 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=1749, name=searcherExecutor-924-thread-1, state=WAITING, group=TGRP-TestLazyCores]
   [junit4]   2> Mar 30, 2016 4:21:12 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> SEVERE: There are still zombie threads that couldn't be terminated:
   [junit4]   2>    1) Thread[id=1749, name=searcherExecutor-924-thread-1, state=WAITING, group=TGRP-TestLazyCores]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2>         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarity(queryNorm=false,coord=yes): {}, locale=pt-BR, timezone=Asia/Tokyo
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=2,free=297963800,total=475004928
   [junit4]   2> NOTE: All tests run in this JVM: [BasicDistributedZkTest, DistributedFacetPivotWhiteBoxTest, TriLevelCompositeIdRoutingTest, UUIDUpdateProcessorFallbackTest, TestStressUserVersions, ResponseLogComponentTest, CoreAdminCreateDiscoverTest, ExplicitHLLTest, TestCustomDocTransformer, ConnectionReuseTest, TestManagedStopFilterFactory, TestStressLucene, SynonymTokenizerTest, TestRealTimeGet, TestConfig, RAMDirectoryFactoryTest, TestPseudoReturnFields, LeaderInitiatedRecoveryOnShardRestartTest, TestValueSourceCache, TestReplicationHandlerBackup, CursorPagingTest, DistributedSuggestComponentTest, ExternalFileFieldSortTest, TestAtomicUpdateErrorCases, TestExclusionRuleCollectionAccess, TestLazyCores]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestLazyCores -Dtests.seed=6F9D598323A0D2E7 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=pt-BR -Dtests.timezone=Asia/Tokyo -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   0.00s J0 | TestLazyCores (suite) <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: ObjectTracker found 4 object(s) that were not released!!! [MockDirectoryWrapper, SolrCore, MDCAwareThreadPoolExecutor, MockDirectoryWrapper]
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([6F9D598323A0D2E7]:0)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:238)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.core.TestLazyCores: 
   [junit4]    >    1) Thread[id=1749, name=searcherExecutor-924-thread-1, state=WAITING, group=TGRP-TestLazyCores]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([6F9D598323A0D2E7]:0)Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=1749, name=searcherExecutor-924-thread-1, state=WAITING, group=TGRP-TestLazyCores]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([6F9D598323A0D2E7]:0)
   [junit4] Completed [94/584 (1!)] on J0 in 157.38s, 8 tests, 1 failure, 2 errors <<< FAILURES!

[...truncated 1587 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:740: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:684: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/common-build.xml:529: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/common-build.xml:1457: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/common-build.xml:1014: There were test failures: 584 suites (10 ignored), 2357 tests, 3 suite-level errors, 1496 ignored (66 assumptions) [seed: 6F9D598323A0D2E7]

Total time: 67 minutes 7 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any




[JENKINS] Lucene-Solr-Tests-master - Build # 1054 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/1054/

1 tests failed.
FAILED:  org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy

Error Message:
Could not find collection : c1

Stack Trace:
org.apache.solr.common.SolrException: Could not find collection : c1
	at __randomizedtesting.SeedInfo.seed([AB664A3E51000B78:C029EA43280FD642]:0)
	at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:170)
	at org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdate(ZkStateReaderTest.java:134)
	at org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy(ZkStateReaderTest.java:45)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 10846 lines...]
   [junit4] Suite: org.apache.solr.cloud.overseer.ZkStateReaderTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.overseer.ZkStateReaderTest_AB664A3E51000B78-001/init-core-data-001
   [junit4]   2> 400258 INFO  (SUITE-ZkStateReaderTest-seed#[AB664A3E51000B78]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false)
   [junit4]   2> 400262 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[AB664A3E51000B78]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testExternalCollectionWatchedNotWatched
   [junit4]   2> 400263 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[AB664A3E51000B78]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 400271 INFO  (Thread-803) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 400271 INFO  (Thread-803) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 400367 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[AB664A3E51000B78]) [    ] o.a.s.c.ZkTestServer start zk server on port:42811
   [junit4]   2> 400368 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 400387 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 400514 INFO  (zkCallback-168-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@79acf2d3 name:ZooKeeperConnection Watcher:127.0.0.1:42811 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 400514 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 400514 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 400528 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 400531 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 400567 INFO  (zkCallback-169-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@574eab36 name:ZooKeeperConnection Watcher:127.0.0.1:42811 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 400567 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 400567 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 400567 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 400574 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 400574 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 400575 INFO  (zkCallback-170-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@772851d8 name:ZooKeeperConnection Watcher:127.0.0.1:42811/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 400575 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 400576 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 400576 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 400577 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 400578 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 400581 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 400581 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 400582 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 400583 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 400584 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 400584 INFO  (zkCallback-170-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 400585 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[AB664A3E51000B78]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 400585 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ZkStateReader addZkWatch [c1]
   [junit4]   2> 400586 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ZkStateReader Add data for [c1] ver [0]
   [junit4]   2> 400586 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ZkStateReader Removing watch for uninteresting collection [c1]
   [junit4]   2> 400589 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[AB664A3E51000B78]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:42811 42811
   [junit4]   2> 400943 INFO  (Thread-803) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:42811 42811
   [junit4]   2> 400955 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[AB664A3E51000B78]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testExternalCollectionWatchedNotWatched
   [junit4]   2> 400959 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[AB664A3E51000B78]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testStateFormatUpdateWithTimeDelay
   [junit4]   2> 400960 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[AB664A3E51000B78]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 400971 INFO  (Thread-804) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 400971 INFO  (Thread-804) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 401209 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[AB664A3E51000B78]) [    ] o.a.s.c.ZkTestServer start zk server on port:33868
   [junit4]   2> 401209 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 401212 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 401235 INFO  (zkCallback-171-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4af9cbc2 name:ZooKeeperConnection Watcher:127.0.0.1:33868 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 401239 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 401239 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 401271 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 401272 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 401278 INFO  (zkCallback-172-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2da275a8 name:ZooKeeperConnection Watcher:127.0.0.1:33868 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 401278 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 401278 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 401278 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 401281 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 401281 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 401282 INFO  (zkCallback-173-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@f306215 name:ZooKeeperConnection Watcher:127.0.0.1:33868/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 401282 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 401283 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 401283 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 401292 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 401292 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 401293 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 401294 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 401296 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 401297 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 401298 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ZkStateReader addZkWatch [c1]
   [junit4]   2> 401298 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 401298 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 401298 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 401300 INFO  (zkCallback-173-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 401301 INFO  (zkCallback-173-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 401301 INFO  (zkCallback-173-thread-1) [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 401306 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[AB664A3E51000B78]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 401307 INFO  (zkCallback-173-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 401309 INFO  (zkCallback-173-thread-2) [    ] o.a.s.c.c.ZkStateReader Add data for [c1] ver [0]
   [junit4]   2> 401371 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[AB664A3E51000B78]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:33868 33868
   [junit4]   2> 401595 INFO  (Thread-804) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:33868 33868
   [junit4]   2> 401607 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[AB664A3E51000B78]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testStateFormatUpdateWithTimeDelay
   [junit4]   2> 401631 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testStateFormatUpdateWithTimeDelayLazy
   [junit4]   2> 401631 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 401639 INFO  (Thread-805) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 401639 INFO  (Thread-805) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 401735 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.ZkTestServer start zk server on port:59107
   [junit4]   2> 401735 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 401751 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 401786 INFO  (zkCallback-174-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@38d03404 name:ZooKeeperConnection Watcher:127.0.0.1:59107 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 401786 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 401787 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 401795 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 401800 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 401809 INFO  (zkCallback-175-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@8794fc7 name:ZooKeeperConnection Watcher:127.0.0.1:59107 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 401809 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 401809 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 401809 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 401811 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 401812 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 401813 INFO  (zkCallback-176-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@14e2b44e name:ZooKeeperConnection Watcher:127.0.0.1:59107/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 401813 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 401813 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 401814 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 401815 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 401815 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 401816 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 401821 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 401821 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 401822 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 401822 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 401823 INFO  (zkCallback-176-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 401824 INFO  (zkCallback-176-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 401825 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 401826 INFO  (zkCallback-176-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 401834 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:59107 59107
   [junit4]   2> 402110 INFO  (Thread-805) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:59107 59107
   [junit4]   2> 402112 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testStateFormatUpdateWithTimeDelayLazy
   [junit4]   2> 402121 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[AB664A3E51000B78]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testStateFormatUpdateWithExplicitRefresh
   [junit4]   2> 402122 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[AB664A3E51000B78]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 402122 INFO  (Thread-806) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 402122 INFO  (Thread-806) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 402223 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[AB664A3E51000B78]) [    ] o.a.s.c.ZkTestServer start zk server on port:46570
   [junit4]   2> 402223 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 402227 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 402263 INFO  (zkCallback-177-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@fb694a1 name:ZooKeeperConnection Watcher:127.0.0.1:46570 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 402263 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 402263 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 402268 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 402287 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 402319 INFO  (zkCallback-178-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@507f0aea name:ZooKeeperConnection Watcher:127.0.0.1:46570 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 402323 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 402323 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 402323 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 402372 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 402383 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 402403 INFO  (zkCallback-179-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6e7cde99 name:ZooKeeperConnection Watcher:127.0.0.1:46570/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 402407 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 402407 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 402415 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 402416 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 402416 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 402417 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 402417 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 402418 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 402418 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 402419 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ZkStateReader addZkWatch [c1]
   [junit4]   2> 402419 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 402419 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 402419 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 402421 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[AB664A3E51000B78]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 402421 INFO  (zkCallback-179-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 402422 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ZkStateReader Add data for [c1] ver [0]
   [junit4]   2> 402434 INFO  (zkCallback-179-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 402434 WARN  (zkCallback-179-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /collections]
   [junit4]   2> 402435 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[AB664A3E51000B78]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46570 46570
   [junit4]   2> 402667 INFO  (Thread-806) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46570 46570
   [junit4]   2> 402668 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[AB664A3E51000B78]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testStateFormatUpdateWithExplicitRefresh
   [junit4]   2> 402670 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testStateFormatUpdateWithExplicitRefreshLazy
   [junit4]   2> 402670 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 402671 INFO  (Thread-807) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 402671 INFO  (Thread-807) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 402775 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.ZkTestServer start zk server on port:55569
   [junit4]   2> 402775 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 402783 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 402795 INFO  (zkCallback-180-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4f072298 name:ZooKeeperConnection Watcher:127.0.0.1:55569 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 402795 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 402795 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 402797 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x153dbb948fd0000, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 402798 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 402799 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 402802 INFO  (zkCallback-181-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7e38d5b3 name:ZooKeeperConnection Watcher:127.0.0.1:55569 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 402802 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 402802 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 402802 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 402804 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 402809 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 402875 INFO  (zkCallback-182-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1709caf6 name:ZooKeeperConnection Watcher:127.0.0.1:55569/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 402875 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 402875 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 402883 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 402909 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 402909 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 402910 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 402911 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 402915 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 402915 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 402916 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 402917 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 402931 ERROR (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[AB664A3E51000B78]-EventThread) [    ] o.a.z.ClientCnxn Error while calling watcher 
   [junit4]   2> java.util.concurrent.RejectedExecutionException: Task org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$5/313611347@43833516 rejected from org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@47bca9be[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 1]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:214)
   [junit4]   2> 	at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:266)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 402931 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:55569 55569
   [junit4]   2> 402935 ERROR (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[AB664A3E51000B78]-EventThread) [    ] o.a.z.ClientCnxn Error while calling watcher 
   [junit4]   2> java.util.concurrent.RejectedExecutionException: Task org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$5/313611347@6987cf06 rejected from org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@47bca9be[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 1]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:214)
   [junit4]   2> 	at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:266)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 403184 INFO  (Thread-807) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:55569 55569
   [junit4]   2> 403185 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[AB664A3E51000B78]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testStateFormatUpdateWithExplicitRefreshLazy
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ZkStateReaderTest -Dtests.method=testStateFormatUpdateWithExplicitRefreshLazy -Dtests.seed=AB664A3E51000B78 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=es-GT -Dtests.timezone=Europe/Vaduz -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.52s J0 | ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy <<<
   [junit4]    > Throwable #1: org.apache.solr.common.SolrException: Could not find collection : c1
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([AB664A3E51000B78:C029EA43280FD642]:0)
   [junit4]    > 	at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:170)
   [junit4]    > 	at org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdate(ZkStateReaderTest.java:134)
   [junit4]    > 	at org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy(ZkStateReaderTest.java:45)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 403191 INFO  (SUITE-ZkStateReaderTest-seed#[AB664A3E51000B78]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.overseer.ZkStateReaderTest_AB664A3E51000B78-001
   [junit4]   2> NOTE: test params are: codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY, chunkSize=5, maxDocsPerChunk=820, blockSize=531), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, chunkSize=5, blockSize=531)), sim=RandomSimilarity(queryNorm=true,coord=no): {}, locale=es-GT, timezone=Europe/Vaduz
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=1,free=144655832,total=402128896
   [junit4]   2> NOTE: All tests run in this JVM: [SOLR749Test, TestRTGBase, TestReplicationHandler, TestMissingGroups, HdfsBasicDistributedZkTest, TestCrossCoreJoin, DistributedDebugComponentTest, PeerSyncTest, TestRandomDVFaceting, URLClassifyProcessorTest, TestCollationFieldDocValues, HttpPartitionTest, TestJsonFacets, TestArbitraryIndexDir, SaslZkACLProviderTest, ZkStateReaderTest]
   [junit4] Completed [71/584 (1!)] on J0 in 2.99s, 5 tests, 1 error <<< FAILURES!

[...truncated 1669 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:740: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:684: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/common-build.xml:529: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/common-build.xml:1457: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/common-build.xml:1014: There were test failures: 584 suites (10 ignored), 2353 tests, 1 error, 85 ignored (70 assumptions) [seed: AB664A3E51000B78]

Total time: 96 minutes 56 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any




[JENKINS] Lucene-Solr-Tests-master - Build # 1053 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/1053/

1 tests failed.
FAILED:  org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy

Error Message:
Could not find collection : c1

Stack Trace:
org.apache.solr.common.SolrException: Could not find collection : c1
	at __randomizedtesting.SeedInfo.seed([B08E5AB945512750:DBC1FAC43C5EFA6A]:0)
	at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:170)
	at org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdate(ZkStateReaderTest.java:134)
	at org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy(ZkStateReaderTest.java:45)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 12142 lines...]
   [junit4] Suite: org.apache.solr.cloud.overseer.ZkStateReaderTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.overseer.ZkStateReaderTest_B08E5AB945512750-001/init-core-data-001
   [junit4]   2> 2405163 INFO  (SUITE-ZkStateReaderTest-seed#[B08E5AB945512750]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true)
   [junit4]   2> 2405175 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B08E5AB945512750]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testStateFormatUpdateWithExplicitRefresh
   [junit4]   2> 2405176 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B08E5AB945512750]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2405176 INFO  (Thread-3888) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2405176 INFO  (Thread-3888) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2405277 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B08E5AB945512750]) [    ] o.a.s.c.ZkTestServer start zk server on port:44527
   [junit4]   2> 2405277 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2405285 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2405305 INFO  (zkCallback-1723-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6b03220a name:ZooKeeperConnection Watcher:127.0.0.1:44527 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2405305 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2405305 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2405319 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2405329 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2405345 INFO  (zkCallback-1724-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2330d30e name:ZooKeeperConnection Watcher:127.0.0.1:44527 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2405349 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2405349 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2405349 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 2405366 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2405366 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2405367 INFO  (zkCallback-1725-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4497615e name:ZooKeeperConnection Watcher:127.0.0.1:44527/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2405367 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2405367 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2405368 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 2405369 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 2405370 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 2405371 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 2405377 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 2405385 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 2405393 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 2405393 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ZkStateReader addZkWatch [c1]
   [junit4]   2> 2405394 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 2405394 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 2405394 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 2405395 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B08E5AB945512750]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 2405396 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ZkStateReader Add data for [c1] ver [0]
   [junit4]   2> 2405396 ERROR (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B08E5AB945512750]-EventThread) [    ] o.a.z.ClientCnxn Error while calling watcher 
   [junit4]   2> java.util.concurrent.RejectedExecutionException: Task org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$5/439641745@4e4ee7fe rejected from org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@4a716aef[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 1]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:214)
   [junit4]   2> 	at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:266)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 2405397 ERROR (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B08E5AB945512750]-EventThread) [    ] o.a.z.ClientCnxn Error while calling watcher 
   [junit4]   2> java.util.concurrent.RejectedExecutionException: Task org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$5/439641745@77e904d rejected from org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@4a716aef[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 1]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:214)
   [junit4]   2> 	at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:266)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 2405404 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B08E5AB945512750]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:44527 44527
   [junit4]   2> 2405629 INFO  (Thread-3888) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:44527 44527
   [junit4]   2> 2405637 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B08E5AB945512750]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testStateFormatUpdateWithExplicitRefresh
   [junit4]   2> 2405657 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B08E5AB945512750]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testStateFormatUpdateWithTimeDelay
   [junit4]   2> 2405657 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B08E5AB945512750]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2405658 INFO  (Thread-3889) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2405658 INFO  (Thread-3889) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2405758 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B08E5AB945512750]) [    ] o.a.s.c.ZkTestServer start zk server on port:56511
   [junit4]   2> 2405758 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2405759 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2405761 INFO  (zkCallback-1726-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4edd2677 name:ZooKeeperConnection Watcher:127.0.0.1:56511 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2405761 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2405761 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2405762 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2405763 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2405765 INFO  (zkCallback-1727-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@51412367 name:ZooKeeperConnection Watcher:127.0.0.1:56511 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2405765 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2405765 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2405766 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 2405768 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2405768 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2405769 INFO  (zkCallback-1728-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@563e20af name:ZooKeeperConnection Watcher:127.0.0.1:56511/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2405769 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2405770 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2405770 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 2405771 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 2405772 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 2405773 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 2405774 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 2405775 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 2405776 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 2405776 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ZkStateReader addZkWatch [c1]
   [junit4]   2> 2405776 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 2405777 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 2405777 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 2405777 INFO  (zkCallback-1728-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 2405778 INFO  (zkCallback-1728-thread-1) [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 2405778 INFO  (zkCallback-1728-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 2405845 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B08E5AB945512750]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 2405865 INFO  (zkCallback-1728-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 2406019 INFO  (zkCallback-1728-thread-2) [    ] o.a.s.c.c.ZkStateReader Add data for [c1] ver [0]
   [junit4]   2> 2406071 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B08E5AB945512750]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:56511 56511
   [junit4]   2> 2406337 INFO  (Thread-3889) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:56511 56511
   [junit4]   2> 2406338 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B08E5AB945512750]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testStateFormatUpdateWithTimeDelay
   [junit4]   2> 2406340 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B08E5AB945512750]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testStateFormatUpdateWithExplicitRefreshLazy
   [junit4]   2> 2406341 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2406353 INFO  (Thread-3890) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2406353 INFO  (Thread-3890) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2406474 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.ZkTestServer start zk server on port:47790
   [junit4]   2> 2406474 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2406520 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2406533 INFO  (zkCallback-1729-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2a11ec9c name:ZooKeeperConnection Watcher:127.0.0.1:47790 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2406537 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2406537 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2406538 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2406539 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2406552 INFO  (zkCallback-1730-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@47ce7f1 name:ZooKeeperConnection Watcher:127.0.0.1:47790 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2406552 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2406552 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2406552 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 2406566 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2406567 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2406569 INFO  (zkCallback-1731-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7c5d6e86 name:ZooKeeperConnection Watcher:127.0.0.1:47790/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2406569 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2406586 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2406586 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 2406587 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 2406588 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 2406589 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 2406589 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 2406589 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 2406590 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 2406590 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 2406591 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 2406592 INFO  (zkCallback-1731-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 2406593 WARN  (zkCallback-1731-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /collections]
   [junit4]   2> 2406600 INFO  (zkCallback-1731-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 2406600 WARN  (zkCallback-1731-thread-2) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /clusterstate.json]
   [junit4]   2> 2406601 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:47790 47790
   [junit4]   2> 2406756 INFO  (Thread-3890) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:47790 47790
   [junit4]   2> 2406758 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B08E5AB945512750]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testStateFormatUpdateWithExplicitRefreshLazy
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ZkStateReaderTest -Dtests.method=testStateFormatUpdateWithExplicitRefreshLazy -Dtests.seed=B08E5AB945512750 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=bg -Dtests.timezone=Egypt -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.42s J2 | ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy <<<
   [junit4]    > Throwable #1: org.apache.solr.common.SolrException: Could not find collection : c1
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([B08E5AB945512750:DBC1FAC43C5EFA6A]:0)
   [junit4]    > 	at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:170)
   [junit4]    > 	at org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdate(ZkStateReaderTest.java:134)
   [junit4]    > 	at org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy(ZkStateReaderTest.java:45)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 2406767 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B08E5AB945512750]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testStateFormatUpdateWithTimeDelayLazy
   [junit4]   2> 2406767 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2406769 INFO  (Thread-3891) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2406769 INFO  (Thread-3891) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2406869 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.ZkTestServer start zk server on port:56614
   [junit4]   2> 2406869 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2406870 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2406901 INFO  (zkCallback-1732-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4a3195e7 name:ZooKeeperConnection Watcher:127.0.0.1:56614 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2406901 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2406901 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2406921 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2406929 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2406941 INFO  (zkCallback-1733-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3d07d0b8 name:ZooKeeperConnection Watcher:127.0.0.1:56614 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2406941 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2406942 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2406942 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 2407029 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2407037 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2407061 INFO  (zkCallback-1734-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@38de6b2b name:ZooKeeperConnection Watcher:127.0.0.1:56614/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2407061 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2407061 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2407069 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 2407087 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 2407088 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 2407090 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 2407091 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 2407091 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 2407092 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 2407092 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 2407093 INFO  (zkCallback-1734-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 2407093 INFO  (zkCallback-1734-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 2407094 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 2407094 INFO  (zkCallback-1734-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 2407097 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B08E5AB945512750]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:56614 56614
   [junit4]   2> 2407572 INFO  (Thread-3891) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:56614 56614
   [junit4]   2> 2407578 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B08E5AB945512750]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testStateFormatUpdateWithTimeDelayLazy
   [junit4]   2> 2407583 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B08E5AB945512750]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testExternalCollectionWatchedNotWatched
   [junit4]   2> 2407589 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B08E5AB945512750]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2407601 INFO  (Thread-3892) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2407601 INFO  (Thread-3892) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2407701 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B08E5AB945512750]) [    ] o.a.s.c.ZkTestServer start zk server on port:54654
   [junit4]   2> 2407701 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2407713 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2407725 INFO  (zkCallback-1735-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@508c0750 name:ZooKeeperConnection Watcher:127.0.0.1:54654 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2407726 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2407726 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2407729 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2407730 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2407730 INFO  (zkCallback-1736-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7d806832 name:ZooKeeperConnection Watcher:127.0.0.1:54654 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2407730 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2407731 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2407731 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 2407732 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2407732 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2407733 INFO  (zkCallback-1737-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@62a7f901 name:ZooKeeperConnection Watcher:127.0.0.1:54654/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2407733 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2407733 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2407733 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 2407734 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 2407735 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 2407735 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 2407736 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 2407736 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 2407737 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 2407737 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 2407737 INFO  (zkCallback-1737-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 2407738 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B08E5AB945512750]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 2407738 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ZkStateReader addZkWatch [c1]
   [junit4]   2> 2407738 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ZkStateReader Add data for [c1] ver [0]
   [junit4]   2> 2407738 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B08E5AB945512750]) [    ] o.a.s.c.c.ZkStateReader Removing watch for uninteresting collection [c1]
   [junit4]   2> 2407739 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B08E5AB945512750]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:54654 54654
   [junit4]   2> 2407930 INFO  (Thread-3892) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:54654 54654
   [junit4]   2> 2407932 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B08E5AB945512750]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testExternalCollectionWatchedNotWatched
   [junit4]   2> 2407932 INFO  (SUITE-ZkStateReaderTest-seed#[B08E5AB945512750]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.overseer.ZkStateReaderTest_B08E5AB945512750-001
   [junit4]   2> Apr 02, 2016 5:49:44 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene60): {}, docValues:{}, maxPointsInLeafNode=1277, maxMBSortInHeap=4.875463942588656, sim=RandomSimilarity(queryNorm=false,coord=no): {}, locale=bg, timezone=Egypt
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=1,free=232235528,total=524288000
   [junit4]   2> NOTE: All tests run in this JVM: [TestDistributedStatsComponentCardinality, FieldMutatingUpdateProcessorTest, TestXIncludeConfig, TestXmlQParser, OverseerTest, SolrCoreCheckLockOnStartupTest, TestAddFieldRealTimeGet, TestIndexSearcher, TestSolrDeletionPolicy1, WrapperMergePolicyFactoryTest, TestJettySolrRunner, TestFuzzyAnalyzedSuggestions, NoCacheHeaderTest, TestSolrIndexConfig, SSLMigrationTest, BadCopyFieldTest, TestCopyFieldCollectionResource, TestObjectReleaseTracker, TestMaxScoreQueryParser, TestCollationField, TestExceedMaxTermLength, DirectUpdateHandlerOptimizeTest, DistributedQueryComponentOptimizationTest, LukeRequestHandlerTest, CdcrUpdateLogTest, TestShardHandlerFactory, TestPHPSerializedResponseWriter, TestRestManager, TestClassicSimilarityFactory, SearchHandlerTest, SimpleFacetsTest, HdfsLockFactoryTest, TestJmxIntegration, TestCharFilters, TestIndexingPerformance, HdfsBasicDistributedZk2Test, CleanupOldIndexTest, BinaryUpdateRequestHandlerTest, TestDistributedMissingSort, XmlUpdateRequestHandlerTest, StatsComponentTest, UnloadDistributedZkTest, TlogReplayBufferedWhileIndexingTest, TestPerFieldSimilarityWithDefaultOverride, TestAuthorizationFramework, TestStandardQParsers, HdfsSyncSliceTest, LeaderInitiatedRecoveryOnCommitTest, TestDistribIDF, HdfsUnloadDistributedZkTest, SliceStateTest, RequestHandlersTest, TestPostingsSolrHighlighter, PrimitiveFieldTypeTest, SuggesterTSTTest, TestPerFieldSimilarity, TestFilteredDocIdSet, DateMathParserTest, CoreAdminHandlerTest, TestStressReorder, TestCloudSchemaless, HighlighterConfigTest, TestElisionMultitermQuery, SmileWriterTest, MultiThreadedOCPTest, TestOverriddenPrefixQueryForCustomFieldType, TolerantUpdateProcessorTest, CoreMergeIndexesAdminHandlerTest, TestRestoreCore, TestCSVResponseWriter, DocValuesMultiTest, BadIndexSchemaTest, DirectSolrConnectionTest, TestConfigSetsAPIZkFailure, RecoveryZkTest, RegexBoostProcessorTest, TestComplexPhraseQParserPlugin, DistribJoinFromCollectionTest, LeaderElectionTest, DebugComponentTest, ConnectionManagerTest, SolrCloudExampleTest, TestStressRecovery, TestDynamicFieldResource, TestSerializedLuceneMatchVersion, TestSuggestSpellingConverter, HardAutoCommitTest, TestFastWriter, DirectUpdateHandlerTest, TestSolrCloudWithKerberosAlt, ForceLeaderTest, TestUniqueKeyFieldResource, AutoCommitTest, TestDistributedGrouping, TestRecovery, DistributedSpellCheckComponentTest, TermVectorComponentDistributedTest, TestJoin, TestStressVersions, TestSolr4Spatial, PeerSyncTest, ShowFileRequestHandlerTest, CurrencyFieldOpenExchangeTest, DistributedQueryElevationComponentTest, SuggesterFSTTest, SuggesterTest, SpatialFilterTest, TestPseudoReturnFields, StatelessScriptUpdateProcessorFactoryTest, DocumentAnalysisRequestHandlerTest, TestOmitPositions, FieldAnalysisRequestHandlerTest, FastVectorHighlighterTest, QueryParsingTest, TestBinaryResponseWriter, UpdateParamsTest, BadComponentTest, MultiTermTest, TestSearchPerf, TestLuceneMatchVersion, SynonymTokenizerTest, TestSweetSpotSimilarityFactory, TestJmxMonitoredMap, PluginInfoTest, PreAnalyzedFieldTest, ClusterStateTest, TestRTGBase, SolrTestCaseJ4Test, TestCrossCoreJoin, TestCursorMarkWithoutUniqueKey, TestSimpleTrackingShardHandler, TestTolerantSearch, TestEmbeddedSolrServerConstructors, ActionThrottleTest, AliasIntegrationTest, CloudExitableDirectoryReaderTest, CollectionStateFormat2Test, CollectionsAPISolrJTest, DeleteLastCustomShardedReplicaTest, DeleteReplicaTest, DeleteStatusTest, DistributedQueueTest, DistributedVersionInfoTest, OverseerCollectionConfigSetProcessorTest, OverseerTaskQueueTest, RecoveryAfterSoftCommitTest, ReplicationFactorTest, RestartWhileUpdatingTest, RollingRestartTest, SharedFSAutoReplicaFailoverTest, SimpleCollectionCreateDeleteTest, SolrXmlInZkTest, TestCloudDeleteByQuery, TestCollectionAPI, TestDistribDocBasedVersion, TestLeaderInitiatedRecoveryThread, TestRandomRequestDistribution, TestReplicaProperties, TestSizeLimitedDistributedMap, HdfsChaosMonkeySafeLeaderTest, HdfsNNFailoverTest, TestClusterStateMutator, ZkStateReaderTest]
   [junit4] Completed [469/584 (1!)] on J2 in 3.07s, 5 tests, 1 error <<< FAILURES!

[...truncated 378 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:740: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:684: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/common-build.xml:529: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/common-build.xml:1457: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/common-build.xml:1014: There were test failures: 584 suites (10 ignored), 2353 tests, 1 error, 85 ignored (70 assumptions) [seed: B08E5AB945512750]

Total time: 93 minutes 10 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any




[JENKINS] Lucene-Solr-Tests-master - Build # 1052 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/1052/

3 tests failed.
FAILED:  org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.test

Error Message:
Expected 2 of 3 replicas to be active but only found 1; [core_node2:{"core":"c8n_1x3_lf_shard1_replica3","base_url":"http://127.0.0.1:54307","node_name":"127.0.0.1:54307_","state":"active","leader":"true"}]; clusterState: DocCollection(c8n_1x3_lf)={   "replicationFactor":"3",   "shards":{"shard1":{       "range":"80000000-7fffffff",       "state":"active",       "replicas":{         "core_node1":{           "state":"down",           "base_url":"http://127.0.0.1:47626",           "core":"c8n_1x3_lf_shard1_replica1",           "node_name":"127.0.0.1:47626_"},         "core_node2":{           "core":"c8n_1x3_lf_shard1_replica3",           "base_url":"http://127.0.0.1:54307",           "node_name":"127.0.0.1:54307_",           "state":"active",           "leader":"true"},         "core_node3":{           "core":"c8n_1x3_lf_shard1_replica2",           "base_url":"http://127.0.0.1:37594",           "node_name":"127.0.0.1:37594_",           "state":"down"}}}},   "router":{"name":"compositeId"},   "maxShardsPerNode":"1",   "autoAddReplicas":"false"}

Stack Trace:
java.lang.AssertionError: Expected 2 of 3 replicas to be active but only found 1; [core_node2:{"core":"c8n_1x3_lf_shard1_replica3","base_url":"http://127.0.0.1:54307","node_name":"127.0.0.1:54307_","state":"active","leader":"true"}]; clusterState: DocCollection(c8n_1x3_lf)={
  "replicationFactor":"3",
  "shards":{"shard1":{
      "range":"80000000-7fffffff",
      "state":"active",
      "replicas":{
        "core_node1":{
          "state":"down",
          "base_url":"http://127.0.0.1:47626",
          "core":"c8n_1x3_lf_shard1_replica1",
          "node_name":"127.0.0.1:47626_"},
        "core_node2":{
          "core":"c8n_1x3_lf_shard1_replica3",
          "base_url":"http://127.0.0.1:54307",
          "node_name":"127.0.0.1:54307_",
          "state":"active",
          "leader":"true"},
        "core_node3":{
          "core":"c8n_1x3_lf_shard1_replica2",
          "base_url":"http://127.0.0.1:37594",
          "node_name":"127.0.0.1:37594_",
          "state":"down"}}}},
  "router":{"name":"compositeId"},
  "maxShardsPerNode":"1",
  "autoAddReplicas":"false"}
	at __randomizedtesting.SeedInfo.seed([6340D85577954DDB:EB14E78FD9692023]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.testRf3WithLeaderFailover(LeaderFailoverAfterPartitionTest.java:168)
	at org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.test(LeaderFailoverAfterPartitionTest.java:55)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.update.AutoCommitTest.testMaxTime

Error Message:
Exception during query

Stack Trace:
java.lang.RuntimeException: Exception during query
	at __randomizedtesting.SeedInfo.seed([6340D85577954DDB:F9B4A5B7E90FD1E7]:0)
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:775)
	at org.apache.solr.update.AutoCommitTest.testMaxTime(AutoCommitTest.java:243)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=1]
	xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><result name="response" numFound="0" start="0"></result>
</response>

	request was:q=id:529&qt=standard&start=0&rows=20&version=2.2
	at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:768)
	... 40 more


FAILED:  org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy

Error Message:
Could not find collection : c1

Stack Trace:
org.apache.solr.common.SolrException: Could not find collection : c1
	at __randomizedtesting.SeedInfo.seed([6340D85577954DDB:80F78280E9A90E1]:0)
	at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:170)
	at org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdate(ZkStateReaderTest.java:135)
	at org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy(ZkStateReaderTest.java:46)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11538 lines...]
   [junit4] Suite: org.apache.solr.cloud.LeaderFailoverAfterPartitionTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderFailoverAfterPartitionTest_6340D85577954DDB-001/init-core-data-001
   [junit4]   2> 1391493 INFO  (SUITE-LeaderFailoverAfterPartitionTest-seed#[6340D85577954DDB]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 1391496 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1391496 INFO  (Thread-4576) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1391496 INFO  (Thread-4576) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1391598 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.ZkTestServer start zk server on port:44614
   [junit4]   2> 1391598 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1391607 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1391698 INFO  (zkCallback-1706-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6b800065 name:ZooKeeperConnection Watcher:127.0.0.1:44614 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1391710 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1391710 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1391710 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1391734 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1391750 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1391770 INFO  (zkCallback-1707-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6ed22400 name:ZooKeeperConnection Watcher:127.0.0.1:44614/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1391774 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1391774 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1391774 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 1391775 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 1391775 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 1391776 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 1391777 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1391777 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1391778 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1391778 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 1391779 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1391779 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1391779 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1391779 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1391780 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1391780 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1391781 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1391781 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 1391782 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1391782 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1391782 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1391782 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1391783 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1391783 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1391784 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1391784 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1391785 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1391785 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1391785 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x153d152d8cb0001, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1391865 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderFailoverAfterPartitionTest_6340D85577954DDB-001/control-001/cores/collection1
   [junit4]   2> 1391867 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 1391906 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@46540789{/,null,AVAILABLE}
   [junit4]   2> 1391906 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.e.j.s.ServerConnector Started ServerConnector@2381633b{HTTP/1.1,[http/1.1]}{127.0.0.1:51365}
   [junit4]   2> 1391906 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.e.j.s.Server Started @1398630ms
   [junit4]   2> 1391907 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderFailoverAfterPartitionTest_6340D85577954DDB-001/tempDir-001/control/data, hostContext=/, hostPort=54307, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderFailoverAfterPartitionTest_6340D85577954DDB-001/control-001/cores}
   [junit4]   2> 1391907 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 1391907 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderFailoverAfterPartitionTest_6340D85577954DDB-001/control-001'
   [junit4]   2> 1391907 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1391907 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1391907 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1391922 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1391946 INFO  (zkCallback-1708-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@53e776b4 name:ZooKeeperConnection Watcher:127.0.0.1:44614/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1391946 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1391946 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1391970 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1391970 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderFailoverAfterPartitionTest_6340D85577954DDB-001/control-001/solr.xml
   [junit4]   2> 1391973 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderFailoverAfterPartitionTest_6340D85577954DDB-001/control-001/cores
   [junit4]   2> 1391973 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.CoreContainer New CoreContainer 854924758
   [junit4]   2> 1391973 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderFailoverAfterPartitionTest_6340D85577954DDB-001/control-001]
   [junit4]   2> 1391973 WARN  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderFailoverAfterPartitionTest_6340D85577954DDB-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderFailoverAfterPartitionTest_6340D85577954DDB-001/control-001/lib
   [junit4]   2> 1391974 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1391974 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1391975 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1391975 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1391975 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44614/solr
   [junit4]   2> 1391975 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1391975 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1391990 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1391998 INFO  (zkCallback-1711-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2b93ec32 name:ZooKeeperConnection Watcher:127.0.0.1:44614 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1392006 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1392006 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1392044 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:54307_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1392062 INFO  (zkCallback-1712-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@59e71b5f name:ZooKeeperConnection Watcher:127.0.0.1:44614/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1392066 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:54307_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1392098 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:54307_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1392346 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:54307_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1392347 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:54307_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1392348 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:54307_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1392354 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:54307_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1392355 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:54307_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1392356 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:54307_    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1392362 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:54307_    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1392362 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:54307_    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1392363 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:54307_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1392363 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:54307_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1392364 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:54307_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1392374 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:54307_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1392375 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:54307_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1392375 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:54307_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95650170859618308-127.0.0.1:54307_-n_0000000000
   [junit4]   2> 1392375 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:54307_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:54307_
   [junit4]   2> 1392375 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:54307_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1392375 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:54307_    ] o.a.s.c.Overseer Overseer (id=95650170859618308-127.0.0.1:54307_-n_0000000000) starting
   [junit4]   2> 1392376 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:54307_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1392383 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:54307_    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1392392 INFO  (OverseerStateUpdate-95650170859618308-127.0.0.1:54307_-n_0000000000) [n:127.0.0.1:54307_    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1392392 INFO  (OverseerCollectionConfigSetProcessor-95650170859618308-127.0.0.1:54307_-n_0000000000) [n:127.0.0.1:54307_    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 1392400 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:54307_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54307_
   [junit4]   2> 1392400 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:54307_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:54307_
   [junit4]   2> 1392401 INFO  (zkCallback-1712-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 1392402 INFO  (OverseerStateUpdate-95650170859618308-127.0.0.1:54307_-n_0000000000) [n:127.0.0.1:54307_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1392406 INFO  (zkCallback-1712-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1392409 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:54307_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1392409 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:54307_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1392410 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:54307_    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderFailoverAfterPartitionTest_6340D85577954DDB-001/control-001/cores
   [junit4]   2> 1392414 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:54307_    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=control_collection, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 1392414 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:54307_    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderFailoverAfterPartitionTest_6340D85577954DDB-001/control-001/cores/collection1
   [junit4]   2> 1392414 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:54307_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 1392415 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:54307_    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1
   [junit4]   2> 1392415 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:54307_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1392415 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 1392415 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1392416 INFO  (OverseerStateUpdate-95650170859618308-127.0.0.1:54307_-n_0000000000) [n:127.0.0.1:54307_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:54307",
   [junit4]   2>   "node_name":"127.0.0.1:54307_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 1392416 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 1392416 INFO  (OverseerStateUpdate-95650170859618308-127.0.0.1:54307_-n_0000000000) [n:127.0.0.1:54307_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:54307",
   [junit4]   2>   "node_name":"127.0.0.1:54307_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 1392416 INFO  (OverseerStateUpdate-95650170859618308-127.0.0.1:54307_-n_0000000000) [n:127.0.0.1:54307_    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 1392417 INFO  (OverseerStateUpdate-95650170859618308-127.0.0.1:54307_-n_0000000000) [n:127.0.0.1:54307_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 1392417 INFO  (zkCallback-1712-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1393416 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1393416 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 1393430 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 1393430 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 1393434 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 1393434 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderFailoverAfterPartitionTest_6340D85577954DDB-001/control-001/cores/collection1'
   [junit4]   2> 1393434 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1393434 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1393435 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 1393438 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1393440 WARN  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection   x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 1393441 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 1393464 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1393467 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1393689 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1393713 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 1393714 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1393734 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1393736 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1393747 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1393748 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1393749 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1
   [junit4]   2> 1393750 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 1393750 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1393750 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderFailoverAfterPartitionTest_6340D85577954DDB-001/control-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderFailoverAfterPartitionTest_6340D85577954DDB-001/control-001/cores/collection1/data/]
   [junit4]   2> 1393750 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@64082bbf
   [junit4]   2> 1393750 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderFailoverAfterPartitionTest_6340D85577954DDB-001/control-001/cores/collection1/data
   [junit4]   2> 1393766 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderFailoverAfterPartitionTest_6340D85577954DDB-001/control-001/cores/collection1/data/index/
   [junit4]   2> 1393766 WARN  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderFailoverAfterPartitionTest_6340D85577954DDB-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1393766 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderFailoverAfterPartitionTest_6340D85577954DDB-001/control-001/cores/collection1/data/index
   [junit4]   2> 1393766 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=695922963, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 1393767 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@439f07f2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@443dbde4),segFN=segments_1,generation=1}
   [junit4]   2> 1393767 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 1393771 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1393772 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1393772 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1393772 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1393772 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1393772 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1393772 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1393772 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1393772 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1393772 WARN  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
   [junit4]   2> 1393773 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1393774 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderFailoverAfterPartitionTest_6340D85577954DDB-001/control-001/cores/collection1/data/
   [junit4]   2> 1393774 WARN  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderFailoverAfterPartitionTest_6340D85577954DDB-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 1393774 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1393778 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1393779 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1393781 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/ping,/admin/threads,/update,/admin/file
   [junit4]   2> 1393781 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1393790 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1393790 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1393791 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1393791 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1393791 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=41, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7726943821065707]
   [junit4]   2> 1393806 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@439f07f2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@443dbde4),segFN=segments_1,generation=1}
   [junit4]   2> 1393806 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 1393806 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@169a08f8[collection1] main]
   [junit4]   2> 1393806 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 1393807 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 1393807 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1393807 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1393807 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 1393807 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1393807 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1393808 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1393808 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 1393808 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1393812 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 1393812 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
   [junit4]   2> 1393812 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 1393812 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1530402736181346304
   [junit4]   2> 1393814 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 1.0ms to seed version buckets with highest version 1530402736181346304
   [junit4]   2> 1393814 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 1393814 INFO  (searcherExecutor-3912-thread-1-processing-n:127.0.0.1:54307_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@169a08f8[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1393814 INFO  (coreLoadExecutor-3911-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 1393818 INFO  (coreZkRegister-3905-thread-1-processing-n:127.0.0.1:54307_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:54307 collection:control_collection shard:shard1
   [junit4]   2> 1393826 INFO  (coreZkRegister-3905-thread-1-processing-n:127.0.0.1:54307_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 1393858 INFO  (coreZkRegister-3905-thread-1-processing-n:127.0.0.1:54307_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/95650170859618308-core_node1-n_0000000000
   [junit4]   2> 1393862 INFO  (coreZkRegister-3905-thread-1-processing-n:127.0.0.1:54307_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 and weAreReplacement=false and leaderVoteWait=10000
   [junit4]   2> 1393878 INFO  (coreZkRegister-3905-thread-1-processing-n:127.0.0.1:54307_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1393878 INFO  (coreZkRegister-3905-thread-1-processing-n:127.0.0.1:54307_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1393878 INFO  (coreZkRegister-3905-thread-1-processing-n:127.0.0.1:54307_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:54307/collection1/
   [junit4]   2> 1393878 INFO  (coreZkRegister-3905-thread-1-processing-n:127.0.0.1:54307_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1393878 INFO  (coreZkRegister-3905-thread-1-processing-n:127.0.0.1:54307_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:54307/collection1/ has no replicas
   [junit4]   2> 1393882 INFO  (OverseerStateUpdate-95650170859618308-127.0.0.1:54307_-n_0000000000) [n:127.0.0.1:54307_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 1393883 INFO  (coreZkRegister-3905-thread-1-processing-n:127.0.0.1:54307_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 1393914 INFO  (coreZkRegister-3905-thread-1-processing-n:127.0.0.1:54307_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/control_collection/leaders/shard1/leader after winning as /collections/control_collection/leader_elect/shard1/election/95650170859618308-core_node1-n_0000000000
   [junit4]   2> 1393922 INFO  (coreZkRegister-3905-thread-1-processing-n:127.0.0.1:54307_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:54307/collection1/ shard1
   [junit4]   2> 1393926 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1393933 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1393934 INFO  (OverseerStateUpdate-95650170859618308-127.0.0.1:54307_-n_0000000000) [n:127.0.0.1:54307_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:54307",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 1393934 INFO  (zkCallback-1712-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1393938 INFO  (zkCallback-1714-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6b0e088b name:ZooKeeperConnection Watcher:127.0.0.1:44614/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1393938 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1393938 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1393938 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1393939 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1393939 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1393978 INFO  (coreZkRegister-3905-thread-1-processing-n:127.0.0.1:54307_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:54307/collection1/ and leader is http://127.0.0.1:54307/collection1/
   [junit4]   2> 1393978 INFO  (coreZkRegister-3905-thread-1-processing-n:127.0.0.1:54307_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54307
   [junit4]   2> 1393978 INFO  (coreZkRegister-3905-thread-1-processing-n:127.0.0.1:54307_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1393978 INFO  (coreZkRegister-3905-thread-1-processing-n:127.0.0.1:54307_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 1393978 INFO  (coreZkRegister-3905-thread-1-processing-n:127.0.0.1:54307_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:54307_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1393979 INFO  (OverseerStateUpdate-95650170859618308-127.0.0.1:54307_-n_0000000000) [n:127.0.0.1:54307_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:54307",
   [junit4]   2>   "node_name":"127.0.0.1:54307_",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 2
   [junit4]   2> 1393979 INFO  (OverseerStateUpdate-95650170859618308-127.0.0.1:54307_-n_0000000000) [n:127.0.0.1:54307_    ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:54307",
   [junit4]   2>   "node_name":"127.0.0.1:54307_",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 1394040 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderFailoverAfterPartitionTest_6340D85577954DDB-001/shard-1-001/cores/collection1
   [junit4]   2> 1394040 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderFailoverAfterPartitionTest_6340D85577954DDB-001/shard-1-001
   [junit4]   2> 1394041 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 1394042 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5a3d0020{/,null,AVAILABLE}
   [junit4]   2> 1394042 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.e.j.s.ServerConnector Started ServerConnector@313f6882{HTTP/1.1,[http/1.1]}{127.0.0.1:60920}
   [junit4]   2> 1394043 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.e.j.s.Server Started @1400766ms
   [junit4]   2> 1394043 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderFailoverAfterPartitionTest_6340D85577954DDB-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=37594, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderFailoverAfterPartitionTest_6340D85577954DDB-001/shard-1-001/cores}
   [junit4]   2> 1394043 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 1394043 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderFailoverAfterPartitionTest_6340D85577954DDB-001/shard-1-001'
   [junit4]   2> 1394043 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1394043 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1394043 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1394043 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1394052 INFO  (zkCallback-1715-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2f31c119 name:ZooKeeperConnection Watcher:127.0.0.1:44614/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1394052 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1394052 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1394053 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1394053 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderFailoverAfterPartitionTest_6340D85577954DDB-001/shard-1-001/solr.xml
   [junit4]   2> 1394057 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderFailoverAfterPartitionTest_6340D85577954DDB-001/shard-1-001/cores
   [junit4]   2> 1394057 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.CoreContainer New CoreContainer 1570002978
   [junit4]   2> 1394057 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderFailoverAfterPartitionTest_6340D85577954DDB-001/shard-1-001]
   [junit4]   2> 1394057 WARN  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderFailoverAfterPartitionTest_6340D85577954DDB-001/shard-1-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderFailoverAfterPartitionTest_6340D85577954DDB-001/shard-1-001/lib
   [junit4]   2> 1394057 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1394058 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1394058 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1394058 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1394058 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44614/solr
   [junit4]   2> 1394058 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1394058 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1394059 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1394060 INFO  (zkCallback-1718-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3833420e name:ZooKeeperConnection Watcher:127.0.0.1:44614 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1394061 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1394061 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1394066 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:37594_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1394066 INFO  (zkCallback-1719-thread-1-processing-n:127.0.0.1:37594_) [n:127.0.0.1:37594_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5417ea4c name:ZooKeeperConnection Watcher:127.0.0.1:44614/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1394066 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:37594_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1394070 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:37594_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1394072 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:37594_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1394073 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:37594_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1394073 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:37594_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95650170859618312-127.0.0.1:37594_-n_0000000001
   [junit4]   2> 1394073 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:37594_    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95650170859618308-127.0.0.1:54307_-n_0000000000 to know if I could be the leader
   [junit4]   2> 1394074 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:37594_    ] o.a.s.c.ZkController Publish node=127.0.0.1:37594_ as DOWN
   [junit4]   2> 1394074 INFO  (OverseerStateUpdate-95650170859618308-127.0.0.1:54307_-n_0000000000) [n:127.0.0.1:54307_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:37594_"} current state version: 2
   [junit4]   2> 1394074 INFO  (OverseerStateUpdate-95650170859618308-127.0.0.1:54307_-n_0000000000) [n:127.0.0.1:54307_    ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:37594_
   [junit4]   2> 1394186 INFO  (zkCallback-1712-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1394186 INFO  (zkCallback-1714-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1394188 INFO  (zkCallback-1719-thread-1-processing-n:127.0.0.1:37594_) [n:127.0.0.1:37594_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1395075 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:37594_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37594_
   [junit4]   2> 1395076 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:37594_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:37594_
   [junit4]   2> 1395086 INFO  (zkCallback-1714-thread-1) [    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1395086 INFO  (zkCallback-1712-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1395086 INFO  (zkCallback-1714-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1395086 INFO  (zkCallback-1719-thread-1-processing-n:127.0.0.1:37594_) [n:127.0.0.1:37594_    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1395091 INFO  (zkCallback-1712-thread-1-processing-n:127.0.0.1:54307_) [n:127.0.0.1:54307_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1395092 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:37594_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1395092 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:37594_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1395093 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:37594_    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderFailoverAfterPartitionTest_6340D85577954DDB-001/shard-1-001/cores
   [junit4]   2> 1395094 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:37594_    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=collection1, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 1395094 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:37594_    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.LeaderFailoverAfterPartitionTest_6340D85577954DDB-001/shard-1-001/cores/collection1
   [junit4]   2> 1395094 INFO  (TEST-LeaderFailoverAfterPartitionTest.test-seed#[6340D85577954DDB]) [n:127.0.0.1:

[...truncated too long message...]

   2> 2499463 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 2499464 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 2499464 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 2499465 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 2499465 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 2499466 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 2499466 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.ZkStateReader addZkWatch [c1]
   [junit4]   2> 2499467 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 2499467 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 2499467 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[6340D85577954DDB]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 2499474 INFO  (zkCallback-2108-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 2499475 INFO  (zkCallback-2108-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 2499479 INFO  (zkCallback-2108-thread-1) [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 2499530 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[6340D85577954DDB]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 2499546 INFO  (zkCallback-2108-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 2499561 INFO  (zkCallback-2108-thread-2) [    ] o.a.s.c.c.ZkStateReader Add data for [c1] ver [0]
   [junit4]   2> 2499611 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[6340D85577954DDB]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41031 41031
   [junit4]   2> 2499712 INFO  (Thread-6734) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41031 41031
   [junit4]   2> 2499728 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[6340D85577954DDB]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testStateFormatUpdateWithTimeDelay
   [junit4]   2> 2499729 INFO  (SUITE-ZkStateReaderTest-seed#[6340D85577954DDB]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.overseer.ZkStateReaderTest_6340D85577954DDB-001
   [junit4]   2> Apr 01, 2016 10:34:48 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene60): {}, docValues:{}, maxPointsInLeafNode=491, maxMBSortInHeap=4.01623637336602, sim=RandomSimilarity(queryNorm=true,coord=crazy): {}, locale=en-US, timezone=Europe/Moscow
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=1,free=228071560,total=529006592
   [junit4]   2> NOTE: All tests run in this JVM: [JSONWriterTest, TestDistributedSearch, BlockJoinFacetRandomTest, TestCollationFieldDocValues, TestReplicationHandlerBackup, AlternateDirectoryTest, SharedFSAutoReplicaFailoverUtilsTest, ReturnFieldsTest, TestSolrConfigHandler, TestSQLHandler, CoreAdminCreateDiscoverTest, TestHdfsUpdateLog, ZkNodePropsTest, DataDrivenBlockJoinTest, ActionThrottleTest, TestFieldTypeResource, TestCustomSort, TestUseDocValuesAsStored, LeaderInitiatedRecoveryOnShardRestartTest, OverseerRolesTest, ExternalFileFieldSortTest, StandardRequestHandlerTest, TestReplicaProperties, UUIDFieldTest, TestRemoteStreaming, TestHighlightDedupGrouping, DocumentAnalysisRequestHandlerTest, ExplicitHLLTest, TestMergePolicyConfig, HttpPartitionTest, TestSortByMinMaxFunction, SolrCoreTest, CurrencyFieldOpenExchangeTest, CdcrVersionReplicationTest, HdfsCollectionsAPIDistributedZkTest, DateFieldTest, UUIDUpdateProcessorFallbackTest, QueryResultKeyTest, RankQueryTest, TestSchemaSimilarityResource, SignatureUpdateProcessorFactoryTest, TestManagedStopFilterFactory, TestArbitraryIndexDir, PingRequestHandlerTest, TestHashQParserPlugin, JavabinLoaderTest, TestValueSourceCache, TestRangeQuery, AnalysisAfterCoreReloadTest, BigEndianAscendingWordDeserializerTest, TestRTimerTree, TestBlendedInfixSuggestions, TestIBSimilarityFactory, TestDocSet, DistribCursorPagingTest, AddBlockUpdateTest, OutputWriterTest, TestLRUCache, TestMiniSolrCloudCluster, HLLUtilTest, DistributedQueryElevationComponentTest, PrimUtilsTest, TestMissingGroups, RequiredFieldsTest, PathHierarchyTokenizerFactoryTest, RAMDirectoryFactoryTest, PolyFieldTest, TestCrossCoreJoin, EnumFieldTest, ConcurrentDeleteAndCreateCollectionTest, DistributedSuggestComponentTest, TestSearcherReuse, TestQueryWrapperFilter, TestReRankQParserPlugin, SynonymTokenizerTest, TestConfigSetsAPI, ConnectionReuseTest, AsyncCallRequestStatusResponseTest, TestTolerantUpdateProcessorCloud, HdfsRecoveryZkTest, SOLR749Test, TestScoreJoinQPNoScore, CheckHdfsIndexTest, PreAnalyzedUpdateProcessorTest, TestSolr4Spatial, LeaderElectionIntegrationTest, TestNRTOpen, SuggestComponentContextFilterQueryTest, DocExpirationUpdateProcessorFactoryTest, TestRandomDVFaceting, PreAnalyzedFieldTest, HdfsThreadLeakTest, XsltUpdateRequestHandlerTest, TestHighFrequencyDictionaryFactory, TestCustomDocTransformer, ResponseHeaderTest, AnalyticsQueryTest, ChaosMonkeySafeLeaderTest, RecoveryZkTest, TestRandomFaceting, TestFaceting, TestRealTimeGet, DistributedTermsComponentTest, TestGroupingSearch, QueryElevationComponentTest, TestSort, DirectUpdateHandlerTest, TestIndexSearcher, SoftAutoCommitTest, TestTrie, TestCSVLoader, NoCacheHeaderTest, SchemaVersionSpecificBehaviorTest, TestUpdate, QueryEqualityTest, DocValuesMultiTest, DistanceFunctionTest, CacheHeaderTest, LukeRequestHandlerTest, TestReversedWildcardFilterFactory, TestOmitPositions, FileBasedSpellCheckerTest, TestIndexingPerformance, MoreLikeThisHandlerTest, TestSolrQueryParser, TestJmxIntegration, QueryParsingTest, UniqFieldsUpdateProcessorFactoryTest, SearchHandlerTest, TestBinaryField, MinimalSchemaTest, TestElisionMultitermQuery, TestConfig, TestFuzzyAnalyzedSuggestions, DirectSolrConnectionTest, TestLuceneMatchVersion, TestPhraseSuggestions, TestXIncludeConfig, EchoParamsTest, TestSweetSpotSimilarityFactory, TestDFRSimilarityFactory, TestLMDirichletSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TestFastWriter, ResourceLoaderTest, TestFastOutputStream, ScriptEngineTest, URLClassifyProcessorTest, PluginInfoTest, TestFastLRUCache, DateMathParserTest, ChaosMonkeyNothingIsSafeTest, CursorPagingTest, TestEmbeddedSolrServerConstructors, TestJettySolrRunner, CdcrReplicationDistributedZkTest, CdcrRequestHandlerTest, CloudExitableDirectoryReaderTest, CollectionsAPIAsyncDistributedZkTest, ConnectionManagerTest, DeleteInactiveReplicaTest, DeleteStatusTest, DistribDocExpirationUpdateProcessorTest, OutOfBoxZkACLAndCredentialsProvidersTest, OverriddenZkACLAndCredentialsProvidersTest, OverseerTaskQueueTest, RecoveryAfterSoftCommitTest, RestartWhileUpdatingTest, RollingRestartTest, SolrXmlInZkTest, TestAuthenticationFramework, TestDownShardTolerantSearch, TestExclusionRuleCollectionAccess, TestSizeLimitedDistributedMap, TlogReplayBufferedWhileIndexingTest, TriLevelCompositeIdRoutingTest, TestClusterStateMutator, ZkStateReaderTest]
   [junit4] Completed [483/584 (3!)] on J0 in 3.64s, 5 tests, 1 error <<< FAILURES!

[...truncated 346 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:740: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:684: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/common-build.xml:529: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/common-build.xml:1457: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/common-build.xml:1014: There were test failures: 584 suites (10 ignored), 2353 tests, 2 errors, 1 failure, 85 ignored (70 assumptions) [seed: 6340D85577954DDB]

Total time: 113 minutes 14 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any




[JENKINS] Lucene-Solr-Tests-master - Build # 1051 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/1051/

1 tests failed.
FAILED:  org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy

Error Message:
Could not find collection : c1

Stack Trace:
org.apache.solr.common.SolrException: Could not find collection : c1
	at __randomizedtesting.SeedInfo.seed([7965FD2F8D140B4A:122A5D52F41BD670]:0)
	at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:170)
	at org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdate(ZkStateReaderTest.java:135)
	at org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy(ZkStateReaderTest.java:46)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 12175 lines...]
   [junit4] Suite: org.apache.solr.cloud.overseer.ZkStateReaderTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.overseer.ZkStateReaderTest_7965FD2F8D140B4A-001/init-core-data-001
   [junit4]   2> 2383616 INFO  (SUITE-ZkStateReaderTest-seed#[7965FD2F8D140B4A]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 2383618 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testStateFormatUpdateWithExplicitRefreshLazy
   [junit4]   2> 2383618 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2383619 INFO  (Thread-6734) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2383619 INFO  (Thread-6734) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2383853 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.ZkTestServer start zk server on port:52156
   [junit4]   2> 2383853 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2383968 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2383997 INFO  (zkCallback-2164-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2b7768ab name:ZooKeeperConnection Watcher:127.0.0.1:52156 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2383997 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2383997 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2383998 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2383999 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2384005 INFO  (zkCallback-2165-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5995a90f name:ZooKeeperConnection Watcher:127.0.0.1:52156 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2384005 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2384005 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2384005 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 2384011 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2384015 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2384063 INFO  (zkCallback-2166-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6694f9d6 name:ZooKeeperConnection Watcher:127.0.0.1:52156/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2384063 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2384064 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2384067 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 2384068 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 2384068 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 2384069 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 2384069 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 2384070 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 2384070 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 2384070 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 2384072 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 2384073 INFO  (zkCallback-2166-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 2384073 WARN  (zkCallback-2166-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /collections]
   [junit4]   2> 2384096 INFO  (zkCallback-2166-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 2384096 WARN  (zkCallback-2166-thread-2) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /clusterstate.json]
   [junit4]   2> 2384112 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:52156 52156
   [junit4]   2> 2384384 INFO  (Thread-6734) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:52156 52156
   [junit4]   2> 2384388 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testStateFormatUpdateWithExplicitRefreshLazy
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ZkStateReaderTest -Dtests.method=testStateFormatUpdateWithExplicitRefreshLazy -Dtests.seed=7965FD2F8D140B4A -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=en-IN -Dtests.timezone=Africa/Kampala -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.77s J0 | ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy <<<
   [junit4]    > Throwable #1: org.apache.solr.common.SolrException: Could not find collection : c1
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([7965FD2F8D140B4A:122A5D52F41BD670]:0)
   [junit4]    > 	at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:170)
   [junit4]    > 	at org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdate(ZkStateReaderTest.java:135)
   [junit4]    > 	at org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy(ZkStateReaderTest.java:46)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 2384392 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[7965FD2F8D140B4A]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testStateFormatUpdateWithTimeDelay
   [junit4]   2> 2384392 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2384395 INFO  (Thread-6735) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2384395 INFO  (Thread-6735) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2384499 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.ZkTestServer start zk server on port:46051
   [junit4]   2> 2384499 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2384511 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2384527 INFO  (zkCallback-2167-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@495adfb6 name:ZooKeeperConnection Watcher:127.0.0.1:46051 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2384527 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2384528 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2384543 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2384547 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2384555 INFO  (zkCallback-2168-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@677fc320 name:ZooKeeperConnection Watcher:127.0.0.1:46051 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2384555 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2384556 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2384556 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 2384568 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2384591 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2384607 INFO  (zkCallback-2169-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4a712d38 name:ZooKeeperConnection Watcher:127.0.0.1:46051/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2384607 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2384608 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2384610 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 2384611 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 2384612 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 2384613 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 2384614 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 2384614 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 2384615 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 2384616 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ZkStateReader addZkWatch [c1]
   [junit4]   2> 2384616 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 2384616 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 2384616 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 2384617 INFO  (zkCallback-2169-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 2384621 INFO  (zkCallback-2169-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 2384621 INFO  (zkCallback-2169-thread-1) [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 2384814 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 2384819 INFO  (zkCallback-2169-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 2384833 INFO  (zkCallback-2169-thread-2) [    ] o.a.s.c.c.ZkStateReader Add data for [c1] ver [0]
   [junit4]   2> 2384872 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46051 46051
   [junit4]   2> 2385055 INFO  (Thread-6735) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46051 46051
   [junit4]   2> 2385057 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[7965FD2F8D140B4A]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testStateFormatUpdateWithTimeDelay
   [junit4]   2> 2385063 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testStateFormatUpdateWithTimeDelayLazy
   [junit4]   2> 2385064 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2385071 INFO  (Thread-6736) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2385073 INFO  (Thread-6736) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2385168 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.ZkTestServer start zk server on port:52775
   [junit4]   2> 2385168 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2385171 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2385195 INFO  (zkCallback-2170-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2ebb54f7 name:ZooKeeperConnection Watcher:127.0.0.1:52775 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2385199 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2385199 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2385221 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2385228 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2385243 INFO  (zkCallback-2171-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@25e3b8fc name:ZooKeeperConnection Watcher:127.0.0.1:52775 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2385243 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2385244 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2385244 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 2385274 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2385274 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2385275 INFO  (zkCallback-2172-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1282dff8 name:ZooKeeperConnection Watcher:127.0.0.1:52775/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2385275 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2385275 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2385275 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 2385276 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 2385277 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 2385277 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 2385278 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 2385278 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 2385279 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 2385279 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 2385280 INFO  (zkCallback-2172-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 2385280 INFO  (zkCallback-2172-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 2385281 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 2385281 INFO  (zkCallback-2172-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 2385375 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:52775 52775
   [junit4]   2> 2385543 INFO  (Thread-6736) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:52775 52775
   [junit4]   2> 2385545 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[7965FD2F8D140B4A]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testStateFormatUpdateWithTimeDelayLazy
   [junit4]   2> 2385548 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[7965FD2F8D140B4A]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testExternalCollectionWatchedNotWatched
   [junit4]   2> 2385548 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2385548 INFO  (Thread-6737) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2385548 INFO  (Thread-6737) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2385648 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.ZkTestServer start zk server on port:56529
   [junit4]   2> 2385648 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2385767 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2385775 INFO  (zkCallback-2173-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@28baa278 name:ZooKeeperConnection Watcher:127.0.0.1:56529 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2385779 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2385779 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2385787 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2385792 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2385799 INFO  (zkCallback-2174-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@61a46926 name:ZooKeeperConnection Watcher:127.0.0.1:56529 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2385799 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2385800 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2385800 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 2385815 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2385827 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2385839 INFO  (zkCallback-2175-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@526a43a7 name:ZooKeeperConnection Watcher:127.0.0.1:56529/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2385839 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2385840 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2385840 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 2385840 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 2385841 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 2385841 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 2385842 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 2385842 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 2385843 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 2385843 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 2385844 INFO  (zkCallback-2175-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 2385844 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 2385845 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ZkStateReader addZkWatch [c1]
   [junit4]   2> 2385845 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ZkStateReader Add data for [c1] ver [0]
   [junit4]   2> 2385845 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ZkStateReader Removing watch for uninteresting collection [c1]
   [junit4]   2> 2385863 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:56529 56529
   [junit4]   2> 2386075 INFO  (Thread-6737) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:56529 56529
   [junit4]   2> 2386083 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[7965FD2F8D140B4A]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testExternalCollectionWatchedNotWatched
   [junit4]   2> 2386086 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[7965FD2F8D140B4A]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testStateFormatUpdateWithExplicitRefresh
   [junit4]   2> 2386086 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2386099 INFO  (Thread-6738) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2386099 INFO  (Thread-6738) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2386313 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.ZkTestServer start zk server on port:53197
   [junit4]   2> 2386313 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2386318 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2386321 INFO  (zkCallback-2176-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6be87718 name:ZooKeeperConnection Watcher:127.0.0.1:53197 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2386321 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2386321 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2386322 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2386323 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2386328 INFO  (zkCallback-2177-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@23fefbbe name:ZooKeeperConnection Watcher:127.0.0.1:53197 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2386328 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2386328 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2386328 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 2386331 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2386331 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2386332 INFO  (zkCallback-2178-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@17fb4778 name:ZooKeeperConnection Watcher:127.0.0.1:53197/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2386332 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2386332 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2386333 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 2386334 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 2386334 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 2386335 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 2386336 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 2386337 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 2386337 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 2386338 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ZkStateReader addZkWatch [c1]
   [junit4]   2> 2386338 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 2386338 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 2386338 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 2386339 INFO  (zkCallback-2178-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 2386341 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 2386342 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.c.ZkStateReader Add data for [c1] ver [0]
   [junit4]   2> 2386347 INFO  (zkCallback-2178-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 2386347 WARN  (zkCallback-2178-thread-2) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /clusterstate.json]
   [junit4]   2> 2386348 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[7965FD2F8D140B4A]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:53197 53197
   [junit4]   2> 2386564 INFO  (Thread-6738) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:53197 53197
   [junit4]   2> 2386566 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[7965FD2F8D140B4A]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testStateFormatUpdateWithExplicitRefresh
   [junit4]   2> 2386566 INFO  (SUITE-ZkStateReaderTest-seed#[7965FD2F8D140B4A]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.overseer.ZkStateReaderTest_7965FD2F8D140B4A-001
   [junit4]   2> Mar 31, 2016 7:15:41 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Lucene60, sim=RandomSimilarity(queryNorm=false,coord=yes): {}, locale=en-IN, timezone=Africa/Kampala
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_74 (64-bit)/cpus=4,threads=1,free=257933528,total=523239424
   [junit4]   2> NOTE: All tests run in this JVM: [ExplicitHLLTest, RecoveryAfterSoftCommitTest, BlockJoinFacetRandomTest, TestPhraseSuggestions, SolrCoreTest, TestFieldTypeResource, OutOfBoxZkACLAndCredentialsProvidersTest, SuggestComponentContextFilterQueryTest, ResponseHeaderTest, TestCustomSort, TestAnalyzedSuggestions, TestExpandComponent, AtomicUpdatesTest, TestRandomDVFaceting, TestArbitraryIndexDir, TestReplicaProperties, AddBlockUpdateTest, CloudExitableDirectoryReaderTest, TestConfigSetsAPI, RankQueryTest, TestCSVLoader, TestManagedStopFilterFactory, SyncSliceTest, TestHashQParserPlugin, TestRTimerTree, BasicDistributedZkTest, TestDistributedSearch, TestComponentsName, TestSQLHandler, HdfsThreadLeakTest, InfoHandlerTest, BigEndianAscendingWordDeserializerTest, RuleEngineTest, EnumFieldTest, SynonymTokenizerTest, TestHighlightDedupGrouping, TestLRUCache, JsonLoaderTest, TestJoin, TestSolr4Spatial2, TestMergePolicyConfig, TestFoldingMultitermQuery, TestTolerantUpdateProcessorCloud, CheckHdfsIndexTest, CurrencyFieldOpenExchangeTest, CopyFieldTest, TestIntervalFaceting, BasicZkTest, PingRequestHandlerTest, TestReplicationHandlerBackup, TestSchemaSimilarityResource, ActionThrottleTest, DefaultValueUpdateProcessorTest, PreAnalyzedFieldTest, JavabinLoaderTest, TestNRTOpen, ResourceLoaderTest, TestImplicitCoreProperties, CursorPagingTest, AsyncCallRequestStatusResponseTest, TestIBSimilarityFactory, TestRandomFaceting, DistributedSuggestComponentTest, TestCloudManagedSchema, DistribCursorPagingTest, IndexSchemaTest, TestConfigSetProperties, UUIDFieldTest, TestRangeQuery, ExternalFileFieldSortTest, CustomCollectionTest, SOLR749Test, DistributedFacetPivotLongTailTest, TestPKIAuthenticationPlugin, TestSolr4Spatial, ConnectionReuseTest, TestRealTimeGet, TestLazyCores, StandardRequestHandlerTest, PeerSyncTest, DistributedDebugComponentTest, CdcrVersionReplicationTest, JSONWriterTest, TestManagedResource, RequestLoggingTest, TestOmitPositions, SystemInfoHandlerTest, SharedFSAutoReplicaFailoverUtilsTest, ResponseLogComponentTest, TestFaceting, TestSolrConfigHandler, DisMaxRequestHandlerTest, TestMiniSolrCloudClusterSSL, DistributedQueryElevationComponentTest, TestBlendedInfixSuggestions, SaslZkACLProviderTest, TestCustomDocTransformer, TestExclusionRuleCollectionAccess, CollectionsAPIDistributedZkTest, RecoveryZkTest, TestHashPartitioner, TermVectorComponentDistributedTest, HardAutoCommitTest, TestCoreContainer, SpellCheckComponentTest, QueryElevationComponentTest, BasicFunctionalityTest, TestBadConfig, SolrIndexSplitterTest, SignatureUpdateProcessorFactoryTest, SuggesterFSTTest, SolrRequestParserTest, PolyFieldTest, WordBreakSolrSpellCheckerTest, TestAtomicUpdateErrorCases, StatelessScriptUpdateProcessorFactoryTest, CacheHeaderTest, TestWriterPerf, PrimitiveFieldTypeTest, RequestHandlersTest, PathHierarchyTokenizerFactoryTest, FieldAnalysisRequestHandlerTest, LoggingHandlerTest, TestJmxIntegration, BinaryUpdateRequestHandlerTest, SearchHandlerTest, TestCharFilters, EchoParamsTest, TestLMDirichletSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TestFastOutputStream, ScriptEngineTest, PluginInfoTest, DateMathParserTest, PrimUtilsTest, SpellingQueryConverterTest, TestUtils, FileUtilsTest, TestRTGBase, TestCursorMarkWithoutUniqueKey, TestDistributedMissingSort, CollectionStateFormat2Test, CollectionsAPIAsyncDistributedZkTest, DeleteLastCustomShardedReplicaTest, DeleteStatusTest, DistribDocExpirationUpdateProcessorTest, LeaderFailoverAfterPartitionTest, MultiThreadedOCPTest, OverseerStatusTest, ReplicationFactorTest, RestartWhileUpdatingTest, RollingRestartTest, TestAuthenticationFramework, TestRandomRequestDistribution, TestRebalanceLeaders, TestShortCircuitedRequests, TestSolrCloudWithKerberosAlt, VMParamsZkACLAndCredentialsProvidersTest, HdfsBasicDistributedZk2Test, HdfsBasicDistributedZkTest, HdfsChaosMonkeyNothingIsSafeTest, HdfsChaosMonkeySafeLeaderTest, HdfsCollectionsAPIDistributedZkTest, HdfsNNFailoverTest, ZkStateReaderTest]
   [junit4] Completed [482/584 (1!)] on J0 in 3.75s, 5 tests, 1 error <<< FAILURES!

[...truncated 336 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:740: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:684: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/common-build.xml:529: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/common-build.xml:1457: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/common-build.xml:1014: There were test failures: 584 suites (10 ignored), 2353 tests, 1 error, 85 ignored (70 assumptions) [seed: 7965FD2F8D140B4A]

Total time: 83 minutes 27 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any