You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2016/03/11 10:55:31 UTC

[JENKINS] Lucene-Solr-Tests-6.x - Build # 41 - Failure

Build: https://builds.apache.org/job/Lucene-Solr-Tests-6.x/41/

1 tests failed.
FAILED:  org.apache.solr.handler.TestReplicationHandlerBackup.doTestBackup

Error Message:
Failed to create backup

Stack Trace:
java.lang.AssertionError: Failed to create backup
	at __randomizedtesting.SeedInfo.seed([EA9DEA1C70EF9584:AB16CA79575166CB]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.handler.CheckBackupStatus.fetchStatus(CheckBackupStatus.java:50)
	at org.apache.solr.handler.TestReplicationHandlerBackup.doTestBackup(TestReplicationHandlerBackup.java:200)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 12072 lines...]
   [junit4] Suite: org.apache.solr.handler.TestReplicationHandlerBackup
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/init-core-data-001
   [junit4]   2> 1826729 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testBackupOnCommit
   [junit4]   2> 1826730 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-001/collection1
   [junit4]   2> 1826739 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[EA9DEA1C70EF9584]) [    ] o.e.j.s.Server jetty-9.3.6.v20151106
   [junit4]   2> 1826741 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[EA9DEA1C70EF9584]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@350a4c14{/solr,null,AVAILABLE}
   [junit4]   2> 1826742 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[EA9DEA1C70EF9584]) [    ] o.e.j.s.ServerConnector Started ServerConnector@26e17556{HTTP/1.1,[http/1.1]}{127.0.0.1:४६३५२}
   [junit4]   2> 1826743 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[EA9DEA1C70EF9584]) [    ] o.e.j.s.Server Started @१८३०१६४ms
   [junit4]   2> 1826743 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-001/collection1/data, hostContext=/solr, hostPort=46352}
   [junit4]   2> 1826743 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 1826743 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-001'
   [junit4]   2> 1826743 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1826743 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1826744 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-001/solr.xml
   [junit4]   2> 1826760 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-001/.
   [junit4]   2> 1826760 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.c.CoreContainer New CoreContainer 1280687733
   [junit4]   2> 1826760 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-001]
   [junit4]   2> 1826760 WARN  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-001/lib
   [junit4]   2> 1826761 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1826763 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1826764 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1826764 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1826764 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1826764 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1826765 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-001/.
   [junit4]   2> 1826766 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, configSetProperties=configsetprops.json, transient=false, dataDir=data/}
   [junit4]   2> 1826767 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-001/./collection1
   [junit4]   2> 1826767 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 1826767 INFO  (coreLoadExecutor-6291-thread-1) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-001/collection1'
   [junit4]   2> 1826768 INFO  (coreLoadExecutor-6291-thread-1) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1826768 INFO  (coreLoadExecutor-6291-thread-1) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1826768 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1
   [junit4]   2> 1826768 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1826777 INFO  (coreLoadExecutor-6291-thread-1) [    ] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1826781 WARN  (coreLoadExecutor-6291-thread-1) [    ] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 1826782 INFO  (coreLoadExecutor-6291-thread-1) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.1.0
   [junit4]   2> 1826790 INFO  (coreLoadExecutor-6291-thread-1) [    ] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1826794 INFO  (coreLoadExecutor-6291-thread-1) [    ] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1826797 INFO  (coreLoadExecutor-6291-thread-1) [    ] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1826800 INFO  (coreLoadExecutor-6291-thread-1) [    ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-001/collection1'
   [junit4]   2> 1826800 INFO  (coreLoadExecutor-6291-thread-1) [    ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-001/./collection1
   [junit4]   2> 1826801 INFO  (coreLoadExecutor-6291-thread-1) [    x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1826801 INFO  (coreLoadExecutor-6291-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-001/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-001/./collection1/data/]
   [junit4]   2> 1826801 INFO  (coreLoadExecutor-6291-thread-1) [    x:collection1] o.a.s.c.SolrCore JMX monitoring not detected for core: collection1
   [junit4]   2> 1826801 INFO  (coreLoadExecutor-6291-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-001/./collection1/data
   [junit4]   2> 1826802 INFO  (coreLoadExecutor-6291-thread-1) [    x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-001/./collection1/data/index/
   [junit4]   2> 1826802 WARN  (coreLoadExecutor-6291-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-001/./collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1826802 INFO  (coreLoadExecutor-6291-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-001/./collection1/data/index
   [junit4]   2> 1826802 INFO  (coreLoadExecutor-6291-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=41, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.25799353101933087]
   [junit4]   2> 1826803 INFO  (coreLoadExecutor-6291-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@23b39907 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5ed1be02),segFN=segments_1,generation=1}
   [junit4]   2> 1826803 INFO  (coreLoadExecutor-6291-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 1826804 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [    x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-001/./collection1/data/
   [junit4]   2> 1826806 INFO  (coreLoadExecutor-6291-thread-1) [    x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1826809 INFO  (coreLoadExecutor-6291-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1826810 INFO  (coreLoadExecutor-6291-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1826811 INFO  (coreLoadExecutor-6291-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1826812 INFO  (coreLoadExecutor-6291-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1826815 INFO  (coreLoadExecutor-6291-thread-1) [    x:collection1] o.a.s.c.PluginBag requestHandler : 'lazy' created with startup=lazy 
   [junit4]   2> 1826815 INFO  (coreLoadExecutor-6291-thread-1) [    x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,lazy,/update/json/docs,/admin/luke,/export,/get,/admin/properties,/update/json,/admin/threads,/update/csv,/sql,/admin/segments,/admin/system,/replication,defaults,/config,/stream,/schema,/admin/plugins,/admin/logging,/admin/ping,/update,/admin/file
   [junit4]   2> 1826815 INFO  (coreLoadExecutor-6291-thread-1) [    x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1826815 INFO  (coreLoadExecutor-6291-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1826815 INFO  (coreLoadExecutor-6291-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1826815 INFO  (coreLoadExecutor-6291-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=47, maxMergedSegmentMB=65.5986328125, floorSegmentMB=0.7763671875, forceMergeDeletesPctAllowed=18.447000057497995, segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 1826816 INFO  (coreLoadExecutor-6291-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@23b39907 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5ed1be02),segFN=segments_1,generation=1}
   [junit4]   2> 1826816 INFO  (coreLoadExecutor-6291-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 1826816 INFO  (coreLoadExecutor-6291-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@169d05c2[collection1] main]
   [junit4]   2> 1826816 INFO  (coreLoadExecutor-6291-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-001/collection1/conf
   [junit4]   2> 1826816 INFO  (coreLoadExecutor-6291-thread-1) [    x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-001/collection1/conf}
   [junit4]   2> 1826816 INFO  (coreLoadExecutor-6291-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-001/collection1/conf
   [junit4]   2> 1826817 INFO  (coreLoadExecutor-6291-thread-1) [    x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 1826817 INFO  (coreLoadExecutor-6291-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Replication enabled for following config files: schema-replication2.xml:schema.xml
   [junit4]   2> 1826817 INFO  (coreLoadExecutor-6291-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1826817 INFO  (coreLoadExecutor-6291-thread-1) [    x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 1826818 INFO  (searcherExecutor-6292-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@169d05c2[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1827271 INFO  (qtp8624326-16805) [    x:collection1] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 1827271 INFO  (qtp8624326-16805) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{deleteByQuery=*:*} 0 0
   [junit4]   2> 1827274 INFO  (qtp8624326-16806) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[0]} 0 1
   [junit4]   2> 1827276 INFO  (qtp8624326-16807) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[1]} 0 0
   [junit4]   2> 1827278 INFO  (qtp8624326-16808) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[2]} 0 0
   [junit4]   2> 1827280 INFO  (qtp8624326-16809) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[3]} 0 0
   [junit4]   2> 1827282 INFO  (qtp8624326-16802) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[4]} 0 0
   [junit4]   2> 1827283 INFO  (qtp8624326-16805) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[5]} 0 0
   [junit4]   2> 1827285 INFO  (qtp8624326-16806) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[6]} 0 0
   [junit4]   2> 1827287 INFO  (qtp8624326-16807) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[7]} 0 0
   [junit4]   2> 1827288 INFO  (qtp8624326-16808) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[8]} 0 0
   [junit4]   2> 1827290 INFO  (qtp8624326-16809) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[9]} 0 0
   [junit4]   2> 1827292 INFO  (qtp8624326-16802) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[10]} 0 0
   [junit4]   2> 1827293 INFO  (qtp8624326-16805) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[11]} 0 0
   [junit4]   2> 1827295 INFO  (qtp8624326-16806) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[12]} 0 0
   [junit4]   2> 1827297 INFO  (qtp8624326-16807) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[13]} 0 0
   [junit4]   2> 1827298 INFO  (qtp8624326-16808) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[14]} 0 0
   [junit4]   2> 1827300 INFO  (qtp8624326-16809) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[15]} 0 0
   [junit4]   2> 1827302 INFO  (qtp8624326-16802) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[16]} 0 0
   [junit4]   2> 1827303 INFO  (qtp8624326-16805) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[17]} 0 0
   [junit4]   2> 1827305 INFO  (qtp8624326-16806) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[18]} 0 0
   [junit4]   2> 1827307 INFO  (qtp8624326-16807) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[19]} 0 0
   [junit4]   2> 1827308 INFO  (qtp8624326-16808) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[20]} 0 0
   [junit4]   2> 1827310 INFO  (qtp8624326-16809) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[21]} 0 0
   [junit4]   2> 1827312 INFO  (qtp8624326-16802) [    x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1827314 INFO  (qtp8624326-16802) [    x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@23b39907 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5ed1be02),segFN=segments_1,generation=1}
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@23b39907 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5ed1be02),segFN=segments_2,generation=2}
   [junit4]   2> 1827314 INFO  (qtp8624326-16802) [    x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 2
   [junit4]   2> 1827315 INFO  (Thread-8651) [    x:collection1] o.a.s.h.SnapShooter Creating backup snapshot <not named> at /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-001/./collection1/data/
   [junit4]   2> 1827316 INFO  (qtp8624326-16802) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@65a868aa[collection1] main]
   [junit4]   2> 1827316 INFO  (qtp8624326-16802) [    x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1827316 INFO  (searcherExecutor-6292-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@65a868aa[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.1.0):C22)))}
   [junit4]   2> 1827317 INFO  (qtp8624326-16802) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 5
   [junit4]   2> 1827317 INFO  (Thread-8651) [    x:collection1] o.a.s.h.SnapShooter Done creating backup snapshot: <not named> at /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-001/./collection1/data/
   [junit4]   2> 1827324 INFO  (qtp8624326-16805) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={command=details} status=0 QTime=0
   [junit4]   2> 1828329 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testBackupOnCommit
   [junit4]   2> 1828330 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[EA9DEA1C70EF9584]) [    ] o.e.j.s.ServerConnector Stopped ServerConnector@26e17556{HTTP/1.1,[http/1.1]}{127.0.0.1:०}
   [junit4]   2> 1828330 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1280687733
   [junit4]   2> 1828331 INFO  (coreCloseExecutor-6296-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@a0d7213
   [junit4]   2> 1828331 INFO  (coreCloseExecutor-6296-thread-1) [    x:collection1] o.a.s.u.DirectUpdateHandler2 closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=22,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
   [junit4]   2> 1828331 INFO  (coreCloseExecutor-6296-thread-1) [    x:collection1] o.a.s.u.SolrCoreState Closing SolrCoreState
   [junit4]   2> 1828331 INFO  (coreCloseExecutor-6296-thread-1) [    x:collection1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 1828331 INFO  (coreCloseExecutor-6296-thread-1) [    x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
   [junit4]   2> 1828331 INFO  (coreCloseExecutor-6296-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request.
   [junit4]   2> 1828331 INFO  (coreCloseExecutor-6296-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 1828331 INFO  (coreCloseExecutor-6296-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-001/./collection1/data/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-001/./collection1/data/index;done=false>>]
   [junit4]   2> 1828332 INFO  (coreCloseExecutor-6296-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-001/./collection1/data/index
   [junit4]   2> 1828332 INFO  (coreCloseExecutor-6296-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-001/./collection1/data [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-001/./collection1/data;done=false>>]
   [junit4]   2> 1828332 INFO  (coreCloseExecutor-6296-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-001/./collection1/data
   [junit4]   2> 1828332 INFO  (TEST-TestReplicationHandlerBackup.testBackupOnCommit-seed#[EA9DEA1C70EF9584]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@350a4c14{/solr,null,UNAVAILABLE}
   [junit4]   2> 1828338 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.SolrTestCaseJ4 ###Starting doTestBackup
   [junit4]   2> 1828338 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-002/collection1
   [junit4]   2> 1828345 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[EA9DEA1C70EF9584]) [    ] o.e.j.s.Server jetty-9.3.6.v20151106
   [junit4]   2> 1828346 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[EA9DEA1C70EF9584]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@66d4c22b{/solr,null,AVAILABLE}
   [junit4]   2> 1828347 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[EA9DEA1C70EF9584]) [    ] o.e.j.s.ServerConnector Started ServerConnector@633cddf0{HTTP/1.1,[http/1.1]}{127.0.0.1:४१३६६}
   [junit4]   2> 1828347 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[EA9DEA1C70EF9584]) [    ] o.e.j.s.Server Started @१८३१७६८ms
   [junit4]   2> 1828347 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-002/collection1/data, hostContext=/solr, hostPort=41366}
   [junit4]   2> 1828348 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 1828348 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-002'
   [junit4]   2> 1828348 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1828348 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1828348 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-002/solr.xml
   [junit4]   2> 1828353 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-002/.
   [junit4]   2> 1828353 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.c.CoreContainer New CoreContainer 100566755
   [junit4]   2> 1828353 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-002]
   [junit4]   2> 1828353 WARN  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-002/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-002/lib
   [junit4]   2> 1828354 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1828355 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1828355 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1828355 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1828355 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1828356 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1828356 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-002/.
   [junit4]   2> 1828357 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, configSetProperties=configsetprops.json, transient=false, dataDir=data/}
   [junit4]   2> 1828357 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-002/./collection1
   [junit4]   2> 1828358 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 1828358 INFO  (coreLoadExecutor-6303-thread-1) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-002/collection1'
   [junit4]   2> 1828358 INFO  (coreLoadExecutor-6303-thread-1) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1828358 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1
   [junit4]   2> 1828358 INFO  (coreLoadExecutor-6303-thread-1) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1828358 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1828364 INFO  (coreLoadExecutor-6303-thread-1) [    ] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1828367 WARN  (coreLoadExecutor-6303-thread-1) [    ] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 1828367 INFO  (coreLoadExecutor-6303-thread-1) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.1.0
   [junit4]   2> 1828373 INFO  (coreLoadExecutor-6303-thread-1) [    ] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1828375 INFO  (coreLoadExecutor-6303-thread-1) [    ] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1828378 INFO  (coreLoadExecutor-6303-thread-1) [    ] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1828380 INFO  (coreLoadExecutor-6303-thread-1) [    ] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-002/collection1'
   [junit4]   2> 1828380 INFO  (coreLoadExecutor-6303-thread-1) [    ] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from instancedir /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-002/./collection1
   [junit4]   2> 1828380 INFO  (coreLoadExecutor-6303-thread-1) [    x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1828380 INFO  (coreLoadExecutor-6303-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-002/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-002/./collection1/data/]
   [junit4]   2> 1828380 INFO  (coreLoadExecutor-6303-thread-1) [    x:collection1] o.a.s.c.SolrCore JMX monitoring not detected for core: collection1
   [junit4]   2> 1828381 INFO  (coreLoadExecutor-6303-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-002/./collection1/data
   [junit4]   2> 1828381 INFO  (coreLoadExecutor-6303-thread-1) [    x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-002/./collection1/data/index/
   [junit4]   2> 1828381 WARN  (coreLoadExecutor-6303-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-002/./collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1828381 INFO  (coreLoadExecutor-6303-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-002/./collection1/data/index
   [junit4]   2> 1828382 INFO  (coreLoadExecutor-6303-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=41, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.25799353101933087]
   [junit4]   2> 1828382 INFO  (coreLoadExecutor-6303-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@231557aa lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@344f6e7),segFN=segments_1,generation=1}
   [junit4]   2> 1828382 INFO  (coreLoadExecutor-6303-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 1828383 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [    x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-002/./collection1/data/
   [junit4]   2> 1828385 INFO  (coreLoadExecutor-6303-thread-1) [    x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1828387 INFO  (coreLoadExecutor-6303-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1828388 INFO  (coreLoadExecutor-6303-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1828388 INFO  (coreLoadExecutor-6303-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1828389 INFO  (coreLoadExecutor-6303-thread-1) [    x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1828390 INFO  (coreLoadExecutor-6303-thread-1) [    x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/ping,/admin/threads,/update,/admin/file
   [junit4]   2> 1828390 INFO  (coreLoadExecutor-6303-thread-1) [    x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1828391 INFO  (coreLoadExecutor-6303-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1828391 INFO  (coreLoadExecutor-6303-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1828391 INFO  (coreLoadExecutor-6303-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=47, maxMergedSegmentMB=65.5986328125, floorSegmentMB=0.7763671875, forceMergeDeletesPctAllowed=18.447000057497995, segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 1828391 INFO  (coreLoadExecutor-6303-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@231557aa lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@344f6e7),segFN=segments_1,generation=1}
   [junit4]   2> 1828391 INFO  (coreLoadExecutor-6303-thread-1) [    x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 1828391 INFO  (coreLoadExecutor-6303-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@38132c08[collection1] main]
   [junit4]   2> 1828392 INFO  (coreLoadExecutor-6303-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-002/collection1/conf
   [junit4]   2> 1828392 INFO  (coreLoadExecutor-6303-thread-1) [    x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-002/collection1/conf}
   [junit4]   2> 1828392 INFO  (coreLoadExecutor-6303-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-002/collection1/conf
   [junit4]   2> 1828392 INFO  (coreLoadExecutor-6303-thread-1) [    x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 1828392 INFO  (coreLoadExecutor-6303-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Replication enabled for following config files: schema-replication2.xml:schema.xml
   [junit4]   2> 1828392 INFO  (coreLoadExecutor-6303-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1828393 INFO  (coreLoadExecutor-6303-thread-1) [    x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 1828393 INFO  (searcherExecutor-6304-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@38132c08[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1828861 INFO  (qtp1815024541-16827) [    x:collection1] o.a.s.u.DirectUpdateHandler2 [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 1828861 INFO  (qtp1815024541-16827) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{deleteByQuery=*:*} 0 0
   [junit4]   2> 1828864 INFO  (qtp1815024541-16828) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[0]} 0 1
   [junit4]   2> 1828866 INFO  (qtp1815024541-16829) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[1]} 0 0
   [junit4]   2> 1828868 INFO  (qtp1815024541-16830) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[2]} 0 0
   [junit4]   2> 1828869 INFO  (qtp1815024541-16830) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[3]} 0 0
   [junit4]   2> 1828871 INFO  (qtp1815024541-16830) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[4]} 0 0
   [junit4]   2> 1828873 INFO  (qtp1815024541-16830) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[5]} 0 0
   [junit4]   2> 1828874 INFO  (qtp1815024541-16828) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[6]} 0 0
   [junit4]   2> 1828876 INFO  (qtp1815024541-16829) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[7]} 0 0
   [junit4]   2> 1828878 INFO  (qtp1815024541-16831) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[8]} 0 0
   [junit4]   2> 1828879 INFO  (qtp1815024541-16831) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[9]} 0 0
   [junit4]   2> 1828881 INFO  (qtp1815024541-16831) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[10]} 0 0
   [junit4]   2> 1828883 INFO  (qtp1815024541-16831) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[11]} 0 0
   [junit4]   2> 1828884 INFO  (qtp1815024541-16828) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[12]} 0 0
   [junit4]   2> 1828886 INFO  (qtp1815024541-16829) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[13]} 0 0
   [junit4]   2> 1828888 INFO  (qtp1815024541-16824) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[14]} 0 0
   [junit4]   2> 1828890 INFO  (qtp1815024541-16824) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[15]} 0 0
   [junit4]   2> 1828892 INFO  (qtp1815024541-16830) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[16]} 0 0
   [junit4]   2> 1828894 INFO  (qtp1815024541-16831) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[17]} 0 0
   [junit4]   2> 1828895 INFO  (qtp1815024541-16828) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[18]} 0 0
   [junit4]   2> 1828897 INFO  (qtp1815024541-16829) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[19]} 0 0
   [junit4]   2> 1828899 INFO  (qtp1815024541-16827) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[20]} 0 0
   [junit4]   2> 1828901 INFO  (qtp1815024541-16827) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[21]} 0 0
   [junit4]   2> 1828903 INFO  (qtp1815024541-16830) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[22]} 0 0
   [junit4]   2> 1828905 INFO  (qtp1815024541-16831) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[23]} 0 0
   [junit4]   2> 1828907 INFO  (qtp1815024541-16828) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[24]} 0 0
   [junit4]   2> 1828908 INFO  (qtp1815024541-16829) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[25]} 0 0
   [junit4]   2> 1828910 INFO  (qtp1815024541-16824) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[26]} 0 0
   [junit4]   2> 1828912 INFO  (qtp1815024541-16827) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[27]} 0 0
   [junit4]   2> 1828914 INFO  (qtp1815024541-16830) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[28]} 0 0
   [junit4]   2> 1828916 INFO  (qtp1815024541-16831) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[29]} 0 0
   [junit4]   2> 1828918 INFO  (qtp1815024541-16828) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[30]} 0 0
   [junit4]   2> 1828920 INFO  (qtp1815024541-16829) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[31]} 0 0
   [junit4]   2> 1828921 INFO  (qtp1815024541-16824) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[32]} 0 0
   [junit4]   2> 1828923 INFO  (qtp1815024541-16827) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[33]} 0 0
   [junit4]   2> 1828925 INFO  (qtp1815024541-16830) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[34]} 0 0
   [junit4]   2> 1828927 INFO  (qtp1815024541-16831) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[35]} 0 0
   [junit4]   2> 1828928 INFO  (qtp1815024541-16828) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[36]} 0 0
   [junit4]   2> 1828930 INFO  (qtp1815024541-16829) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[37]} 0 0
   [junit4]   2> 1828932 INFO  (qtp1815024541-16824) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[38]} 0 0
   [junit4]   2> 1828936 INFO  (qtp1815024541-16827) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[39]} 0 0
   [junit4]   2> 1828938 INFO  (qtp1815024541-16830) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[40]} 0 0
   [junit4]   2> 1828940 INFO  (qtp1815024541-16831) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[41]} 0 0
   [junit4]   2> 1828942 INFO  (qtp1815024541-16828) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[42]} 0 0
   [junit4]   2> 1828943 INFO  (qtp1815024541-16829) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[43]} 0 0
   [junit4]   2> 1828945 INFO  (qtp1815024541-16824) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[44]} 0 0
   [junit4]   2> 1828947 INFO  (qtp1815024541-16827) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[45]} 0 0
   [junit4]   2> 1828948 INFO  (qtp1815024541-16830) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={wt=javabin&version=2}{add=[46]} 0 0
   [junit4]   2> 1828950 INFO  (qtp1815024541-16831) [    x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1828953 INFO  (qtp1815024541-16831) [    x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@231557aa lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@344f6e7),segFN=segments_1,generation=1}
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@231557aa lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@344f6e7),segFN=segments_2,generation=2}
   [junit4]   2> 1828953 INFO  (qtp1815024541-16831) [    x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 2
   [junit4]   2> 1828955 INFO  (Thread-8666) [    x:collection1] o.a.s.h.SnapShooter Creating backup snapshot <not named> at /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-002/./collection1/data/
   [junit4]   2> 1828955 INFO  (qtp1815024541-16831) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@5b6a5a81[collection1] main]
   [junit4]   2> 1828956 INFO  (qtp1815024541-16831) [    x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1828956 INFO  (searcherExecutor-6304-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@5b6a5a81[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.1.0):C47)))}
   [junit4]   2> 1828956 INFO  (qtp1815024541-16831) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 5
   [junit4]   2> 1828960 INFO  (qtp1815024541-16829) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={command=backup} status=0 QTime=2
   [junit4]   2> 1828961 INFO  (Thread-8667) [    x:collection1] o.a.s.h.SnapShooter Creating backup snapshot <not named> at /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-002/./collection1/data/
   [junit4]   2> 1828963 INFO  (qtp1815024541-16828) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={command=details} status=0 QTime=0
   [junit4]   2> 1828968 INFO  (Thread-8667) [    x:collection1] o.a.s.h.SnapShooter Done creating backup snapshot: <not named> at /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-002/./collection1/data/
   [junit4]   2> 1828971 ERROR (Thread-8666) [    x:collection1] o.a.s.h.SnapShooter Exception while creating snapshot
   [junit4]   2> java.nio.file.NoSuchFileException: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-002/collection1/data/snapshot.20160311154925509/_0.fnm
   [junit4]   2> 	at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
   [junit4]   2> 	at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
   [junit4]   2> 	at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
   [junit4]   2> 	at sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214)
   [junit4]   2> 	at java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:434)
   [junit4]   2> 	at java.nio.file.Files.newOutputStream(Files.java:216)
   [junit4]   2> 	at org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:408)
   [junit4]   2> 	at org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:404)
   [junit4]   2> 	at org.apache.lucene.store.FSDirectory.createOutput(FSDirectory.java:253)
   [junit4]   2> 	at org.apache.lucene.store.Directory.copyFrom(Directory.java:154)
   [junit4]   2> 	at org.apache.solr.handler.SnapShooter.copyFiles(SnapShooter.java:203)
   [junit4]   2> 	at org.apache.solr.handler.SnapShooter.createSnapshot(SnapShooter.java:136)
   [junit4]   2> 	at org.apache.solr.handler.SnapShooter$1.run(SnapShooter.java:85)
   [junit4]   2> 1829966 INFO  (qtp1815024541-16827) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp=/solr path=/replication params={command=details} status=0 QTime=0
   [junit4]   2> 1829966 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.SolrTestCaseJ4 ###Ending doTestBackup
   [junit4]   2> 1829967 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[EA9DEA1C70EF9584]) [    ] o.e.j.s.ServerConnector Stopped ServerConnector@633cddf0{HTTP/1.1,[http/1.1]}{127.0.0.1:०}
   [junit4]   2> 1829967 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[EA9DEA1C70EF9584]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=100566755
   [junit4]   2> 1829968 INFO  (coreCloseExecutor-6308-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@5ce4e858
   [junit4]   2> 1829968 INFO  (coreCloseExecutor-6308-thread-1) [    x:collection1] o.a.s.u.DirectUpdateHandler2 closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=47,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0}
   [junit4]   2> 1829968 INFO  (coreCloseExecutor-6308-thread-1) [    x:collection1] o.a.s.u.SolrCoreState Closing SolrCoreState
   [junit4]   2> 1829968 INFO  (coreCloseExecutor-6308-thread-1) [    x:collection1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 1829968 INFO  (coreCloseExecutor-6308-thread-1) [    x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
   [junit4]   2> 1829969 INFO  (coreCloseExecutor-6308-thread-1) [    x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request.
   [junit4]   2> 1829969 INFO  (coreCloseExecutor-6308-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 1829969 INFO  (coreCloseExecutor-6308-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-002/./collection1/data [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-002/./collection1/data;done=false>>]
   [junit4]   2> 1829969 INFO  (coreCloseExecutor-6308-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-002/./collection1/data
   [junit4]   2> 1829969 INFO  (coreCloseExecutor-6308-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-002/./collection1/data/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-002/./collection1/data/index;done=false>>]
   [junit4]   2> 1829969 INFO  (coreCloseExecutor-6308-thread-1) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001/solr-instance-002/./collection1/data/index
   [junit4]   2> 1829970 INFO  (TEST-TestReplicationHandlerBackup.doTestBackup-seed#[EA9DEA1C70EF9584]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@66d4c22b{/solr,null,UNAVAILABLE}
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestReplicationHandlerBackup -Dtests.method=doTestBackup -Dtests.seed=EA9DEA1C70EF9584 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=hi-IN -Dtests.timezone=Asia/Thimphu -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] FAILURE 1.64s J1 | TestReplicationHandlerBackup.doTestBackup <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Failed to create backup
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([EA9DEA1C70EF9584:AB16CA79575166CB]:0)
   [junit4]    > 	at org.apache.solr.handler.CheckBackupStatus.fetchStatus(CheckBackupStatus.java:50)
   [junit4]    > 	at org.apache.solr.handler.TestReplicationHandlerBackup.doTestBackup(TestReplicationHandlerBackup.java:200)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1829973 INFO  (SUITE-TestReplicationHandlerBackup-seed#[EA9DEA1C70EF9584]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandlerBackup_EA9DEA1C70EF9584-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene60): {name=PostingsFormat(name=LuceneFixedGap), id=PostingsFormat(name=LuceneFixedGap)}, docValues:{}, maxPointsInLeafNode=1008, maxMBSortInHeap=5.365111381507196, sim=RandomSimilarity(queryNorm=false,coord=no): {}, locale=hi-IN, timezone=Asia/Thimphu
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=182618032,total=533200896
   [junit4]   2> NOTE: All tests run in this JVM: [DeleteShardTest, SoftAutoCommitTest, SpellPossibilityIteratorTest, DateRangeFieldTest, SortByFunctionTest, TestSolrCoreProperties, WordBreakSolrSpellCheckerTest, RuleEngineTest, HdfsCollectionsAPIDistributedZkTest, AnalysisErrorHandlingTest, TestMiniSolrCloudClusterBase, HdfsDirectoryTest, TestDFRSimilarityFactory, SuggesterFSTTest, ZkControllerTest, DistributedFacetPivotLongTailTest, TestDistributedGrouping, TestSQLHandler, FileUtilsTest, TestCodecSupport, TestCollapseQParserPlugin, TestUpdate, TimeZoneUtilsTest, CursorMarkTest, TestSizeLimitedDistributedMap, CollectionReloadTest, ShardSplitTest, SortSpecParsingTest, TestLMJelinekMercerSimilarityFactory, NumericFieldsTest, MinimalSchemaTest, TestConfigSetProperties, SpatialRPTFieldTypeTest, IndexBasedSpellCheckerTest, DistributedIntervalFacetingTest, TestRandomCollapseQParserPlugin, TestManagedResourceStorage, DistributedTermsComponentTest, HLLUtilTest, DistanceFunctionTest, OverriddenZkACLAndCredentialsProvidersTest, TestStandardQParsers, DirectSolrSpellCheckerTest, ConvertedLegacyTest, TestBM25SimilarityFactory, ChaosMonkeyNothingIsSafeTest, TestRandomRequestDistribution, TestSolrConfigHandler, VersionInfoTest, ConfigSetsAPITest, JavabinLoaderTest, GraphQueryTest, TestCursorMarkWithoutUniqueKey, UniqFieldsUpdateProcessorFactoryTest, TestIntervalFaceting, MBeansHandlerTest, CSVRequestHandlerTest, BigEndianAscendingWordDeserializerTest, BlockJoinFacetDistribTest, TestDefaultStatsCache, SolrCmdDistributorTest, SpellCheckComponentTest, TestFastLRUCache, TestRecoveryHdfs, TestSchemaNameResource, TestWordDelimiterFilterFactory, CdcrReplicationHandlerTest, MigrateRouteKeyTest, OpenExchangeRatesOrgProviderTest, ClusterStateUpdateTest, DistribDocExpirationUpdateProcessorTest, SchemaVersionSpecificBehaviorTest, SpatialFilterTest, ZkSolrClientTest, RequestLoggingTest, DocValuesTest, RollingRestartTest, DeleteInactiveReplicaTest, TestAuthenticationFramework, TestRequestForwarding, HdfsRecoveryZkTest, HighlighterTest, TestSystemIdResolver, HdfsWriteToMultipleCollectionsTest, DirectoryFactoryTest, TestEmbeddedSolrServerConstructors, TestUseDocValuesAsStored2, PKIAuthenticationIntegrationTest, SpellCheckCollatorTest, TestStressVersions, DistributedFacetPivotWhiteBoxTest, TestExpandComponent, TestXmlQParser, TestReplicationHandler, TestStressReorder, HardAutoCommitTest, SolrCoreTest, TestFunctionQuery, TestLazyCores, SimplePostToolTest, AnalysisAfterCoreReloadTest, CoreAdminHandlerTest, TestCSVLoader, QueryEqualityTest, TestSolrDeletionPolicy1, DebugComponentTest, LukeRequestHandlerTest, RequestHandlersTest, MoreLikeThisHandlerTest, SolrPluginUtilsTest, ReturnFieldsTest, TestPartialUpdateDeduplication, TestBinaryResponseWriter, SOLR749Test, TestQuerySenderListener, AlternateDirectoryTest, TestSolrIndexConfig, TestQuerySenderNoQuery, SolrIndexConfigTest, TestSolrDeletionPolicy2, MultiTermTest, SampleTest, TestDocSet, TestSearchPerf, TestConfig, OutputWriterTest, TestFuzzyAnalyzedSuggestions, TestPostingsSolrHighlighter, NotRequiredUniqueKeyTest, TestPhraseSuggestions, TestXIncludeConfig, TestFastWriter, ScriptEngineTest, URLClassifyProcessorTest, DateMathParserTest, PreAnalyzedFieldTest, PrimUtilsTest, DateFieldTest, SpellingQueryConverterTest, DOMUtilTest, ClusterStateTest, SliceStateTest, UUIDFieldTest, TestHighlightDedupGrouping, TestTolerantSearch, ConnectionReuseTest, AssignTest, AsyncMigrateRouteKeyTest, CollectionsAPIAsyncDistributedZkTest, HttpPartitionTest, TestConfigSetsAPI, TestDistribDocBasedVersion, TestLeaderElectionZkExpiry, TestMiniSolrCloudClusterSSL, TestRebalanceLeaders, TriLevelCompositeIdRoutingTest, HdfsDirectoryFactoryTest, QueryResultKeyTest, TestConfigOverlay, TestConfigSetImmutable, TestDynamicLoading, TestReplicationHandlerBackup]
   [junit4] Completed [479/579 (1!)] on J1 in 3.27s, 2 tests, 1 failure <<< FAILURES!

[...truncated 303 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/build.xml:740: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/build.xml:684: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/common-build.xml:524: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/lucene/common-build.xml:1457: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/lucene/common-build.xml:1014: There were test failures: 579 suites (10 ignored), 2314 tests, 1 failure, 86 ignored (70 assumptions) [seed: EA9DEA1C70EF9584]

Total time: 60 minutes 48 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-Tests-6.x - Build # 45 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-6.x/45/

1 tests failed.
FAILED:  org.apache.solr.search.stats.TestDistribIDF.testSimpleQuery

Error Message:
Error from server at https://127.0.0.1:52952/solr: no servers hosting shard: a

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:52952/solr: no servers hosting shard: a
	at __randomizedtesting.SeedInfo.seed([46BA07B637298132:33B7C7AA273347E7]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:149)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:942)
	at org.apache.solr.search.stats.TestDistribIDF.testSimpleQuery(TestDistribIDF.java:125)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11249 lines...]
   [junit4] Suite: org.apache.solr.search.stats.TestDistribIDF
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_46BA07B637298132-001/init-core-data-001
   [junit4]   2> 789434 INFO  (SUITE-TestDistribIDF-seed#[46BA07B637298132]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false)
   [junit4]   2> 789435 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testMultiCollectionQuery
   [junit4]   2> 789436 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 789436 INFO  (Thread-2476) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 789436 INFO  (Thread-2476) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 789536 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.ZkTestServer start zk server on port:35046
   [junit4]   2> 789536 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 789537 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 789539 INFO  (zkCallback-1348-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4751fc09 name:ZooKeeperConnection Watcher:127.0.0.1:35046 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 789539 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 789540 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 789540 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr/solr.xml
   [junit4]   2> 789542 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr/clusterprops.json
   [junit4]   2> 789548 INFO  (jetty-launcher-1347-thread-1) [    ] o.e.j.s.Server jetty-9.3.6.v20151106
   [junit4]   2> 789553 INFO  (jetty-launcher-1347-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6ce7623f{/solr,null,AVAILABLE}
   [junit4]   2> 789557 INFO  (jetty-launcher-1347-thread-1) [    ] o.e.j.u.s.SslContextFactory x509=X509@328c6e3(solrtest,h=[],w=[]) for SslContextFactory@75651dff(file:///x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/server/etc/test/solrtest.keystore,file:///x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/server/etc/test/solrtest.keystore)
   [junit4]   2> 789561 INFO  (jetty-launcher-1347-thread-2) [    ] o.e.j.s.Server jetty-9.3.6.v20151106
   [junit4]   2> 789565 INFO  (jetty-launcher-1347-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@d39b7da{/solr,null,AVAILABLE}
   [junit4]   2> 789566 INFO  (jetty-launcher-1347-thread-2) [    ] o.e.j.u.s.SslContextFactory x509=X509@4d519d36(solrtest,h=[],w=[]) for SslContextFactory@de12656(file:///x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/server/etc/test/solrtest.keystore,file:///x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/server/etc/test/solrtest.keystore)
   [junit4]   2> 789567 INFO  (jetty-launcher-1347-thread-1) [    ] o.e.j.s.ServerConnector Started ServerConnector@6c342064{SSL,[ssl, http/1.1]}{127.0.0.1:42870}
   [junit4]   2> 789567 INFO  (jetty-launcher-1347-thread-1) [    ] o.e.j.s.Server Started @792983ms
   [junit4]   2> 789567 INFO  (jetty-launcher-1347-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42870}
   [junit4]   2> 789568 INFO  (jetty-launcher-1347-thread-1) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 789568 INFO  (jetty-launcher-1347-thread-1) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_46BA07B637298132-001/tempDir-001/node1'
   [junit4]   2> 789568 INFO  (jetty-launcher-1347-thread-1) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 789568 INFO  (jetty-launcher-1347-thread-1) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 789568 INFO  (jetty-launcher-1347-thread-1) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 789576 INFO  (jetty-launcher-1347-thread-1) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 789576 INFO  (jetty-launcher-1347-thread-2) [    ] o.e.j.s.ServerConnector Started ServerConnector@22e777b4{SSL,[ssl, http/1.1]}{127.0.0.1:53095}
   [junit4]   2> 789576 INFO  (jetty-launcher-1347-thread-2) [    ] o.e.j.s.Server Started @792993ms
   [junit4]   2> 789576 INFO  (jetty-launcher-1347-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=53095}
   [junit4]   2> 789577 INFO  (jetty-launcher-1347-thread-2) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 789577 INFO  (jetty-launcher-1347-thread-2) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_46BA07B637298132-001/tempDir-001/node2'
   [junit4]   2> 789577 INFO  (jetty-launcher-1347-thread-2) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 789577 INFO  (jetty-launcher-1347-thread-2) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 789577 INFO  (jetty-launcher-1347-thread-2) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 789579 INFO  (jetty-launcher-1347-thread-2) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 789579 INFO  (jetty-launcher-1347-thread-3) [    ] o.e.j.s.Server jetty-9.3.6.v20151106
   [junit4]   2> 789581 INFO  (jetty-launcher-1347-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5fe45731{/solr,null,AVAILABLE}
   [junit4]   2> 789582 INFO  (jetty-launcher-1347-thread-3) [    ] o.e.j.u.s.SslContextFactory x509=X509@21dfd216(solrtest,h=[],w=[]) for SslContextFactory@70a08b32(file:///x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/server/etc/test/solrtest.keystore,file:///x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/server/etc/test/solrtest.keystore)
   [junit4]   2> 789593 INFO  (zkCallback-1349-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1c2a5fb5 name:ZooKeeperConnection Watcher:127.0.0.1:35046/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 789593 INFO  (jetty-launcher-1347-thread-3) [    ] o.e.j.s.ServerConnector Started ServerConnector@f5d87a6{SSL,[ssl, http/1.1]}{127.0.0.1:35787}
   [junit4]   2> 789594 INFO  (jetty-launcher-1347-thread-1) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 789594 INFO  (jetty-launcher-1347-thread-3) [    ] o.e.j.s.Server Started @793010ms
   [junit4]   2> 789594 INFO  (jetty-launcher-1347-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35787}
   [junit4]   2> 789594 INFO  (jetty-launcher-1347-thread-1) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 789594 INFO  (jetty-launcher-1347-thread-3) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 789594 INFO  (jetty-launcher-1347-thread-3) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_46BA07B637298132-001/tempDir-001/node3'
   [junit4]   2> 789594 INFO  (jetty-launcher-1347-thread-3) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 789594 INFO  (jetty-launcher-1347-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 789594 INFO  (jetty-launcher-1347-thread-3) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 789595 INFO  (jetty-launcher-1347-thread-3) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 789595 INFO  (zkCallback-1350-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@48f80883 name:ZooKeeperConnection Watcher:127.0.0.1:35046/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 789595 INFO  (jetty-launcher-1347-thread-2) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 789595 INFO  (jetty-launcher-1347-thread-2) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 789596 INFO  (jetty-launcher-1347-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 789601 INFO  (jetty-launcher-1347-thread-3) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 789602 INFO  (jetty-launcher-1347-thread-1) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_46BA07B637298132-001/tempDir-001/node1/.
   [junit4]   2> 789602 INFO  (jetty-launcher-1347-thread-1) [    ] o.a.s.c.CoreContainer New CoreContainer 1911421478
   [junit4]   2> 789602 INFO  (jetty-launcher-1347-thread-1) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_46BA07B637298132-001/tempDir-001/node1]
   [junit4]   2> 789602 INFO  (zkCallback-1351-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2879b3ab name:ZooKeeperConnection Watcher:127.0.0.1:35046/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 789603 INFO  (jetty-launcher-1347-thread-3) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 789603 WARN  (jetty-launcher-1347-thread-1) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_46BA07B637298132-001/tempDir-001/node1/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_46BA07B637298132-001/tempDir-001/node1/lib
   [junit4]   2> 789603 INFO  (jetty-launcher-1347-thread-3) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 789603 INFO  (jetty-launcher-1347-thread-1) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : https,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 789603 INFO  (jetty-launcher-1347-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 789605 INFO  (jetty-launcher-1347-thread-1) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 789606 INFO  (jetty-launcher-1347-thread-1) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 789606 INFO  (jetty-launcher-1347-thread-1) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 789607 INFO  (jetty-launcher-1347-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35046/solr
   [junit4]   2> 789607 INFO  (jetty-launcher-1347-thread-1) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 789607 INFO  (jetty-launcher-1347-thread-1) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 789613 INFO  (jetty-launcher-1347-thread-1) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 789614 INFO  (jetty-launcher-1347-thread-3) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_46BA07B637298132-001/tempDir-001/node3/.
   [junit4]   2> 789614 INFO  (zkCallback-1354-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4db270c name:ZooKeeperConnection Watcher:127.0.0.1:35046 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 789615 INFO  (jetty-launcher-1347-thread-3) [    ] o.a.s.c.CoreContainer New CoreContainer 1606427649
   [junit4]   2> 789615 INFO  (jetty-launcher-1347-thread-3) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_46BA07B637298132-001/tempDir-001/node3]
   [junit4]   2> 789615 INFO  (jetty-launcher-1347-thread-1) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 789615 WARN  (jetty-launcher-1347-thread-3) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_46BA07B637298132-001/tempDir-001/node3/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_46BA07B637298132-001/tempDir-001/node3/lib
   [junit4]   2> 789615 INFO  (jetty-launcher-1347-thread-1) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 789615 INFO  (jetty-launcher-1347-thread-3) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : https,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 789615 INFO  (jetty-launcher-1347-thread-2) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_46BA07B637298132-001/tempDir-001/node2/.
   [junit4]   2> 789615 INFO  (jetty-launcher-1347-thread-2) [    ] o.a.s.c.CoreContainer New CoreContainer 1209036720
   [junit4]   2> 789615 INFO  (jetty-launcher-1347-thread-2) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_46BA07B637298132-001/tempDir-001/node2]
   [junit4]   2> 789616 WARN  (jetty-launcher-1347-thread-2) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_46BA07B637298132-001/tempDir-001/node2/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_46BA07B637298132-001/tempDir-001/node2/lib
   [junit4]   2> 789616 INFO  (jetty-launcher-1347-thread-2) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : https,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 789617 INFO  (jetty-launcher-1347-thread-2) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 789619 INFO  (jetty-launcher-1347-thread-2) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 789619 INFO  (jetty-launcher-1347-thread-2) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 789619 INFO  (jetty-launcher-1347-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35046/solr
   [junit4]   2> 789619 INFO  (jetty-launcher-1347-thread-2) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 789619 INFO  (jetty-launcher-1347-thread-2) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 789620 INFO  (jetty-launcher-1347-thread-1) [n:127.0.0.1:42870_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 789630 INFO  (jetty-launcher-1347-thread-2) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 789631 INFO  (jetty-launcher-1347-thread-3) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 789632 INFO  (zkCallback-1358-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2d1b1e33 name:ZooKeeperConnection Watcher:127.0.0.1:35046 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 789633 INFO  (jetty-launcher-1347-thread-2) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 789633 INFO  (jetty-launcher-1347-thread-2) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 789635 INFO  (jetty-launcher-1347-thread-3) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 789635 INFO  (jetty-launcher-1347-thread-3) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 789635 INFO  (jetty-launcher-1347-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35046/solr
   [junit4]   2> 789635 INFO  (jetty-launcher-1347-thread-3) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 789635 INFO  (jetty-launcher-1347-thread-3) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 789635 INFO  (jetty-launcher-1347-thread-2) [n:127.0.0.1:53095_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 789645 INFO  (jetty-launcher-1347-thread-3) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 789649 INFO  (zkCallback-1361-thread-1-processing-n:127.0.0.1:53095_solr) [n:127.0.0.1:53095_solr    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@32e814e name:ZooKeeperConnection Watcher:127.0.0.1:35046/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 789649 INFO  (jetty-launcher-1347-thread-2) [n:127.0.0.1:53095_solr    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 789650 INFO  (zkCallback-1355-thread-1-processing-n:127.0.0.1:42870_solr) [n:127.0.0.1:42870_solr    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3b15f517 name:ZooKeeperConnection Watcher:127.0.0.1:35046/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 789650 INFO  (jetty-launcher-1347-thread-1) [n:127.0.0.1:42870_solr    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 789651 INFO  (jetty-launcher-1347-thread-1) [n:127.0.0.1:42870_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 789651 INFO  (jetty-launcher-1347-thread-2) [n:127.0.0.1:53095_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 789652 INFO  (jetty-launcher-1347-thread-2) [n:127.0.0.1:53095_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 789653 INFO  (jetty-launcher-1347-thread-1) [n:127.0.0.1:42870_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 789655 INFO  (zkCallback-1362-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@b507fd4 name:ZooKeeperConnection Watcher:127.0.0.1:35046 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 789655 INFO  (jetty-launcher-1347-thread-3) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 789655 INFO  (jetty-launcher-1347-thread-3) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 789656 INFO  (jetty-launcher-1347-thread-1) [n:127.0.0.1:42870_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 789660 INFO  (jetty-launcher-1347-thread-2) [n:127.0.0.1:53095_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 789662 INFO  (jetty-launcher-1347-thread-3) [n:127.0.0.1:35787_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 789662 INFO  (jetty-launcher-1347-thread-2) [n:127.0.0.1:53095_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 789662 INFO  (jetty-launcher-1347-thread-1) [n:127.0.0.1:42870_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 789664 INFO  (jetty-launcher-1347-thread-1) [n:127.0.0.1:42870_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 789664 INFO  (jetty-launcher-1347-thread-2) [n:127.0.0.1:53095_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 789666 INFO  (jetty-launcher-1347-thread-1) [n:127.0.0.1:42870_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 789666 INFO  (jetty-launcher-1347-thread-2) [n:127.0.0.1:53095_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 789667 INFO  (jetty-launcher-1347-thread-2) [n:127.0.0.1:53095_solr    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 789667 INFO  (jetty-launcher-1347-thread-1) [n:127.0.0.1:42870_solr    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 789668 INFO  (jetty-launcher-1347-thread-1) [n:127.0.0.1:42870_solr    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 789668 INFO  (jetty-launcher-1347-thread-2) [n:127.0.0.1:53095_solr    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 789669 INFO  (jetty-launcher-1347-thread-1) [n:127.0.0.1:42870_solr    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 789669 INFO  (jetty-launcher-1347-thread-2) [n:127.0.0.1:53095_solr    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 789669 INFO  (jetty-launcher-1347-thread-1) [n:127.0.0.1:42870_solr    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 789669 INFO  (jetty-launcher-1347-thread-2) [n:127.0.0.1:53095_solr    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 789670 INFO  (jetty-launcher-1347-thread-2) [n:127.0.0.1:53095_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 789670 INFO  (jetty-launcher-1347-thread-1) [n:127.0.0.1:42870_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 789671 INFO  (jetty-launcher-1347-thread-2) [n:127.0.0.1:53095_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 789671 INFO  (jetty-launcher-1347-thread-1) [n:127.0.0.1:42870_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 789673 INFO  (jetty-launcher-1347-thread-2) [n:127.0.0.1:53095_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 789673 INFO  (jetty-launcher-1347-thread-1) [n:127.0.0.1:42870_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 789674 INFO  (jetty-launcher-1347-thread-1) [n:127.0.0.1:42870_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 789674 INFO  (jetty-launcher-1347-thread-2) [n:127.0.0.1:53095_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 789675 INFO  (jetty-launcher-1347-thread-1) [n:127.0.0.1:42870_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 789675 INFO  (jetty-launcher-1347-thread-2) [n:127.0.0.1:53095_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 789675 INFO  (jetty-launcher-1347-thread-1) [n:127.0.0.1:42870_solr    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95539021581844485-127.0.0.1:42870_solr-n_0000000000
   [junit4]   2> 789675 INFO  (jetty-launcher-1347-thread-2) [n:127.0.0.1:53095_solr    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95539021581844487-127.0.0.1:53095_solr-n_0000000001
   [junit4]   2> 789676 INFO  (jetty-launcher-1347-thread-1) [n:127.0.0.1:42870_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:42870_solr
   [junit4]   2> 789676 INFO  (jetty-launcher-1347-thread-1) [n:127.0.0.1:42870_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 789676 INFO  (jetty-launcher-1347-thread-2) [n:127.0.0.1:53095_solr    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95539021581844485-127.0.0.1:42870_solr-n_0000000000 to know if I could be the leader
   [junit4]   2> 789676 INFO  (jetty-launcher-1347-thread-2) [n:127.0.0.1:53095_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53095_solr
   [junit4]   2> 789677 INFO  (jetty-launcher-1347-thread-2) [n:127.0.0.1:53095_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:53095_solr
   [junit4]   2> 789677 INFO  (jetty-launcher-1347-thread-1) [n:127.0.0.1:42870_solr    ] o.a.s.c.Overseer Overseer (id=95539021581844485-127.0.0.1:42870_solr-n_0000000000) starting
   [junit4]   2> 789678 INFO  (zkCallback-1361-thread-1-processing-n:127.0.0.1:53095_solr) [n:127.0.0.1:53095_solr    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 789678 INFO  (zkCallback-1363-thread-1-processing-n:127.0.0.1:35787_solr) [n:127.0.0.1:35787_solr    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5c11addf name:ZooKeeperConnection Watcher:127.0.0.1:35046/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 789678 INFO  (zkCallback-1355-thread-1-processing-n:127.0.0.1:42870_solr) [n:127.0.0.1:42870_solr    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 789678 INFO  (jetty-launcher-1347-thread-3) [n:127.0.0.1:35787_solr    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 789679 INFO  (zkCallback-1361-thread-1-processing-n:127.0.0.1:53095_solr) [n:127.0.0.1:53095_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 789685 INFO  (zkCallback-1355-thread-1-processing-n:127.0.0.1:42870_solr) [n:127.0.0.1:42870_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 789686 INFO  (jetty-launcher-1347-thread-1) [n:127.0.0.1:42870_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 789692 INFO  (jetty-launcher-1347-thread-3) [n:127.0.0.1:35787_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 789693 INFO  (jetty-launcher-1347-thread-2) [n:127.0.0.1:53095_solr    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 789693 INFO  (jetty-launcher-1347-thread-2) [n:127.0.0.1:53095_solr    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 789693 INFO  (jetty-launcher-1347-thread-3) [n:127.0.0.1:35787_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 789693 INFO  (jetty-launcher-1347-thread-1) [n:127.0.0.1:42870_solr    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 789693 INFO  (jetty-launcher-1347-thread-2) [n:127.0.0.1:53095_solr    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_46BA07B637298132-001/tempDir-001/node2/.
   [junit4]   2> 789694 INFO  (jetty-launcher-1347-thread-2) [n:127.0.0.1:53095_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
   [junit4]   2> 789694 INFO  (OverseerCollectionConfigSetProcessor-95539021581844485-127.0.0.1:42870_solr-n_0000000000) [n:127.0.0.1:42870_solr    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 789695 INFO  (jetty-launcher-1347-thread-3) [n:127.0.0.1:35787_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 789694 INFO  (jetty-launcher-1347-thread-1) [n:127.0.0.1:42870_solr    ] o.a.s.c.ZkController Publish node=127.0.0.1:42870_solr as DOWN
   [junit4]   2> 789694 INFO  (OverseerStateUpdate-95539021581844485-127.0.0.1:42870_solr-n_0000000000) [n:127.0.0.1:42870_solr    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 789696 INFO  (jetty-launcher-1347-thread-3) [n:127.0.0.1:35787_solr    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95539021581844489-127.0.0.1:35787_solr-n_0000000002
   [junit4]   2> 789697 INFO  (jetty-launcher-1347-thread-3) [n:127.0.0.1:35787_solr    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95539021581844487-127.0.0.1:53095_solr-n_0000000001 to know if I could be the leader
   [junit4]   2> 789697 INFO  (jetty-launcher-1347-thread-3) [n:127.0.0.1:35787_solr    ] o.a.s.c.ZkController Publish node=127.0.0.1:35787_solr as DOWN
   [junit4]   2> 789701 INFO  (OverseerStateUpdate-95539021581844485-127.0.0.1:42870_solr-n_0000000000) [n:127.0.0.1:42870_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1)
   [junit4]   2> 789702 INFO  (jetty-launcher-1347-thread-2) [n:127.0.0.1:53095_solr    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2
   [junit4]   2> 789702 INFO  (jetty-launcher-1347-thread-2) [n:127.0.0.1:53095_solr    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 789703 INFO  (OverseerStateUpdate-95539021581844485-127.0.0.1:42870_solr-n_0000000000) [n:127.0.0.1:42870_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:42870_solr"} current state version: 0
   [junit4]   2> 789703 INFO  (OverseerStateUpdate-95539021581844485-127.0.0.1:42870_solr-n_0000000000) [n:127.0.0.1:42870_solr    ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:42870_solr
   [junit4]   2> 789704 INFO  (OverseerStateUpdate-95539021581844485-127.0.0.1:42870_solr-n_0000000000) [n:127.0.0.1:42870_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:35787_solr"} current state version: 0
   [junit4]   2> 789705 INFO  (OverseerStateUpdate-95539021581844485-127.0.0.1:42870_solr-n_0000000000) [n:127.0.0.1:42870_solr    ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:35787_solr
   [junit4]   2> 790697 INFO  (jetty-launcher-1347-thread-1) [n:127.0.0.1:42870_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42870_solr
   [junit4]   2> 790698 INFO  (jetty-launcher-1347-thread-1) [n:127.0.0.1:42870_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:42870_solr
   [junit4]   2> 790698 INFO  (jetty-launcher-1347-thread-3) [n:127.0.0.1:35787_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35787_solr
   [junit4]   2> 790699 INFO  (jetty-launcher-1347-thread-3) [n:127.0.0.1:35787_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:35787_solr
   [junit4]   2> 790699 INFO  (zkCallback-1355-thread-1-processing-n:127.0.0.1:42870_solr) [n:127.0.0.1:42870_solr    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 790699 INFO  (zkCallback-1361-thread-1-processing-n:127.0.0.1:53095_solr) [n:127.0.0.1:53095_solr    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 790699 INFO  (zkCallback-1363-thread-1-processing-n:127.0.0.1:35787_solr) [n:127.0.0.1:35787_solr    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 790699 INFO  (zkCallback-1361-thread-1-processing-n:127.0.0.1:53095_solr) [n:127.0.0.1:53095_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 790700 INFO  (zkCallback-1355-thread-1-processing-n:127.0.0.1:42870_solr) [n:127.0.0.1:42870_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 790700 INFO  (zkCallback-1363-thread-1-processing-n:127.0.0.1:35787_solr) [n:127.0.0.1:35787_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 790701 INFO  (zkCallback-1361-thread-1-processing-n:127.0.0.1:53095_solr) [n:127.0.0.1:53095_solr    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [2])
   [junit4]   2> 790701 INFO  (zkCallback-1361-thread-1-processing-n:127.0.0.1:53095_solr) [n:127.0.0.1:53095_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 790704 INFO  (zkCallback-1363-thread-1-processing-n:127.0.0.1:35787_solr) [n:127.0.0.1:35787_solr    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [2])
   [junit4]   2> 790704 INFO  (zkCallback-1355-thread-1-processing-n:127.0.0.1:42870_solr) [n:127.0.0.1:42870_solr    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [2])
   [junit4]   2> 790705 INFO  (zkCallback-1363-thread-1-processing-n:127.0.0.1:35787_solr) [n:127.0.0.1:35787_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 790705 INFO  (zkCallback-1355-thread-1-processing-n:127.0.0.1:42870_solr) [n:127.0.0.1:42870_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 790709 INFO  (jetty-launcher-1347-thread-1) [n:127.0.0.1:42870_solr    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 790709 INFO  (jetty-launcher-1347-thread-1) [n:127.0.0.1:42870_solr    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 790710 INFO  (jetty-launcher-1347-thread-1) [n:127.0.0.1:42870_solr    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_46BA07B637298132-001/tempDir-001/node1/.
   [junit4]   2> 790710 INFO  (jetty-launcher-1347-thread-1) [n:127.0.0.1:42870_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
   [junit4]   2> 790711 INFO  (jetty-launcher-1347-thread-1) [n:127.0.0.1:42870_solr    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2
   [junit4]   2> 790711 INFO  (jetty-launcher-1347-thread-1) [n:127.0.0.1:42870_solr    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 790712 INFO  (jetty-launcher-1347-thread-3) [n:127.0.0.1:35787_solr    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 790712 INFO  (jetty-launcher-1347-thread-3) [n:127.0.0.1:35787_solr    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 790713 INFO  (jetty-launcher-1347-thread-3) [n:127.0.0.1:35787_solr    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_46BA07B637298132-001/tempDir-001/node3/.
   [junit4]   2> 790713 INFO  (jetty-launcher-1347-thread-3) [n:127.0.0.1:35787_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
   [junit4]   2> 790714 INFO  (jetty-launcher-1347-thread-3) [n:127.0.0.1:35787_solr    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2
   [junit4]   2> 790714 INFO  (jetty-launcher-1347-thread-3) [n:127.0.0.1:35787_solr    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 790714 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 790724 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 790724 INFO  (zkCallback-1364-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@243afd47 name:ZooKeeperConnection Watcher:127.0.0.1:35046 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 790725 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 790725 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 790726 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x1536c3be393000a, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 790728 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 790729 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 790730 INFO  (zkCallback-1366-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@38941b4b name:ZooKeeperConnection Watcher:127.0.0.1:35046/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 790730 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 790730 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 790731 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-spellcheckcomponent.xml
   [junit4]   2> 790734 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-null-charfilters-analyzer.xml
   [junit4]   2> 790735 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/regex-boost-processor-test.txt
   [junit4]   2> 790737 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-spellchecker.xml
   [junit4]   2> 790739 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-multiple-asterisk-copyfield-dest-should-fail-test.xml
   [junit4]   2> 790741 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-docValuesFaceting.xml
   [junit4]   2> 790743 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-tlog-with-delayingcomponent.xml
   [junit4]   2> 790745 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-currency-ft-bogus-default-code.xml
   [junit4]   2> 790747 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-numeric.xml
   [junit4]   2> 790749 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig_codec.xml
   [junit4]   2> 790750 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-multiple-asterisk-copyfield-source-should-fail-test.xml
   [junit4]   2> 790752 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema_latest.xml
   [junit4]   2> 790754 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-sorts.xml
   [junit4]   2> 790756 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-headers.xml
   [junit4]   2> 790758 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-implicitproperties.xml
   [junit4]   2> 790759 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-solrconfig-bogus-scriptengine-name.xml
   [junit4]   2> 790765 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-snippet-types.incl
   [junit4]   2> 790767 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-parsing-update-processor-chains.xml
   [junit4]   2> 790768 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-docValuesMissing.xml
   [junit4]   2> 790770 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-noopregen.xml
   [junit4]   2> 790771 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-one-field-no-dynamic-field-unique-key.xml
   [junit4]   2> 790773 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-script-updateprocessor.xml
   [junit4]   2> 790774 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-error-solrconfig.xml
   [junit4]   2> 790776 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-suggestercomponent.xml
   [junit4]   2> 790778 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-currency.xml
   [junit4]   2> 790779 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-query-parser-init.xml
   [junit4]   2> 790781 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-caching.xml
   [junit4]   2> 790783 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/conditional.updateprocessor.js
   [junit4]   2> 790784 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-indexconfig-mergepolicyfactory.xml
   [junit4]   2> 790786 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/compoundDictionary.txt
   [junit4]   2> 790787 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-tieredmergepolicyfactory.xml
   [junit4]   2> 790789 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/phrasesuggest.txt
   [junit4]   2> 790790 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-transformers.xml
   [junit4]   2> 790792 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-not-indexed-but-norms.xml
   [junit4]   2> 790794 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/blendedInfixSuggest.txt
   [junit4]   2> 790796 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-phrasesuggest.xml
   [junit4]   2> 790797 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/hunspell-test.dic
   [junit4]   2> 790799 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-HighlighterMaxOffsetTest.xml
   [junit4]   2> 790801 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-rest-lucene-match-version.xml
   [junit4]   2> 790802 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-functionquery.xml
   [junit4]   2> 790804 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-externalversionconstraint.xml
   [junit4]   2> 790805 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-codec-global-vs-ft-mismatch.xml
   [junit4]   2> 790807 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-sim.xml
   [junit4]   2> 790808 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-docValuesMulti.xml
   [junit4]   2> 790810 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-logmergepolicyfactory.xml
   [junit4]   2> 790811 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-collapseqparser.xml
   [junit4]   2> 790813 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-analytics-query.xml
   [junit4]   2> 790815 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-sweetspot.xml
   [junit4]   2> 790816 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-searcher-listeners1.xml
   [junit4]   2> 790818 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-id-and-version-fields-only.xml
   [junit4]   2> 790820 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-solrconfig-schema-mutable-but-not-managed.xml
   [junit4]   2> 790821 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/hunspell-test.aff
   [junit4]   2> 790823 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-response-log-component.xml
   [junit4]   2> 790825 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-sim-default-does-not-exist.xml
   [junit4]   2> 790827 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-dynamicfield-required.xml
   [junit4]   2> 790829 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-not-indexed-but-pos.xml
   [junit4]   2> 790830 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-hash.xml
   [junit4]   2> 790831 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-components-name.xml
   [junit4]   2> 790833 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-mp-solrconfig.xml
   [junit4]   2> 790835 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 790837 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-xinclude.xml
   [junit4]   2> 790838 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/cross-compatible.js
   [junit4]   2> 790840 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig_perf.xml
   [junit4]   2> 790842 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-solrconfig-invalid-scriptfile.xml
   [junit4]   2> 790843 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-basic.xml
   [junit4]   2> 790845 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-sql.xml
   [junit4]   2> 790846 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-replication1.xml
   [junit4]   2> 790848 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-solrconfig-missing-scriptfile.xml
   [junit4]   2> 790849 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-altdirectory.xml
   [junit4]   2> 790851 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-distributed-missing-sort.xml
   [junit4]   2> 790852 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 790854 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-sortingmergepolicyfactory.xml
   [junit4]   2> 790855 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-tfidf.xml
   [junit4]   2> 790857 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/jasuggest.txt
   [junit4]   2> 790858 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-dup-field.xml
   [junit4]   2> 790860 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-cdcrupdatelog.xml
   [junit4]   2> 790861 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/fuzzysuggest.txt
   [junit4]   2> 790863 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-minimal.xml
   [junit4]   2> 790865 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-highlight.xml
   [junit4]   2> 790866 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-tieredmergepolicy.xml
   [junit4]   2> 790868 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-blockjoinfacetcomponent.xml
   [junit4]   2> 790872 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-version-indexed.xml
   [junit4]   2> 790874 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-unsupported-docValues.xml
   [junit4]   2> 790875 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 790877 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-lmdirichlet.xml
   [junit4]   2> 790879 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-synonym-tokenizer.xml
   [junit4]   2> 790880 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stop-2.txt
   [junit4]   2> 790882 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-non-stored-docvalues.xml
   [junit4]   2> 790884 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-sim-default-override.xml
   [junit4]   2> 790885 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-plugcollector.xml
   [junit4]   2> 790887 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-managed-schema-test.xml
   [junit4]   2> 790889 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-uniquekey-uses-default.xml
   [junit4]   2> 790890 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-sim-global-vs-ft-mismatch.xml
   [junit4]   2> 790892 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-warmer.xml
   [junit4]   2> 790893 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema11.xml
   [junit4]   2> 790895 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-tlog.xml
   [junit4]   2> 790897 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-withgethandler.xml
   [junit4]   2> 790898 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-lmjelinekmercer.xml
   [junit4]   2> 790900 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema12.xml
   [junit4]   2> 790901 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-SOLR-749.xml
   [junit4]   2> 790903 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-sweetspot-partial-hyperbolic.xml
   [junit4]   2> 790904 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-master2.xml
   [junit4]   2> 790906 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-bm25.xml
   [junit4]   2> 790908 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 790909 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-preanalyzed.xml
   [junit4]   2> 790910 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-snippet-type.xml
   [junit4]   2> 790912 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-suggestercomponent-context-filter-query.xml
   [junit4]   2> 790913 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-distrib-interval-faceting.xml
   [junit4]   2> 790915 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-master1.xml
   [junit4]   2> 790916 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-currency-ft-oer-norates.xml
   [junit4]   2> 790918 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-schemaless.xml
   [junit4]   2> 790919 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-dynamicfield-default-val.xml
   [junit4]   2> 790921 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-sweetspot-partial-norms.xml
   [junit4]   2> 790922 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/elevate.xml
   [junit4]   2> 790924 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-required-fields.xml
   [junit4]   2> 790925 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-doc-expire-update-processor.xml
   [junit4]   2> 790927 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-charfilters.xml
   [junit4]   2> 790928 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-querysender.xml
   [junit4]   2> 790930 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-nontext-analyzer.xml
   [junit4]   2> 790931 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/frenchArticles.txt
   [junit4]   2> 790933 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-tolerant-search.xml
   [junit4]   2> 790934 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-sim-default-has-no-explicit-sim.xml
   [junit4]   2> 790936 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 790937 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-update-processor-chains.xml
   [junit4]   2> 790939 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-rest.xml
   [junit4]   2> 790941 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/trivial.updateprocessor0.js
   [junit4]   2> 790942 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-mergepolicy-nocfs.xml
   [junit4]   2> 790943 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-reqHandler.incl
   [junit4]   2> 790945 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 790947 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-spellchecker.xml
   [junit4]   2> 790949 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-doctransformers.xml
   [junit4]   2> 790950 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-reversed.xml
   [junit4]   2> 790952 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-managed-schema.xml
   [junit4]   2> 790953 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-omit-tf-but-not-pos.xml
   [junit4]   2> 790955 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-solcoreproperties.xml
   [junit4]   2> 790956 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 790958 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/keep-1.txt
   [junit4]   2> 790959 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/throw.error.on.add.updateprocessor.js
   [junit4]   2> 790961 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-master-throttled.xml
   [junit4]   2> 790963 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-single-dynamic-copy-field.xml
   [junit4]   2> 790965 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-xinclude.xml
   [junit4]   2> 790967 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-elevate.xml
   [junit4]   2> 790969 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stoptypes-2.txt
   [junit4]   2> 790971 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-complex-phrase.xml
   [junit4]   2> 790972 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-master1-keepOneBackup.xml
   [junit4]   2> 790976 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-bogus-analysis-parameters.xml
   [junit4]   2> 790978 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stemdict.txt
   [junit4]   2> 790993 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-trie.xml
   [junit4]   2> 790995 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/wdftypes.txt
   [junit4]   2> 790997 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-slave1.xml
   [junit4]   2> 790999 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-defaults.xml
   [junit4]   2> 791002 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-graph.xml
   [junit4]   2> 791003 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-external-filefield.xml
   [junit4]   2> 791006 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-docValues.xml
   [junit4]   2> 791008 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-delpolicy2.xml
   [junit4]   2> 791009 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schemasurround.xml
   [junit4]   2> 791011 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-test-misc.xml
   [junit4]   2> 791013 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema15.xml
   [junit4]   2> 791014 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-class-name-shortening-on-serialization.xml
   [junit4]   2> 791015 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-add-schema-fields-update-processor.xml
   [junit4]   2> 791017 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-collate.xml
   [junit4]   2> 791018 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 791020 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-snippet-field.xml
   [junit4]   2> 791022 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-indexconfig.xml
   [junit4]   2> 791024 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad_solrconfig.xml
   [junit4]   2> 791025 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-eff.xml
   [junit4]   2> 791027 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-uniquekey-multivalued.xml
   [junit4]   2> 791029 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-solrconfig-nrtmode.xml
   [junit4]   2> 791030 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/analyzingInfixSuggest.txt
   [junit4]   2> 791032 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-repeater.xml
   [junit4]   2> 791033 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-spatial.xml
   [junit4]   2> 791035 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-hash.xml
   [junit4]   2> 791037 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-spatial.xml
   [junit4]   2> 791038 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-field-sort-values.xml
   [junit4]   2> 791040 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stoptypes-1.txt
   [junit4]   2> 791042 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-init-error.xml
   [junit4]   2> 791043 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-customfield.xml
   [junit4]   2> 791045 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-solrconfig-managed-schema-named-schema.xml.xml
   [junit4]   2> 791046 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-paramset.xml
   [junit4]   2> 791048 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-dup-dynamicField.xml
   [junit4]   2> 791049 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 791051 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-folding.xml
   [junit4]   2> 791052 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwithbom.txt
   [junit4]   2> 791054 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/missleading.extension.updateprocessor.js.txt
   [junit4]   2> 791055 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-currency-dynamic-multivalued.xml
   [junit4]   2> 791057 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-binaryfield.xml
   [junit4]   2> 791058 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-slave.xml
   [junit4]   2> 791060 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-luceneMatchVersion.xml
   [junit4]   2> 791061 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-cdcr.xml
   [junit4]   2> 791063 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-sortingresponse.xml
   [junit4]   2> 791064 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-sweetspot-partial-baseline.xml
   [junit4]   2> 791066 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-stop-keep.xml
   [junit4]   2> 791068 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-infostream-logging.xml
   [junit4]   2> 791069 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-uniquekey-is-copyfield-dest.xml
   [junit4]   2> 791071 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-master.xml
   [junit4]   2> 791072 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-replication2.xml
   [junit4]   2> 791074 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-currency-ft-bogus-code-in-xml.xml
   [junit4]   2> 791075 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/addfields.updateprocessor.js
   [junit4]   2> 791077 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-dfr.xml
   [junit4]   2> 791078 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-enums.xml
   [junit4]   2> 791080 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-delpolicy1.xml
   [junit4]   2> 791081 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-minimal.xml
   [junit4]   2> 791083 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-solrconfig-multiple-cfs.xml
   [junit4]   2> 791085 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/trivial.updateprocessor1.js
   [junit4]   2> 791086 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/missing.functions.updateprocessor.js
   [junit4]   2> 791088 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-solrconfig-multiple-dirfactory.xml
   [junit4]   2> 791089 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 791091 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-misplaced-asterisk-copyfield-source-should-fail-test.xml
   [junit4]   2> 791093 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-add-schema-fields-update-processor-chains.xml
   [junit4]   2> 791094 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-version-dv.xml
   [junit4]   2> 791096 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-delaying-component.xml
   [junit4]   2> 791097 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-custom-field.xml
   [junit4]   2> 791099 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-ib.xml
   [junit4]   2> 791100 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/keep-2.txt
   [junit4]   2> 791102 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-one-field-no-dynamic-field.xml
   [junit4]   2> 791104 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-not-required-unique-key.xml
   [junit4]   2> 791105 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/hyphenation.dtd
   [junit4]   2> 791106 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-sql.xml
   [junit4]   2> 791108 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-copyfield-test.xml
   [junit4]   2> 791110 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-analyzer-class-and-nested.xml
   [junit4]   2> 791111 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-mpf-solrconfig.xml
   [junit4]   2> 791112 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-currency-ft-multivalued.xml
   [junit4]   2> 791114 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-querysender-noquery.xml
   [junit4]   2> 791115 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-phrasesuggest.xml
   [junit4]   2> 791117 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwordsWrongEncoding.txt
   [junit4]   2> 791118 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema-simpleqpplugin.xml
   [junit4]   2> 791119 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-mergepolicy-defaults.xml
   [junit4]   2> 791121 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-dup-fieldType.xml
   [junit4]   2> 791122 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-warmer-randommergepolicyfactory.xml
   [junit4]   2> 791124 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stop-snowball.txt
   [junit4]   2> 791125 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-mergepolicy-legacy.xml
   [junit4]   2> 791126 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-nocache.xml
   [junit4]   2> 791128 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/da_compoundDictionary.txt
   [junit4]   2> 791129 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/bad-schema-not-indexed-but-tf.xml
   [junit4]   2> 791131 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig-postingshighlight.xml
   [junit4]   2> 791132 INFO  (TEST-TestDistribIDF.testMultiCollectionQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/xslt/dummy-using-include.xsl
   [junit4]   2> 791134 INFO  (TEST-Test

[...truncated too long message...]

ing down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 20]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:214)
   [junit4]   2> 	at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:266)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 871082 INFO  (zkCallback-1383-thread-2-processing-n:127.0.0.1:54676_solr) [n:127.0.0.1:54676_solr    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [2])
   [junit4]   2> 871082 INFO  (zkCallback-1383-thread-1-processing-n:127.0.0.1:54676_solr) [n:127.0.0.1:54676_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onecollection/state.json] for collection [onecollection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 872582 WARN  (zkCallback-1384-thread-1-processing-n:127.0.0.1:52952_solr) [n:127.0.0.1:52952_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /collections/onecollection/state.json]
   [junit4]   2> 872583 WARN  (zkCallback-1383-thread-2-processing-n:127.0.0.1:54676_solr) [n:127.0.0.1:54676_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 872583 INFO  (jetty-launcher-1369-thread-4) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3ddef88f{/solr,null,UNAVAILABLE}
   [junit4]   2> 872583 WARN  (zkCallback-1383-thread-1-processing-n:127.0.0.1:54676_solr) [n:127.0.0.1:54676_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /collections/onecollection/state.json]
   [junit4]   2> 872583 INFO  (jetty-launcher-1369-thread-5) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@18c0b2e4{/solr,null,UNAVAILABLE}
   [junit4]   2> 872587 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[46BA07B637298132]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:43264 43264
   [junit4]   2> 872770 INFO  (Thread-2529) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:43264 43264
   [junit4]   2> 872772 WARN  (Thread-2529) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	4	/solr/aliases.json
   [junit4]   2> 	3	/solr/security.json
   [junit4]   2> 	3	/solr/configs/conf2
   [junit4]   2> 	3	/solr/configs/conf1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	4	/solr/clusterstate.json
   [junit4]   2> 	3	/solr/collections/onecollection/state.json
   [junit4]   2> 	3	/solr/collections/onecollection_local/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	4	/solr/live_nodes
   [junit4]   2> 	4	/solr/collections
   [junit4]   2> 
   [junit4]   2> 872772 INFO  (TEST-TestDistribIDF.testSimpleQuery-seed#[46BA07B637298132]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testSimpleQuery
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestDistribIDF -Dtests.method=testSimpleQuery -Dtests.seed=46BA07B637298132 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=zh-HK -Dtests.timezone=Iceland -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   67.8s J2 | TestDistribIDF.testSimpleQuery <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:52952/solr: no servers hosting shard: a
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([46BA07B637298132:33B7C7AA273347E7]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:149)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:942)
   [junit4]    > 	at org.apache.solr.search.stats.TestDistribIDF.testSimpleQuery(TestDistribIDF.java:125)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 872775 INFO  (SUITE-TestDistribIDF-seed#[46BA07B637298132]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J2/temp/solr.search.stats.TestDistribIDF_46BA07B637298132-001
   [junit4]   2> Mar 12, 2016 7:11:00 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene60): {range_facet_l_dv=BlockTreeOrds(blocksize=128), _version_=PostingsFormat(name=Memory doPackFST= true), multiDefault=Lucene50(blocksize=128), cat=PostingsFormat(name=Memory doPackFST= true), intDefault=PostingsFormat(name=Memory doPackFST= true), id=BlockTreeOrds(blocksize=128), range_facet_i_dv=PostingsFormat(name=Memory doPackFST= true), _route_=PostingsFormat(name=Memory doPackFST= false), range_facet_l=PostingsFormat(name=Memory doPackFST= true), timestamp=PostingsFormat(name=Memory doPackFST= true)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Asserting), range_facet_i_dv=DocValuesFormat(name=Lucene54), timestamp=DocValuesFormat(name=Lucene54)}, maxPointsInLeafNode=246, maxMBSortInHeap=4.625675859645837, sim=RandomSimilarity(queryNorm=true,coord=no): {}, locale=zh-HK, timezone=Iceland
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=86011968,total=440401920
   [junit4]   2> NOTE: All tests run in this JVM: [DebugComponentTest, LeaderElectionTest, DeleteStatusTest, TestSchemaResource, TestAnalyzeInfixSuggestions, TestSuggestSpellingConverter, BadIndexSchemaTest, CleanupOldIndexTest, ReplicationFactorTest, TestFastWriter, RulesTest, DistributedFacetPivotSmallAdvancedTest, TestPostingsSolrHighlighter, SliceStateTest, SecurityConfHandlerTest, HdfsLockFactoryTest, AnalyticsMergeStrategyTest, FieldAnalysisRequestHandlerTest, BaseCdcrDistributedZkTest, HighlighterConfigTest, CoreAdminHandlerTest, ConnectionManagerTest, TestExceedMaxTermLength, MergeStrategyTest, TestJmxIntegration, TestSmileRequest, BinaryUpdateRequestHandlerTest, TestUniqueKeyFieldResource, TestSolrCLIRunExample, CollectionStateFormat2Test, OverseerCollectionConfigSetProcessorTest, SuggesterTSTTest, TestPivotHelperCode, ShowFileRequestHandlerTest, CurrencyFieldXmlFileTest, TestCoreDiscovery, TestReversedWildcardFilterFactory, TestFilteredDocIdSet, DeleteLastCustomShardedReplicaTest, TestExtendedDismaxParser, TestIndexingPerformance, TestPerFieldSimilarityWithDefaultOverride, SharedFSAutoReplicaFailoverTest, TestJmxMonitoredMap, TestReload, TestLRUStatsCache, TestSerializedLuceneMatchVersion, TestPHPSerializedResponseWriter, HardAutoCommitTest, CircularListTest, SolrCoreCheckLockOnStartupTest, ZkStateWriterTest, TestSolrIndexConfig, TestSolrConfigHandlerCloud, TestReloadAndDeleteDocs, CdcrUpdateLogTest, ScriptEngineTest, ClusterStateTest, TestSort, TestStressRecovery, TestInfoStreamLogging, QueryParsingTest, BasicDistributedZk2Test, UnloadDistributedZkTest, RecoveryZkTest, MultiThreadedOCPTest, HighlighterMaxOffsetTest, SolrTestCaseJ4Test, TestCSVResponseWriter, TestReloadDeadlock, DocValuesMissingTest, DistributedQueryComponentCustomSortTest, TestCloudSchemaless, SuggesterTest, SampleTest, AddSchemaFieldsUpdateProcessorFactoryTest, TestOverriddenPrefixQueryForCustomFieldType, TestDistribIDF]
   [junit4] Completed [224/579 (1!)] on J2 in 83.61s, 2 tests, 1 error <<< FAILURES!

[...truncated 1121 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/build.xml:740: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/build.xml:684: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/common-build.xml:524: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/lucene/common-build.xml:1457: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/lucene/common-build.xml:1014: There were test failures: 579 suites (10 ignored), 2314 tests, 1 error, 86 ignored (70 assumptions) [seed: 46BA07B637298132]

Total time: 61 minutes 26 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-Tests-6.x - Build # 44 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-6.x/44/

All tests passed

Build Log:
[...truncated 53043 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/build.xml:740: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/build.xml:101: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/lucene/build.xml:138: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/lucene/build.xml:480: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/lucene/common-build.xml:2520: Can't get https://issues.apache.org/jira/rest/api/2/project/LUCENE to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/lucene/build/docs/changes/jiraVersionList.json

Total time: 74 minutes 54 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-Tests-6.x - Build # 43 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-6.x/43/

1 tests failed.
FAILED:  org.apache.solr.handler.clustering.DistributedClusteringComponentTest.test

Error Message:
IOException occured when talking to server at: http://127.0.0.1:34255//collection1

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:34255//collection1
	at __randomizedtesting.SeedInfo.seed([EB01C4F683FDF678:6355FB2C2D019B80]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:591)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:149)
	at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:895)
	at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:858)
	at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:873)
	at org.apache.solr.BaseDistributedSearchTestCase.del(BaseDistributedSearchTestCase.java:551)
	at org.apache.solr.handler.clustering.DistributedClusteringComponentTest.test(DistributedClusteringComponentTest.java:35)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsRepeatStatement.callStatement(BaseDistributedSearchTestCase.java:1022)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:971)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketException: Connection reset
	at java.net.SocketInputStream.read(SocketInputStream.java:209)
	at java.net.SocketInputStream.read(SocketInputStream.java:141)
	at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
	at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
	at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
	at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
	at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
	at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
	at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:482)
	... 49 more




Build Log:
[...truncated 14503 lines...]
   [junit4] Suite: org.apache.solr.handler.clustering.DistributedClusteringComponentTest
   [junit4]   2> log4j:WARN No such property [conversionPattern] in org.apache.solr.util.SolrLogLayout.
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/init-core-data-001
   [junit4]   2> 1478 T12 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 1623 T12 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/control/cores/collection1
   [junit4]   2> 1692 T12 oejul.Log.initialized Logging initialized @3584ms
   [junit4]   2> 2039 T12 oejs.Server.doStart jetty-9.3.6.v20151106
   [junit4]   2> 2104 T12 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@5d1d16c4{/,null,AVAILABLE}
   [junit4]   2> 2126 T12 oejs.AbstractConnector.doStart Started ServerConnector@59514b7b{HTTP/1.1,[http/1.1]}{127.0.0.1:34255}
   [junit4]   2> 2127 T12 oejs.Server.doStart Started @4026ms
   [junit4]   2> 2128 T12 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostContext=/, hostPort=34255, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/control/cores}
   [junit4]   2> 2144 T12 oass.SolrDispatchFilter.init SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 2179 T12 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/control'
   [junit4]   2> 2184 T12 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 2184 T12 oasc.SolrResourceLoader.locateSolrHome solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 2193 T12 oasc.SolrXmlConfig.fromFile Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/control/solr.xml
   [junit4]   2> 2393 T12 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/control/cores
   [junit4]   2> 2470 T12 oasc.CoreContainer.<init> New CoreContainer 928498189
   [junit4]   2> 2471 T12 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/control]
   [junit4]   2> 2474 T12 oasc.CoreContainer.load WARN Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/control/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/control/lib
   [junit4]   2> 2532 T12 oashc.HttpShardHandlerFactory.init created with socketTimeout : 600000,urlScheme : ,connTimeout : 60000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 2892 T12 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 2898 T12 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 2899 T12 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 2903 T12 oasc.CoreContainer.initializeAuthorizationPlugin Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 2904 T12 oasc.CoreContainer.initializeAuthenticationPlugin No authentication plugin used.
   [junit4]   2> 3021 T12 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/control/cores
   [junit4]   2> 3031 T12 oasc.CoreDescriptor.<init> Created CoreDescriptor: {name=collection1, config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, configSetProperties=configsetprops.json, transient=false, dataDir=data/, configSet=collection1}
   [junit4]   2> 3032 T12 oasc.CorePropertiesLocator$1.visitFile Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/control/cores/collection1
   [junit4]   2> 3032 T12 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 3044 T12 oass.SolrDispatchFilter.init user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0
   [junit4]   2> 3044 T12 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 3056 T25 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/control/collection1'
   [junit4]   2> 3056 T25 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 3057 T25 oasc.SolrResourceLoader.locateSolrHome solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 3129 T25 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
   [junit4]   2> 3194 T25 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.1.0
   [junit4]   2> 3485 T25 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 3559 T25 oass.IndexSchema.readSchema [collection1] Schema name=example
   [junit4]   2> 3873 T25 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 3873 T25 oass.IndexSchema.readSchema query parser default operator is OR
   [junit4]   2> 3874 T25 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 3918 T25 oasc.ConfigSetProperties.readFromResourceLoader Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/control/collection1'
   [junit4]   2> 3920 T25 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from configset /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/control/collection1
   [junit4]   2> 3972 T25 x:x:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 3988 T25 x:x:collection1 oasc.SolrCore.<init> [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/control/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/control/cores/collection1/data/]
   [junit4]   2> 3991 T25 x:x:collection1 oasc.JmxMonitoredMap.<init> No JMX servers found, not exposing Solr information with JMX.
   [junit4]   2> 4001 T25 x:x:collection1 oasc.SolrCore.initListeners [[collection1] ] Added SolrEventListener for newSearcher: [org.apache.solr.core.QuerySenderListener{queries=[{q=solr,start=0,rows=10}, {q=rocks,start=0,rows=10}, {q=static newSearcher warming query from solrconfig.xml}]}]
   [junit4]   2> 4001 T25 x:x:collection1 oasc.SolrCore.initListeners [[collection1] ] Added SolrEventListener for firstSearcher: [org.apache.solr.core.QuerySenderListener{queries=[{q=fast_warm,start=0,rows=10}, {q=static firstSearcher warming query from solrconfig.xml}]}]
   [junit4]   2> 4029 T25 x:x:collection1 oasc.CachingDirectoryFactory.get return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/control/cores/collection1/data
   [junit4]   2> 4030 T25 x:x:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/control/cores/collection1/data/index/
   [junit4]   2> 4031 T25 x:x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/control/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 4051 T25 x:x:collection1 oasc.CachingDirectoryFactory.get return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/control/cores/collection1/data/index
   [junit4]   2> 4125 T25 x:x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@6ad8dbb5 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7213fba4),segFN=segments_1,generation=1}
   [junit4]   2> 4126 T25 x:x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 4128 T29 x:x:collection1 oasc.SolrCore$11.run Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/control/cores/collection1/data/
   [junit4]   2> 4140 T29 x:x:collection1 oasc.DirectoryFactory.cleanupOldIndexDirectories WARN /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/control/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 4141 T25 x:x:collection1 oasr.XSLTResponseWriter.init xsltCacheLifetimeSeconds=5
   [junit4]   2> 4402 T25 x:x:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 4458 T25 x:x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 4463 T25 x:x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 4465 T25 x:x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 4466 T25 x:x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 4701 T25 x:x:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /admin/mbeans,standard,,/update/json/docs,/admin/luke,docClustering,/export,/get,/admin/properties,/update/json,/admin/threads,/update/csv,/sql,/admin/segments,/admin/system,/replication,/config,/stream,/schema,/admin/plugins,/admin/logging,/admin/ping,/update,/admin/file,/debug/dump
   [junit4]   2> 4701 T25 x:x:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 4728 T25 x:x:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 4729 T25 x:x:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 4733 T25 x:x:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@6ad8dbb5 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7213fba4),segFN=segments_1,generation=1}
   [junit4]   2> 4734 T25 x:x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 4766 T25 x:x:collection1 oass.SolrIndexSearcher.<init> Opening [Searcher@60bf1929[collection1] main]
   [junit4]   2> 4779 T25 x:x:collection1 oasr.ManagedResourceStorage$FileStorageIO.configure File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/control/collection1/conf
   [junit4]   2> 4779 T25 x:x:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/control/collection1/conf}
   [junit4]   2> 4801 T25 x:x:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/control/collection1/conf
   [junit4]   2> 4802 T25 x:x:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 4832 T25 x:x:collection1 oashc.ClusteringComponent.inform Initializing Clustering Engines
   [junit4]   2> 5023 T25 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine 'default'
   [junit4]   2> 5091 T25 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine 'stc'
   [junit4]   2> 5096 T25 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine 'mock'
   [junit4]   2> 5099 T25 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine 'mock-external-attrs'
   [junit4]   2> 5100 T25 x:x:collection1 oashcc.SolrResourceLocator.getAll Loaded Solr resource: clustering/carrot2/mock-external-attrs-attributes.xml
   [junit4]   2> 5953 T25 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine 'echo'
   [junit4]   2> 5970 T25 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine 'lexical-resource-check'
   [junit4]   2> 5979 T25 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine 'lexical-resource-check-custom-resource-dir'
   [junit4]   2> 5993 T25 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine 'custom-duplicating-tokenizer'
   [junit4]   2> 6002 T25 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine 'custom-duplicating-stemmer'
   [junit4]   2> 6007 T25 x:x:collection1 oashc.ClusteringComponent.setupDefaultEngine Default engine for search results clustering: default [CarrotClusteringEngine]
   [junit4]   2> 6007 T25 x:x:collection1 oashc.ClusteringComponent.setupDefaultEngine WARN No default engine for document clustering.
   [junit4]   2> 6007 T25 x:x:collection1 oashc.ClusteringComponent.inform Finished Initializing Clustering Engines
   [junit4]   2> 6007 T25 x:x:collection1 oashc.ClusteringComponent.inform Initializing Clustering Engines
   [junit4]   2> 6008 T25 x:x:collection1 oashc.ClusteringComponent.setupDefaultEngine WARN No default engine for search results clustering.
   [junit4]   2> 6012 T25 x:x:collection1 oashc.ClusteringComponent.setupDefaultEngine Default engine for document clustering: mock [MockDocumentClusteringEngine]
   [junit4]   2> 6012 T25 x:x:collection1 oashc.ClusteringComponent.inform Finished Initializing Clustering Engines
   [junit4]   2> 6013 T25 x:x:collection1 oashc.ClusteringComponent.inform Initializing Clustering Engines
   [junit4]   2> 6013 T25 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine 'stc'
   [junit4]   2> 6016 T25 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine 'default'
   [junit4]   2> 6035 T25 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine 'mock'
   [junit4]   2> 6038 T25 x:x:collection1 oashc.ClusteringComponent.setupDefaultEngine Default engine for search results clustering: default [CarrotClusteringEngine]
   [junit4]   2> 6038 T25 x:x:collection1 oashc.ClusteringComponent.setupDefaultEngine WARN No default engine for document clustering.
   [junit4]   2> 6039 T25 x:x:collection1 oashc.ClusteringComponent.inform Finished Initializing Clustering Engines
   [junit4]   2> 6039 T25 x:x:collection1 oashc.ClusteringComponent.inform Initializing Clustering Engines
   [junit4]   2> 6115 T25 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine 'unavailable'
   [junit4]   2> 6118 T25 x:x:collection1 oashc.ClusteringComponent.inform Optional clustering engine not available: unavailable
   [junit4]   2> 6118 T25 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine 'lingo'
   [junit4]   2> 6121 T25 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine 'stc'
   [junit4]   2> 6126 T25 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine 'mock'
   [junit4]   2> 6131 T25 x:x:collection1 oashc.ClusteringComponent.setupDefaultEngine Default engine for search results clustering: lingo [CarrotClusteringEngine]
   [junit4]   2> 6131 T25 x:x:collection1 oashc.ClusteringComponent.setupDefaultEngine WARN No default engine for document clustering.
   [junit4]   2> 6131 T25 x:x:collection1 oashc.ClusteringComponent.inform Finished Initializing Clustering Engines
   [junit4]   2> 6131 T25 x:x:collection1 oashc.ClusteringComponent.inform Initializing Clustering Engines
   [junit4]   2> 6132 T25 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine '<no 'name' attribute>'
   [junit4]   2> 6132 T25 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine '<no 'name' attribute>'
   [junit4]   2> 6132 T25 x:x:collection1 oashc.ClusteringComponent.inform WARN Duplicate clustering engine component named ''.
   [junit4]   2> 6133 T25 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine '<no 'name' attribute>'
   [junit4]   2> 6133 T25 x:x:collection1 oashc.ClusteringComponent.inform WARN Duplicate clustering engine component named ''.
   [junit4]   2> 6133 T25 x:x:collection1 oashc.ClusteringComponent.setupDefaultEngine Default engine for search results clustering:  [CarrotClusteringEngine]
   [junit4]   2> 6134 T25 x:x:collection1 oashc.ClusteringComponent.setupDefaultEngine WARN No default engine for document clustering.
   [junit4]   2> 6135 T25 x:x:collection1 oashc.ClusteringComponent.inform Finished Initializing Clustering Engines
   [junit4]   2> 6136 T25 x:x:collection1 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 6165 T30 x:x:collection1 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@60bf1929[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 6167 T25 x:x:collection1 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> ASYNC  NEW_CORE C0 name=collection1 org.apache.solr.core.SolrCore@4982a211
   [junit4]   2> 6321 T30 x:x:collection1 C0 oasc.SolrCore.execute [collection1]  webapp=null path=null params={q=fast_warm&distrib=false&start=0&rows=10&event=firstSearcher} hits=0 status=0 QTime=143
   [junit4]   2> 6349 T30 x:x:collection1 C0 oasc.SolrCore.execute [collection1]  webapp=null path=null params={q=static+firstSearcher+warming+query+from+solrconfig.xml&distrib=false&event=firstSearcher} hits=0 status=0 QTime=25
   [junit4]   2> 6351 T30 x:x:collection1 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 6352 T30 x:x:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@60bf1929[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 6622 T12 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/shard0/cores/collection1
   [junit4]   2> 6632 T12 oejs.Server.doStart jetty-9.3.6.v20151106
   [junit4]   2> 6701 T12 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@1d4a6d51{/,null,AVAILABLE}
   [junit4]   2> 6702 T12 oejs.AbstractConnector.doStart Started ServerConnector@682b0c08{HTTP/1.1,[http/1.1]}{127.0.0.1:47432}
   [junit4]   2> 6703 T12 oejs.Server.doStart Started @8602ms
   [junit4]   2> 6703 T12 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostContext=/, hostPort=47432, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/shard0/cores}
   [junit4]   2> 6703 T12 oass.SolrDispatchFilter.init SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 6704 T12 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/shard0'
   [junit4]   2> 6714 T12 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 6714 T12 oasc.SolrResourceLoader.locateSolrHome solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 6724 T12 oasc.SolrXmlConfig.fromFile Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/shard0/solr.xml
   [junit4]   2> 6740 T12 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/shard0/cores
   [junit4]   2> 6740 T12 oasc.CoreContainer.<init> New CoreContainer 31554369
   [junit4]   2> 6740 T12 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/shard0]
   [junit4]   2> 6741 T12 oasc.CoreContainer.load WARN Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/shard0/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/shard0/lib
   [junit4]   2> 6741 T12 oashc.HttpShardHandlerFactory.init created with socketTimeout : 600000,urlScheme : ,connTimeout : 60000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 6743 T12 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 6743 T12 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 6744 T12 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 6744 T12 oasc.CoreContainer.initializeAuthorizationPlugin Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 6744 T12 oasc.CoreContainer.initializeAuthenticationPlugin No authentication plugin used.
   [junit4]   2> 6745 T12 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/shard0/cores
   [junit4]   2> 6747 T12 oasc.CoreDescriptor.<init> Created CoreDescriptor: {name=collection1, config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, configSetProperties=configsetprops.json, transient=false, dataDir=data/, configSet=collection1}
   [junit4]   2> 6747 T12 oasc.CorePropertiesLocator$1.visitFile Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/shard0/cores/collection1
   [junit4]   2> 6747 T12 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 6750 T43 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/shard0/collection1'
   [junit4]   2> 6752 T43 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 6752 T43 oasc.SolrResourceLoader.locateSolrHome solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 6764 T12 oass.SolrDispatchFilter.init user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0
   [junit4]   2> 6764 T12 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 6805 T43 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
   [junit4]   2> 6875 T43 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.1.0
   [junit4]   2> 6965 T43 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 7000 T43 oass.IndexSchema.readSchema [collection1] Schema name=example
   [junit4]   2> 7066 T43 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 7067 T43 oass.IndexSchema.readSchema query parser default operator is OR
   [junit4]   2> 7067 T43 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 7084 T43 oasc.ConfigSetProperties.readFromResourceLoader Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/shard0/collection1'
   [junit4]   2> 7086 T43 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from configset /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/shard0/collection1
   [junit4]   2> 7086 T43 x:x:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 7087 T43 x:x:collection1 oasc.SolrCore.<init> [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/shard0/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/shard0/cores/collection1/data/]
   [junit4]   2> 7087 T43 x:x:collection1 oasc.JmxMonitoredMap.<init> No JMX servers found, not exposing Solr information with JMX.
   [junit4]   2> 7088 T43 x:x:collection1 oasc.SolrCore.initListeners [[collection1] ] Added SolrEventListener for newSearcher: [org.apache.solr.core.QuerySenderListener{queries=[{q=solr,start=0,rows=10}, {q=rocks,start=0,rows=10}, {q=static newSearcher warming query from solrconfig.xml}]}]
   [junit4]   2> 7089 T43 x:x:collection1 oasc.SolrCore.initListeners [[collection1] ] Added SolrEventListener for firstSearcher: [org.apache.solr.core.QuerySenderListener{queries=[{q=fast_warm,start=0,rows=10}, {q=static firstSearcher warming query from solrconfig.xml}]}]
   [junit4]   2> 7090 T43 x:x:collection1 oasc.CachingDirectoryFactory.get return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/shard0/cores/collection1/data
   [junit4]   2> 7104 T43 x:x:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/shard0/cores/collection1/data/index/
   [junit4]   2> 7104 T43 x:x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/shard0/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 7105 T43 x:x:collection1 oasc.CachingDirectoryFactory.get return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/shard0/cores/collection1/data/index
   [junit4]   2> 7106 T43 x:x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@6c171a68 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@37da2381),segFN=segments_1,generation=1}
   [junit4]   2> 7107 T43 x:x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 7113 T43 x:x:collection1 oasr.XSLTResponseWriter.init xsltCacheLifetimeSeconds=5
   [junit4]   2> 7116 T47 x:x:collection1 oasc.SolrCore$11.run Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/shard0/cores/collection1/data/
   [junit4]   2> 7119 T43 x:x:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 7116 T47 x:x:collection1 oasc.DirectoryFactory.cleanupOldIndexDirectories WARN /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/shard0/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 7125 T43 x:x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 7126 T43 x:x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 7128 T43 x:x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 7129 T43 x:x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 7132 T43 x:x:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /admin/mbeans,standard,,/update/json/docs,/admin/luke,docClustering,/export,/get,/admin/properties,/update/json,/admin/threads,/update/csv,/sql,/admin/segments,/admin/system,/replication,/config,/stream,/schema,/admin/plugins,/admin/logging,/admin/ping,/update,/admin/file,/debug/dump
   [junit4]   2> 7132 T43 x:x:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 7133 T43 x:x:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 7134 T43 x:x:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 7135 T43 x:x:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@6c171a68 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@37da2381),segFN=segments_1,generation=1}
   [junit4]   2> 7135 T43 x:x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 7136 T43 x:x:collection1 oass.SolrIndexSearcher.<init> Opening [Searcher@110b118c[collection1] main]
   [junit4]   2> 7136 T43 x:x:collection1 oasr.ManagedResourceStorage$FileStorageIO.configure File-based storage initialized to use dir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/shard0/collection1/conf
   [junit4]   2> 7137 T43 x:x:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/shard0/collection1/conf}
   [junit4]   2> 7138 T43 x:x:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/shard0/collection1/conf
   [junit4]   2> 7138 T43 x:x:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 7138 T43 x:x:collection1 oashc.ClusteringComponent.inform Initializing Clustering Engines
   [junit4]   2> 7140 T43 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine 'default'
   [junit4]   2> 7144 T43 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine 'stc'
   [junit4]   2> 7147 T43 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine 'mock'
   [junit4]   2> 7157 T43 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine 'mock-external-attrs'
   [junit4]   2> 7157 T43 x:x:collection1 oashcc.SolrResourceLocator.getAll Loaded Solr resource: clustering/carrot2/mock-external-attrs-attributes.xml
   [junit4]   2> 7168 T43 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine 'echo'
   [junit4]   2> 7171 T43 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine 'lexical-resource-check'
   [junit4]   2> 7174 T43 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine 'lexical-resource-check-custom-resource-dir'
   [junit4]   2> 7177 T43 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine 'custom-duplicating-tokenizer'
   [junit4]   2> 7184 T43 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine 'custom-duplicating-stemmer'
   [junit4]   2> 7187 T43 x:x:collection1 oashc.ClusteringComponent.setupDefaultEngine Default engine for search results clustering: default [CarrotClusteringEngine]
   [junit4]   2> 7187 T43 x:x:collection1 oashc.ClusteringComponent.setupDefaultEngine WARN No default engine for document clustering.
   [junit4]   2> 7187 T43 x:x:collection1 oashc.ClusteringComponent.inform Finished Initializing Clustering Engines
   [junit4]   2> 7187 T43 x:x:collection1 oashc.ClusteringComponent.inform Initializing Clustering Engines
   [junit4]   2> 7187 T43 x:x:collection1 oashc.ClusteringComponent.setupDefaultEngine WARN No default engine for search results clustering.
   [junit4]   2> 7187 T43 x:x:collection1 oashc.ClusteringComponent.setupDefaultEngine Default engine for document clustering: mock [MockDocumentClusteringEngine]
   [junit4]   2> 7188 T43 x:x:collection1 oashc.ClusteringComponent.inform Finished Initializing Clustering Engines
   [junit4]   2> 7188 T43 x:x:collection1 oashc.ClusteringComponent.inform Initializing Clustering Engines
   [junit4]   2> 7188 T43 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine 'stc'
   [junit4]   2> 7191 T43 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine 'default'
   [junit4]   2> 7201 T43 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine 'mock'
   [junit4]   2> 7211 T43 x:x:collection1 oashc.ClusteringComponent.setupDefaultEngine Default engine for search results clustering: default [CarrotClusteringEngine]
   [junit4]   2> 7211 T43 x:x:collection1 oashc.ClusteringComponent.setupDefaultEngine WARN No default engine for document clustering.
   [junit4]   2> 7211 T43 x:x:collection1 oashc.ClusteringComponent.inform Finished Initializing Clustering Engines
   [junit4]   2> 7211 T43 x:x:collection1 oashc.ClusteringComponent.inform Initializing Clustering Engines
   [junit4]   2> 7241 T43 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine 'unavailable'
   [junit4]   2> 7244 T43 x:x:collection1 oashc.ClusteringComponent.inform Optional clustering engine not available: unavailable
   [junit4]   2> 7244 T43 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine 'lingo'
   [junit4]   2> 7248 T43 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine 'stc'
   [junit4]   2> 7255 T43 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine 'mock'
   [junit4]   2> 7260 T43 x:x:collection1 oashc.ClusteringComponent.setupDefaultEngine Default engine for search results clustering: lingo [CarrotClusteringEngine]
   [junit4]   2> 7260 T43 x:x:collection1 oashc.ClusteringComponent.setupDefaultEngine WARN No default engine for document clustering.
   [junit4]   2> 7260 T43 x:x:collection1 oashc.ClusteringComponent.inform Finished Initializing Clustering Engines
   [junit4]   2> 7261 T43 x:x:collection1 oashc.ClusteringComponent.inform Initializing Clustering Engines
   [junit4]   2> 7261 T43 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine '<no 'name' attribute>'
   [junit4]   2> 7261 T43 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine '<no 'name' attribute>'
   [junit4]   2> 7261 T43 x:x:collection1 oashc.ClusteringComponent.inform WARN Duplicate clustering engine component named ''.
   [junit4]   2> 7261 T43 x:x:collection1 oashcc.CarrotClusteringEngine.init Initializing Clustering Engine '<no 'name' attribute>'
   [junit4]   2> 7262 T43 x:x:collection1 oashc.ClusteringComponent.inform WARN Duplicate clustering engine component named ''.
   [junit4]   2> 7262 T43 x:x:collection1 oashc.ClusteringComponent.setupDefaultEngine Default engine for search results clustering:  [CarrotClusteringEngine]
   [junit4]   2> 7262 T43 x:x:collection1 oashc.ClusteringComponent.setupDefaultEngine WARN No default engine for document clustering.
   [junit4]   2> 7262 T43 x:x:collection1 oashc.ClusteringComponent.inform Finished Initializing Clustering Engines
   [junit4]   2> 7262 T43 x:x:collection1 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 7264 T48 x:x:collection1 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@110b118c[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> ASYNC  NEW_CORE C1 name=collection1 org.apache.solr.core.SolrCore@2f006864
   [junit4]   2> 7266 T48 x:x:collection1 C1 oasc.SolrCore.execute [collection1]  webapp=null path=null params={q=fast_warm&distrib=false&start=0&rows=10&event=firstSearcher} hits=0 status=0 QTime=1
   [junit4]   2> 7268 T48 x:x:collection1 C1 oasc.SolrCore.execute [collection1]  webapp=null path=null params={q=static+firstSearcher+warming+query+from+solrconfig.xml&distrib=false&event=firstSearcher} hits=0 status=0 QTime=1
   [junit4]   2> 7268 T48 x:x:collection1 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 7268 T48 x:x:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@110b118c[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 7270 T43 x:x:collection1 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 7766 T12 oas.SolrTestCaseJ4.setUp ###Starting test
   [junit4]   2> 8239 T12 oas.SolrTestCaseJ4.tearDown ###Ending test
   [junit4]   2> 8252 T12 oejs.AbstractConnector.doStop Stopped ServerConnector@59514b7b{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 8253 T12 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=928498189
   [junit4]   2> 8274 T51 x:x:collection1 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@4982a211
   [junit4]   2> 8277 T51 x:x:collection1 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 8283 T51 x:x:collection1 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 8287 T51 x:x:collection1 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 8287 T51 x:x:collection1 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 8299 T51 x:x:collection1 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 8300 T51 x:x:collection1 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 8301 T51 x:x:collection1 oasc.CachingDirectoryFactory.closeCacheValue looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/control/cores/collection1/data/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/control/cores/collection1/data/index;done=false>>]
   [junit4]   2> 8301 T51 x:x:collection1 oasc.CachingDirectoryFactory.close Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/control/cores/collection1/data/index
   [junit4]   2> 8303 T51 x:x:collection1 oasc.CachingDirectoryFactory.closeCacheValue looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/control/cores/collection1/data [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/control/cores/collection1/data;done=false>>]
   [junit4]   2> 8303 T51 x:x:collection1 oasc.CachingDirectoryFactory.close Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/control/cores/collection1/data
   [junit4]   2> 8306 T12 oejsh.ContextHandler.doStop Stopped o.e.j.s.ServletContextHandler@5d1d16c4{/,null,UNAVAILABLE}
   [junit4]   2> 8318 T12 oejs.AbstractConnector.doStop Stopped ServerConnector@682b0c08{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 8318 T12 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=31554369
   [junit4]   2> 8328 T53 x:x:collection1 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@2f006864
   [junit4]   2> 8329 T53 x:x:collection1 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 8330 T53 x:x:collection1 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 8330 T53 x:x:collection1 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 8330 T53 x:x:collection1 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 8331 T53 x:x:collection1 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 8331 T53 x:x:collection1 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 8332 T53 x:x:collection1 oasc.CachingDirectoryFactory.closeCacheValue looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/shard0/cores/collection1/data/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/shard0/cores/collection1/data/index;done=false>>]
   [junit4]   2> 8332 T53 x:x:collection1 oasc.CachingDirectoryFactory.close Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/shard0/cores/collection1/data/index
   [junit4]   2> 8332 T53 x:x:collection1 oasc.CachingDirectoryFactory.closeCacheValue looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/shard0/cores/collection1/data [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/shard0/cores/collection1/data;done=false>>]
   [junit4]   2> 8332 T53 x:x:collection1 oasc.CachingDirectoryFactory.close Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001/tempDir-001/shard0/cores/collection1/data
   [junit4]   2> 8336 T12 oejsh.ContextHandler.doStop Stopped o.e.j.s.ServletContextHandler@1d4a6d51{/,null,UNAVAILABLE}
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=DistributedClusteringComponentTest -Dtests.method=test -Dtests.seed=EB01C4F683FDF678 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=tr-TR -Dtests.timezone=Asia/Novokuznetsk -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   6.84s J0 | DistributedClusteringComponentTest.test <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:34255//collection1
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([EB01C4F683FDF678:6355FB2C2D019B80]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:591)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:149)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:895)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:858)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.deleteByQuery(SolrClient.java:873)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.del(BaseDistributedSearchTestCase.java:551)
   [junit4]    > 	at org.apache.solr.handler.clustering.DistributedClusteringComponentTest.test(DistributedClusteringComponentTest.java:35)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsRepeatStatement.callStatement(BaseDistributedSearchTestCase.java:1022)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:971)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]    > Caused by: java.net.SocketException: Connection reset
   [junit4]    > 	at java.net.SocketInputStream.read(SocketInputStream.java:209)
   [junit4]    > 	at java.net.SocketInputStream.read(SocketInputStream.java:141)
   [junit4]    > 	at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
   [junit4]    > 	at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
   [junit4]    > 	at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
   [junit4]    > 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
   [junit4]    > 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
   [junit4]    > 	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
   [junit4]    > 	at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
   [junit4]    > 	at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
   [junit4]    > 	at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
   [junit4]    > 	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
   [junit4]    > 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
   [junit4]    > 	at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
   [junit4]    > 	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
   [junit4]    > 	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:482)
   [junit4]    > 	... 49 more
   [junit4]   2> 8354 T12 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/contrib/solr-clustering/test/J0/temp/solr.handler.clustering.DistributedClusteringComponentTest_EB01C4F683FDF678-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene60): {}, docValues:{}, maxPointsInLeafNode=98, maxMBSortInHeap=6.008028843537981, sim=RandomSimilarity(queryNorm=true,coord=yes): {}, locale=tr-TR, timezone=Asia/Novokuznetsk
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=206123176,total=267911168
   [junit4]   2> NOTE: All tests run in this JVM: [DistributedClusteringComponentTest]
   [junit4] Completed [2/3 (1!)] on J0 in 9.03s, 1 test, 1 error <<< FAILURES!

[...truncated 14 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/build.xml:740: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/build.xml:684: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build.xml:253: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/common-build.xml:459: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/common-build.xml:524: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/lucene/common-build.xml:1457: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/lucene/common-build.xml:1014: There were test failures: 3 suites, 29 tests, 1 error [seed: EB01C4F683FDF678]

Total time: 65 minutes 51 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-Tests-6.x - Build # 42 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-6.x/42/

All tests passed

Build Log:
[...truncated 53054 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/build.xml:740: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/build.xml:101: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/lucene/build.xml:138: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/lucene/build.xml:480: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/lucene/common-build.xml:2520: Can't get https://issues.apache.org/jira/rest/api/2/project/LUCENE to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/lucene/build/docs/changes/jiraVersionList.json

Total time: 74 minutes 58 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any