You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2016/04/02 21:58:30 UTC

[JENKINS] Lucene-Solr-6.x-MacOSX (64bit/jdk1.8.0) - Build # 51 - Still Failing!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-6.x-MacOSX/51/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC

2 tests failed.
FAILED:  org.apache.solr.cloud.DistribDocExpirationUpdateProcessorTest.test

Error Message:
There are still nodes recoverying - waited for 45 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 45 seconds
	at __randomizedtesting.SeedInfo.seed([A9FC1E91EFD4A6DD:21A8214B4128CB25]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:173)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:856)
	at org.apache.solr.cloud.DistribDocExpirationUpdateProcessorTest.test(DistribDocExpirationUpdateProcessorTest.java:73)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestTolerantUpdateProcessorCloud

Error Message:
expected two total replicas for: shard1 expected:<2> but was:<1>

Stack Trace:
java.lang.AssertionError: expected two total replicas for: shard1 expected:<2> but was:<1>
	at __randomizedtesting.SeedInfo.seed([A9FC1E91EFD4A6DD]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.apache.solr.cloud.TestTolerantUpdateProcessorCloud.createMiniSolrCloudCluster(TestTolerantUpdateProcessorCloud.java:150)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:811)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11108 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestTolerantUpdateProcessorCloud
   [junit4]   2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTolerantUpdateProcessorCloud_A9FC1E91EFD4A6DD-001/init-core-data-001
   [junit4]   2> 1146779 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 1146781 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1146781 INFO  (Thread-2307) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1146781 INFO  (Thread-2307) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1146881 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:60191
   [junit4]   2> 1146882 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1146882 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1146892 INFO  (zkCallback-1995-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5fa9c53f name:ZooKeeperConnection Watcher:127.0.0.1:60191 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1146892 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1146892 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1146892 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /solr/solr.xml
   [junit4]   2> 1146899 INFO  (jetty-launcher-1994-thread-1) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 1146899 INFO  (jetty-launcher-1994-thread-2) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 1146900 INFO  (jetty-launcher-1994-thread-3) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 1146900 INFO  (jetty-launcher-1994-thread-4) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 1146901 INFO  (jetty-launcher-1994-thread-5) [    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 1146908 INFO  (jetty-launcher-1994-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@20cc8aa{/solr,null,AVAILABLE}
   [junit4]   2> 1146910 INFO  (jetty-launcher-1994-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@64cf8e21{/solr,null,AVAILABLE}
   [junit4]   2> 1146911 INFO  (jetty-launcher-1994-thread-5) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4ca27259{/solr,null,AVAILABLE}
   [junit4]   2> 1146912 INFO  (jetty-launcher-1994-thread-2) [    ] o.e.j.s.ServerConnector Started ServerConnector@3105cdad{HTTP/1.1,[http/1.1]}{127.0.0.1:60198}
   [junit4]   2> 1146912 INFO  (jetty-launcher-1994-thread-2) [    ] o.e.j.s.Server Started @1153900ms
   [junit4]   2> 1146912 INFO  (jetty-launcher-1994-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7688f481{/solr,null,AVAILABLE}
   [junit4]   2> 1146912 INFO  (jetty-launcher-1994-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=60198}
   [junit4]   2> 1146913 INFO  (jetty-launcher-1994-thread-2) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4554617c
   [junit4]   2> 1146913 INFO  (jetty-launcher-1994-thread-2) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTolerantUpdateProcessorCloud_A9FC1E91EFD4A6DD-001/tempDir-001/node2'
   [junit4]   2> 1146913 INFO  (jetty-launcher-1994-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@55b60ab9{/solr,null,AVAILABLE}
   [junit4]   2> 1146913 INFO  (jetty-launcher-1994-thread-2) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1146913 INFO  (jetty-launcher-1994-thread-2) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1146913 INFO  (jetty-launcher-1994-thread-1) [    ] o.e.j.s.ServerConnector Started ServerConnector@26ec8e8c{HTTP/1.1,[http/1.1]}{127.0.0.1:60201}
   [junit4]   2> 1146913 INFO  (jetty-launcher-1994-thread-1) [    ] o.e.j.s.Server Started @1153901ms
   [junit4]   2> 1146913 INFO  (jetty-launcher-1994-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=60201}
   [junit4]   2> 1146914 INFO  (jetty-launcher-1994-thread-5) [    ] o.e.j.s.ServerConnector Started ServerConnector@d8e934e{HTTP/1.1,[http/1.1]}{127.0.0.1:60199}
   [junit4]   2> 1146914 INFO  (jetty-launcher-1994-thread-1) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4554617c
   [junit4]   2> 1146914 INFO  (jetty-launcher-1994-thread-5) [    ] o.e.j.s.Server Started @1153901ms
   [junit4]   2> 1146914 INFO  (jetty-launcher-1994-thread-1) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTolerantUpdateProcessorCloud_A9FC1E91EFD4A6DD-001/tempDir-001/node1'
   [junit4]   2> 1146914 INFO  (jetty-launcher-1994-thread-1) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1146914 INFO  (jetty-launcher-1994-thread-1) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1146913 INFO  (jetty-launcher-1994-thread-3) [    ] o.e.j.s.ServerConnector Started ServerConnector@24a57dd4{HTTP/1.1,[http/1.1]}{127.0.0.1:60200}
   [junit4]   2> 1146914 INFO  (jetty-launcher-1994-thread-3) [    ] o.e.j.s.Server Started @1153902ms
   [junit4]   2> 1146914 INFO  (jetty-launcher-1994-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=60200}
   [junit4]   2> 1146914 INFO  (jetty-launcher-1994-thread-1) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1146914 INFO  (jetty-launcher-1994-thread-5) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=60199}
   [junit4]   2> 1146914 INFO  (jetty-launcher-1994-thread-2) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1146916 INFO  (jetty-launcher-1994-thread-5) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4554617c
   [junit4]   2> 1146916 INFO  (jetty-launcher-1994-thread-4) [    ] o.e.j.s.ServerConnector Started ServerConnector@6ff473e{HTTP/1.1,[http/1.1]}{127.0.0.1:60197}
   [junit4]   2> 1146916 INFO  (jetty-launcher-1994-thread-5) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTolerantUpdateProcessorCloud_A9FC1E91EFD4A6DD-001/tempDir-001/node5'
   [junit4]   2> 1146916 INFO  (jetty-launcher-1994-thread-4) [    ] o.e.j.s.Server Started @1153904ms
   [junit4]   2> 1146916 INFO  (jetty-launcher-1994-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=60197}
   [junit4]   2> 1146916 INFO  (jetty-launcher-1994-thread-5) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1146916 INFO  (jetty-launcher-1994-thread-5) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1146916 INFO  (jetty-launcher-1994-thread-4) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4554617c
   [junit4]   2> 1146916 INFO  (jetty-launcher-1994-thread-4) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTolerantUpdateProcessorCloud_A9FC1E91EFD4A6DD-001/tempDir-001/node4'
   [junit4]   2> 1146916 INFO  (jetty-launcher-1994-thread-4) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1146916 INFO  (jetty-launcher-1994-thread-4) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1146917 INFO  (jetty-launcher-1994-thread-5) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1146917 INFO  (jetty-launcher-1994-thread-4) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1146917 INFO  (jetty-launcher-1994-thread-1) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1146917 INFO  (jetty-launcher-1994-thread-3) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4554617c
   [junit4]   2> 1146917 INFO  (jetty-launcher-1994-thread-3) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTolerantUpdateProcessorCloud_A9FC1E91EFD4A6DD-001/tempDir-001/node3'
   [junit4]   2> 1146917 INFO  (jetty-launcher-1994-thread-3) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1146917 INFO  (jetty-launcher-1994-thread-3) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1146918 INFO  (jetty-launcher-1994-thread-3) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1146918 INFO  (jetty-launcher-1994-thread-4) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1146919 INFO  (jetty-launcher-1994-thread-5) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1146920 INFO  (jetty-launcher-1994-thread-2) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1146921 INFO  (zkCallback-1999-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3534b682 name:ZooKeeperConnection Watcher:127.0.0.1:60191/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1146922 INFO  (jetty-launcher-1994-thread-4) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1146922 INFO  (jetty-launcher-1994-thread-4) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1146922 INFO  (jetty-launcher-1994-thread-3) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1146923 INFO  (zkCallback-1998-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1b6e6498 name:ZooKeeperConnection Watcher:127.0.0.1:60191/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1146923 INFO  (jetty-launcher-1994-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1146923 INFO  (jetty-launcher-1994-thread-5) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1146923 INFO  (jetty-launcher-1994-thread-5) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1146923 INFO  (zkCallback-1997-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@14dc86cb name:ZooKeeperConnection Watcher:127.0.0.1:60191/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1146923 INFO  (jetty-launcher-1994-thread-1) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1146923 INFO  (zkCallback-1996-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@975a7d5 name:ZooKeeperConnection Watcher:127.0.0.1:60191/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1146924 INFO  (jetty-launcher-1994-thread-1) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1146924 INFO  (jetty-launcher-1994-thread-2) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1146924 INFO  (jetty-launcher-1994-thread-2) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1146924 INFO  (jetty-launcher-1994-thread-5) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1146925 INFO  (zkCallback-2000-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4fc9e81e name:ZooKeeperConnection Watcher:127.0.0.1:60191/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1146925 INFO  (jetty-launcher-1994-thread-3) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1146925 INFO  (jetty-launcher-1994-thread-3) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1146925 INFO  (jetty-launcher-1994-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1146926 INFO  (jetty-launcher-1994-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1146926 INFO  (jetty-launcher-1994-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1146935 INFO  (jetty-launcher-1994-thread-1) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTolerantUpdateProcessorCloud_A9FC1E91EFD4A6DD-001/tempDir-001/node1/.
   [junit4]   2> 1146935 INFO  (jetty-launcher-1994-thread-1) [    ] o.a.s.c.CoreContainer New CoreContainer 1689013379
   [junit4]   2> 1146935 INFO  (jetty-launcher-1994-thread-5) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTolerantUpdateProcessorCloud_A9FC1E91EFD4A6DD-001/tempDir-001/node5/.
   [junit4]   2> 1146936 INFO  (jetty-launcher-1994-thread-1) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTolerantUpdateProcessorCloud_A9FC1E91EFD4A6DD-001/tempDir-001/node1]
   [junit4]   2> 1146936 INFO  (jetty-launcher-1994-thread-4) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTolerantUpdateProcessorCloud_A9FC1E91EFD4A6DD-001/tempDir-001/node4/.
   [junit4]   2> 1146945 WARN  (jetty-launcher-1994-thread-1) [    ] o.a.s.c.CoreContainer Couldn't add files from /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTolerantUpdateProcessorCloud_A9FC1E91EFD4A6DD-001/tempDir-001/node1/lib to classpath: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTolerantUpdateProcessorCloud_A9FC1E91EFD4A6DD-001/tempDir-001/node1/lib
   [junit4]   2> 1146945 INFO  (jetty-launcher-1994-thread-5) [    ] o.a.s.c.CoreContainer New CoreContainer 1789215770
   [junit4]   2> 1146945 INFO  (jetty-launcher-1994-thread-5) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTolerantUpdateProcessorCloud_A9FC1E91EFD4A6DD-001/tempDir-001/node5]
   [junit4]   2> 1146945 INFO  (jetty-launcher-1994-thread-1) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1146945 WARN  (jetty-launcher-1994-thread-5) [    ] o.a.s.c.CoreContainer Couldn't add files from /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTolerantUpdateProcessorCloud_A9FC1E91EFD4A6DD-001/tempDir-001/node5/lib to classpath: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTolerantUpdateProcessorCloud_A9FC1E91EFD4A6DD-001/tempDir-001/node5/lib
   [junit4]   2> 1146946 INFO  (jetty-launcher-1994-thread-5) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1146945 INFO  (jetty-launcher-1994-thread-4) [    ] o.a.s.c.CoreContainer New CoreContainer 50391781
   [junit4]   2> 1146946 INFO  (jetty-launcher-1994-thread-4) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTolerantUpdateProcessorCloud_A9FC1E91EFD4A6DD-001/tempDir-001/node4]
   [junit4]   2> 1146946 WARN  (jetty-launcher-1994-thread-4) [    ] o.a.s.c.CoreContainer Couldn't add files from /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTolerantUpdateProcessorCloud_A9FC1E91EFD4A6DD-001/tempDir-001/node4/lib to classpath: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTolerantUpdateProcessorCloud_A9FC1E91EFD4A6DD-001/tempDir-001/node4/lib
   [junit4]   2> 1146946 INFO  (jetty-launcher-1994-thread-4) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1146947 INFO  (jetty-launcher-1994-thread-2) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTolerantUpdateProcessorCloud_A9FC1E91EFD4A6DD-001/tempDir-001/node2/.
   [junit4]   2> 1146947 INFO  (jetty-launcher-1994-thread-2) [    ] o.a.s.c.CoreContainer New CoreContainer 1333901754
   [junit4]   2> 1146947 INFO  (jetty-launcher-1994-thread-2) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTolerantUpdateProcessorCloud_A9FC1E91EFD4A6DD-001/tempDir-001/node2]
   [junit4]   2> 1146947 WARN  (jetty-launcher-1994-thread-2) [    ] o.a.s.c.CoreContainer Couldn't add files from /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTolerantUpdateProcessorCloud_A9FC1E91EFD4A6DD-001/tempDir-001/node2/lib to classpath: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTolerantUpdateProcessorCloud_A9FC1E91EFD4A6DD-001/tempDir-001/node2/lib
   [junit4]   2> 1146947 INFO  (jetty-launcher-1994-thread-2) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1146949 INFO  (jetty-launcher-1994-thread-2) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1146949 INFO  (jetty-launcher-1994-thread-1) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1146949 INFO  (jetty-launcher-1994-thread-5) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1146949 INFO  (jetty-launcher-1994-thread-2) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1146949 INFO  (jetty-launcher-1994-thread-2) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1146949 INFO  (jetty-launcher-1994-thread-1) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1146949 INFO  (jetty-launcher-1994-thread-5) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1146950 INFO  (jetty-launcher-1994-thread-5) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1146950 INFO  (jetty-launcher-1994-thread-4) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1146949 INFO  (jetty-launcher-1994-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:60191/solr
   [junit4]   2> 1146949 INFO  (jetty-launcher-1994-thread-1) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1146951 INFO  (jetty-launcher-1994-thread-2) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1146951 INFO  (jetty-launcher-1994-thread-2) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1146951 INFO  (jetty-launcher-1994-thread-4) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1146951 INFO  (jetty-launcher-1994-thread-4) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1146951 INFO  (jetty-launcher-1994-thread-5) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:60191/solr
   [junit4]   2> 1146952 INFO  (jetty-launcher-1994-thread-2) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1146953 INFO  (jetty-launcher-1994-thread-5) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1146953 INFO  (jetty-launcher-1994-thread-5) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1146953 INFO  (jetty-launcher-1994-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:60191/solr
   [junit4]   2> 1146951 INFO  (jetty-launcher-1994-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:60191/solr
   [junit4]   2> 1146955 INFO  (jetty-launcher-1994-thread-1) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1146955 INFO  (jetty-launcher-1994-thread-1) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1146953 INFO  (jetty-launcher-1994-thread-5) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1146953 INFO  (jetty-launcher-1994-thread-4) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1146957 INFO  (jetty-launcher-1994-thread-4) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1146955 INFO  (jetty-launcher-1994-thread-1) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1146957 INFO  (jetty-launcher-1994-thread-3) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTolerantUpdateProcessorCloud_A9FC1E91EFD4A6DD-001/tempDir-001/node3/.
   [junit4]   2> 1146957 INFO  (jetty-launcher-1994-thread-3) [    ] o.a.s.c.CoreContainer New CoreContainer 1115765549
   [junit4]   2> 1146958 INFO  (jetty-launcher-1994-thread-3) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTolerantUpdateProcessorCloud_A9FC1E91EFD4A6DD-001/tempDir-001/node3]
   [junit4]   2> 1146958 WARN  (jetty-launcher-1994-thread-3) [    ] o.a.s.c.CoreContainer Couldn't add files from /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTolerantUpdateProcessorCloud_A9FC1E91EFD4A6DD-001/tempDir-001/node3/lib to classpath: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTolerantUpdateProcessorCloud_A9FC1E91EFD4A6DD-001/tempDir-001/node3/lib
   [junit4]   2> 1146958 INFO  (jetty-launcher-1994-thread-4) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1146958 INFO  (jetty-launcher-1994-thread-3) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1146959 INFO  (jetty-launcher-1994-thread-3) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1146959 INFO  (zkCallback-2009-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7d512338 name:ZooKeeperConnection Watcher:127.0.0.1:60191 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1146959 INFO  (jetty-launcher-1994-thread-3) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1146959 INFO  (jetty-launcher-1994-thread-3) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1146959 INFO  (jetty-launcher-1994-thread-2) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1146959 INFO  (jetty-launcher-1994-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:60191/solr
   [junit4]   2> 1146959 INFO  (zkCallback-2011-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@40cd8b53 name:ZooKeeperConnection Watcher:127.0.0.1:60191 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1146960 INFO  (zkCallback-2012-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7523ebb6 name:ZooKeeperConnection Watcher:127.0.0.1:60191 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1146960 INFO  (jetty-launcher-1994-thread-1) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1146961 INFO  (jetty-launcher-1994-thread-4) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1146960 INFO  (zkCallback-2010-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@609ee0c8 name:ZooKeeperConnection Watcher:127.0.0.1:60191 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1146961 INFO  (jetty-launcher-1994-thread-4) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1146959 INFO  (jetty-launcher-1994-thread-2) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1146961 INFO  (jetty-launcher-1994-thread-5) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1146959 INFO  (jetty-launcher-1994-thread-3) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1146961 INFO  (jetty-launcher-1994-thread-3) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1146961 INFO  (jetty-launcher-1994-thread-5) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1146961 INFO  (jetty-launcher-1994-thread-1) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1146962 INFO  (jetty-launcher-1994-thread-3) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1146964 INFO  (jetty-launcher-1994-thread-4) [n:127.0.0.1:60197_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1146965 INFO  (jetty-launcher-1994-thread-2) [n:127.0.0.1:60198_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1146966 INFO  (zkCallback-2015-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@74c277e name:ZooKeeperConnection Watcher:127.0.0.1:60191 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1146966 INFO  (jetty-launcher-1994-thread-3) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1146966 INFO  (jetty-launcher-1994-thread-3) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1146966 INFO  (jetty-launcher-1994-thread-1) [n:127.0.0.1:60201_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1146967 INFO  (jetty-launcher-1994-thread-5) [n:127.0.0.1:60199_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1146968 INFO  (zkCallback-2016-thread-1-processing-n:127.0.0.1:60197_solr) [n:127.0.0.1:60197_solr    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@735b24ba name:ZooKeeperConnection Watcher:127.0.0.1:60191/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1146968 INFO  (jetty-launcher-1994-thread-4) [n:127.0.0.1:60197_solr    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1146969 INFO  (zkCallback-2017-thread-1-processing-n:127.0.0.1:60198_solr) [n:127.0.0.1:60198_solr    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@19ba0bd3 name:ZooKeeperConnection Watcher:127.0.0.1:60191/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1146969 INFO  (jetty-launcher-1994-thread-2) [n:127.0.0.1:60198_solr    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1146969 INFO  (zkCallback-2018-thread-1-processing-n:127.0.0.1:60201_solr) [n:127.0.0.1:60201_solr    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@38603820 name:ZooKeeperConnection Watcher:127.0.0.1:60191/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1146970 INFO  (jetty-launcher-1994-thread-1) [n:127.0.0.1:60201_solr    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1146970 INFO  (zkCallback-2019-thread-1-processing-n:127.0.0.1:60199_solr) [n:127.0.0.1:60199_solr    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6d0dbfca name:ZooKeeperConnection Watcher:127.0.0.1:60191/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1146970 INFO  (jetty-launcher-1994-thread-5) [n:127.0.0.1:60199_solr    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1146971 INFO  (jetty-launcher-1994-thread-3) [n:127.0.0.1:60200_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1146971 INFO  (jetty-launcher-1994-thread-4) [n:127.0.0.1:60197_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1146971 INFO  (jetty-launcher-1994-thread-2) [n:127.0.0.1:60198_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1146972 INFO  (jetty-launcher-1994-thread-1) [n:127.0.0.1:60201_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1146972 INFO  (zkCallback-2020-thread-1-processing-n:127.0.0.1:60200_solr) [n:127.0.0.1:60200_solr    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@650dda6a name:ZooKeeperConnection Watcher:127.0.0.1:60191/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1146972 INFO  (jetty-launcher-1994-thread-3) [n:127.0.0.1:60200_solr    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1146973 INFO  (jetty-launcher-1994-thread-5) [n:127.0.0.1:60199_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1146975 INFO  (jetty-launcher-1994-thread-2) [n:127.0.0.1:60198_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1146976 INFO  (jetty-launcher-1994-thread-3) [n:127.0.0.1:60200_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1146976 INFO  (jetty-launcher-1994-thread-1) [n:127.0.0.1:60201_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1146976 INFO  (jetty-launcher-1994-thread-4) [n:127.0.0.1:60197_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1146977 INFO  (jetty-launcher-1994-thread-5) [n:127.0.0.1:60199_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1146983 INFO  (jetty-launcher-1994-thread-4) [n:127.0.0.1:60197_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1146984 INFO  (jetty-launcher-1994-thread-1) [n:127.0.0.1:60201_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1146984 INFO  (jetty-launcher-1994-thread-3) [n:127.0.0.1:60200_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1146984 INFO  (jetty-launcher-1994-thread-2) [n:127.0.0.1:60198_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1146985 INFO  (jetty-launcher-1994-thread-5) [n:127.0.0.1:60199_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1146988 INFO  (jetty-launcher-1994-thread-1) [n:127.0.0.1:60201_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1146988 INFO  (jetty-launcher-1994-thread-3) [n:127.0.0.1:60200_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1146989 INFO  (jetty-launcher-1994-thread-4) [n:127.0.0.1:60197_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1146989 INFO  (jetty-launcher-1994-thread-2) [n:127.0.0.1:60198_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1146990 INFO  (jetty-launcher-1994-thread-5) [n:127.0.0.1:60199_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1146993 INFO  (jetty-launcher-1994-thread-4) [n:127.0.0.1:60197_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1146993 INFO  (jetty-launcher-1994-thread-2) [n:127.0.0.1:60198_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1146994 INFO  (jetty-launcher-1994-thread-3) [n:127.0.0.1:60200_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1146994 INFO  (jetty-launcher-1994-thread-1) [n:127.0.0.1:60201_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1146995 INFO  (jetty-launcher-1994-thread-5) [n:127.0.0.1:60199_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1146998 INFO  (jetty-launcher-1994-thread-3) [n:127.0.0.1:60200_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1146999 INFO  (jetty-launcher-1994-thread-2) [n:127.0.0.1:60198_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1146999 INFO  (jetty-launcher-1994-thread-1) [n:127.0.0.1:60201_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1146999 INFO  (jetty-launcher-1994-thread-4) [n:127.0.0.1:60197_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1147001 INFO  (jetty-launcher-1994-thread-5) [n:127.0.0.1:60199_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1147003 INFO  (jetty-launcher-1994-thread-1) [n:127.0.0.1:60201_solr    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1147003 INFO  (jetty-launcher-1994-thread-2) [n:127.0.0.1:60198_solr    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1147003 INFO  (jetty-launcher-1994-thread-4) [n:127.0.0.1:60197_solr    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1147004 INFO  (jetty-launcher-1994-thread-3) [n:127.0.0.1:60200_solr    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1147006 INFO  (jetty-launcher-1994-thread-5) [n:127.0.0.1:60199_solr    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1147007 INFO  (jetty-launcher-1994-thread-2) [n:127.0.0.1:60198_solr    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1147007 INFO  (jetty-launcher-1994-thread-4) [n:127.0.0.1:60197_solr    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1147007 INFO  (jetty-launcher-1994-thread-1) [n:127.0.0.1:60201_solr    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1147008 INFO  (jetty-launcher-1994-thread-3) [n:127.0.0.1:60200_solr    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1147010 INFO  (jetty-launcher-1994-thread-5) [n:127.0.0.1:60199_solr    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1147010 INFO  (jetty-launcher-1994-thread-4) [n:127.0.0.1:60197_solr    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1147010 INFO  (jetty-launcher-1994-thread-1) [n:127.0.0.1:60201_solr    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1147011 INFO  (jetty-launcher-1994-thread-3) [n:127.0.0.1:60200_solr    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1147011 INFO  (jetty-launcher-1994-thread-2) [n:127.0.0.1:60198_solr    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1147013 INFO  (jetty-launcher-1994-thread-4) [n:127.0.0.1:60197_solr    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1147013 INFO  (jetty-launcher-1994-thread-5) [n:127.0.0.1:60199_solr    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1147014 INFO  (jetty-launcher-1994-thread-3) [n:127.0.0.1:60200_solr    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1147014 INFO  (jetty-launcher-1994-thread-1) [n:127.0.0.1:60201_solr    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1147014 INFO  (jetty-launcher-1994-thread-2) [n:127.0.0.1:60198_solr    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1147015 INFO  (jetty-launcher-1994-thread-4) [n:127.0.0.1:60197_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1147016 INFO  (jetty-launcher-1994-thread-3) [n:127.0.0.1:60200_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1147016 INFO  (jetty-launcher-1994-thread-5) [n:127.0.0.1:60199_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1147017 INFO  (jetty-launcher-1994-thread-1) [n:127.0.0.1:60201_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1147017 INFO  (jetty-launcher-1994-thread-2) [n:127.0.0.1:60198_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1147018 INFO  (jetty-launcher-1994-thread-4) [n:127.0.0.1:60197_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1147020 INFO  (jetty-launcher-1994-thread-2) [n:127.0.0.1:60198_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1147021 INFO  (jetty-launcher-1994-thread-3) [n:127.0.0.1:60200_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1147022 INFO  (jetty-launcher-1994-thread-1) [n:127.0.0.1:60201_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1147022 INFO  (jetty-launcher-1994-thread-5) [n:127.0.0.1:60199_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1147023 INFO  (jetty-launcher-1994-thread-4) [n:127.0.0.1:60197_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1147029 INFO  (jetty-launcher-1994-thread-2) [n:127.0.0.1:60198_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1147029 INFO  (jetty-launcher-1994-thread-4) [n:127.0.0.1:60197_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1147032 INFO  (jetty-launcher-1994-thread-3) [n:127.0.0.1:60200_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1147033 INFO  (jetty-launcher-1994-thread-4) [n:127.0.0.1:60197_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1147033 INFO  (jetty-launcher-1994-thread-2) [n:127.0.0.1:60198_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1147033 INFO  (jetty-launcher-1994-thread-4) [n:127.0.0.1:60197_solr    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95657971477970955-127.0.0.1:60197_solr-n_0000000000
   [junit4]   2> 1147034 INFO  (jetty-launcher-1994-thread-2) [n:127.0.0.1:60198_solr    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95657971477970956-127.0.0.1:60198_solr-n_0000000001
   [junit4]   2> 1147034 INFO  (jetty-launcher-1994-thread-4) [n:127.0.0.1:60197_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:60197_solr
   [junit4]   2> 1147034 INFO  (jetty-launcher-1994-thread-4) [n:127.0.0.1:60197_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1147035 INFO  (jetty-launcher-1994-thread-2) [n:127.0.0.1:60198_solr    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95657971477970955-127.0.0.1:60197_solr-n_0000000000 to know if I could be the leader
   [junit4]   2> 1147035 INFO  (jetty-launcher-1994-thread-5) [n:127.0.0.1:60199_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1147035 INFO  (jetty-launcher-1994-thread-1) [n:127.0.0.1:60201_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1147035 INFO  (jetty-launcher-1994-thread-2) [n:127.0.0.1:60198_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60198_solr
   [junit4]   2> 1147036 INFO  (jetty-launcher-1994-thread-2) [n:127.0.0.1:60198_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:60198_solr
   [junit4]   2> 1147037 INFO  (jetty-launcher-1994-thread-4) [n:127.0.0.1:60197_solr    ] o.a.s.c.Overseer Overseer (id=95657971477970955-127.0.0.1:60197_solr-n_0000000000) starting
   [junit4]   2> 1147038 INFO  (jetty-launcher-1994-thread-1) [n:127.0.0.1:60201_solr    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95657971477970957-127.0.0.1:60201_solr-n_0000000002
   [junit4]   2> 1147039 INFO  (zkCallback-2017-thread-1-processing-n:127.0.0.1:60198_solr) [n:127.0.0.1:60198_solr    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 1147039 INFO  (zkCallback-2019-thread-1-processing-n:127.0.0.1:60199_solr) [n:127.0.0.1:60199_solr    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 1147039 INFO  (zkCallback-2020-thread-1-processing-n:127.0.0.1:60200_solr) [n:127.0.0.1:60200_solr    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 1147039 INFO  (zkCallback-2018-thread-1-processing-n:127.0.0.1:60201_solr) [n:127.0.0.1:60201_solr    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 1147039 INFO  (zkCallback-2016-thread-1-processing-n:127.0.0.1:60197_solr) [n:127.0.0.1:60197_solr    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 1147042 INFO  (zkCallback-2017-thread-1-processing-n:127.0.0.1:60198_solr) [n:127.0.0.1:60198_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1147042 INFO  (zkCallback-2019-thread-1-processing-n:127.0.0.1:60199_solr) [n:127.0.0.1:60199_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1147043 INFO  (jetty-launcher-1994-thread-3) [n:127.0.0.1:60200_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1147044 INFO  (zkCallback-2018-thread-1-processing-n:127.0.0.1:60201_solr) [n:127.0.0.1:60201_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1147044 INFO  (zkCallback-2020-thread-1-processing-n:127.0.0.1:60200_solr) [n:127.0.0.1:60200_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1147045 INFO  (jetty-launcher-1994-thread-4) [n:127.0.0.1:60197_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1147045 INFO  (jetty-launcher-1994-thread-3) [n:127.0.0.1:60200_solr    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95657971477970959-127.0.0.1:60200_solr-n_0000000004
   [junit4]   2> 1147043 INFO  (jetty-launcher-1994-thread-5) [n:127.0.0.1:60199_solr    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95657971477970958-127.0.0.1:60199_solr-n_0000000003
   [junit4]   2> 1147044 INFO  (zkCallback-2016-thread-1-processing-n:127.0.0.1:60197_solr) [n:127.0.0.1:60197_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1147049 INFO  (jetty-launcher-1994-thread-1) [n:127.0.0.1:60201_solr    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95657971477970956-127.0.0.1:60198_solr-n_0000000001 to know if I could be the leader
   [junit4]   2> 1147050 INFO  (jetty-launcher-1994-thread-1) [n:127.0.0.1:60201_solr    ] o.a.s.c.ZkController Publish node=127.0.0.1:60201_solr as DOWN
   [junit4]   2> 1147056 INFO  (jetty-launcher-1994-thread-4) [n:127.0.0.1:60197_solr    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1147056 INFO  (OverseerCollectionConfigSetProcessor-95657971477970955-127.0.0.1:60197_solr-n_0000000000) [n:127.0.0.1:60197_solr    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 1147057 INFO  (OverseerStateUpdate-95657971477970955-127.0.0.1:60197_solr-n_0000000000) [n:127.0.0.1:60197_solr    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1147057 INFO  (jetty-launcher-1994-thread-5) [n:127.0.0.1:60199_solr    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95657971477970957-127.0.0.1:60201_solr-n_0000000002 to know if I could be the leader
   [junit4]   2> 1147057 INFO  (jetty-launcher-1994-thread-4) [n:127.0.0.1:60197_solr    ] o.a.s.c.ZkController Publish node=127.0.0.1:60197_solr as DOWN
   [junit4]   2> 1147060 INFO  (OverseerStateUpdate-95657971477970955-127.0.0.1:60197_solr-n_0000000000) [n:127.0.0.1:60197_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1)
   [junit4]   2> 1147061 INFO  (jetty-launcher-1994-thread-2) [n:127.0.0.1:60198_solr    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1147061 INFO  (jetty-launcher-1994-thread-2) [n:127.0.0.1:60198_solr    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1147061 INFO  (jetty-launcher-1994-thread-3) [n:127.0.0.1:60200_solr    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95657971477970958-127.0.0.1:60199_solr-n_0000000003 to know if I could be the leader
   [junit4]   2> 1147062 INFO  (jetty-launcher-1994-thread-2) [n:127.0.0.1:60198_solr    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTolerantUpdateProcessorCloud_A9FC1E91EFD4A6DD-001/tempDir-001/node2/.
   [junit4]   2> 1147062 INFO  (jetty-launcher-1994-thread-2) [n:127.0.0.1:60198_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
   [junit4]   2> 1147062 INFO  (OverseerStateUpdate-95657971477970955-127.0.0.1:60197_solr-n_0000000000) [n:127.0.0.1:60197_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:60201_solr"} current state version: 0
   [junit4]   2> 1147063 INFO  (OverseerStateUpdate-95657971477970955-127.0.0.1:60197_solr-n_0000000000) [n:127.0.0.1:60197_solr    ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:60201_solr
   [junit4]   2> 1147063 INFO  (jetty-launcher-1994-thread-3) [n:127.0.0.1:60200_solr    ] o.a.s.c.ZkController Publish node=127.0.0.1:60200_solr as DOWN
   [junit4]   2> 1147063 INFO  (jetty-launcher-1994-thread-2) [n:127.0.0.1:60198_solr    ] o.a.s.s.SolrDispatchFilter user.dir=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 1147063 INFO  (jetty-launcher-1994-thread-2) [n:127.0.0.1:60198_solr    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1147065 INFO  (OverseerStateUpdate-95657971477970955-127.0.0.1:60197_solr-n_0000000000) [n:127.0.0.1:60197_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:60197_solr"} current state version: 0
   [junit4]   2> 1147065 INFO  (OverseerStateUpdate-95657971477970955-127.0.0.1:60197_solr-n_0000000000) [n:127.0.0.1:60197_solr    ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:60197_solr
   [junit4]   2> 1147065 INFO  (jetty-launcher-1994-thread-5) [n:127.0.0.1:60199_solr    ] o.a.s.c.ZkController Publish node=127.0.0.1:60199_solr as DOWN
   [junit4]   2> 1147069 INFO  (OverseerStateUpdate-95657971477970955-127.0.0.1:60197_solr-n_0000000000) [n:127.0.0.1:60197_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:60200_solr"} current state version: 0
   [junit4]   2> 1147069 INFO  (OverseerStateUpdate-95657971477970955-127.0.0.1:60197_solr-n_0000000000) [n:127.0.0.1:60197_solr    ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:60200_solr
   [junit4]   2> 1147071 INFO  (OverseerStateUpdate-95657971477970955-127.0.0.1:60197_solr-n_0000000000) [n:127.0.0.1:60197_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:60199_solr"} current state version: 0
   [junit4]   2> 1147071 INFO  (OverseerStateUpdate-95657971477970955-127.0.0.1:60197_solr-n_0000000000) [n:127.0.0.1:60197_solr    ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:60199_solr
   [junit4]   2> 1148061 INFO  (jetty-launcher-1994-thread-4) [n:127.0.0.1:60197_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60197_solr
   [junit4]   2> 1148061 INFO  (jetty-launcher-1994-thread-1) [n:127.0.0.1:60201_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60201_solr
   [junit4]   2> 1148062 INFO  (jetty-launcher-1994-thread-4) [n:127.0.0.1:60197_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:60197_solr
   [junit4]   2> 1148062 INFO  (jetty-launcher-1994-thread-1) [n:127.0.0.1:60201_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:60201_solr
   [junit4]   2> 1148064 INFO  (zkCallback-2016-thread-1-processing-n:127.0.0.1:60197_solr) [n:127.0.0.1:60197_solr    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1148064 INFO  (zkCallback-2019-thread-1-processing-n:127.0.0.1:60199_solr) [n:127.0.0.1:60199_solr    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1148065 INFO  (zkCallback-2020-thread-1-processing-n:127.0.0.1:60200_solr) [n:127.0.0.1:60200_solr    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1148065 INFO  (zkCallback-2017-thread-1-processing-n:127.0.0.1:60198_solr) [n:127.0.0.1:60198_solr    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1148065 INFO  (zkCallback-2018-thread-1-processing-n:127.0.0.1:60201_solr) [n:127.0.0.1:60201_solr    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1148066 INFO  (zkCallback-2019-thread-1-processing-n:127.0.0.1:60199_solr) [n:127.0.0.1:60199_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
   [junit4]   2> 1148066 INFO  (zkCallback-2020-thread-1-processing-n:127.0.0.1:60200_solr) [n:127.0.0.1:60200_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
   [junit4]   2> 1148066 INFO  (zkCallback-2017-thread-1-processing-n:127.0.0.1:60198_solr) [n:127.0.0.1:60198_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
   [junit4]   2> 1148067 INFO  (zkCallback-2018-thread-1-processing-n:127.0.0.1:60201_solr) [n:127.0.0.1:60201_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
   [junit4]   2> 1148067 INFO  (zkCallback-2016-thread-1-processing-n:127.0.0.1:60197_solr) [n:127.0.0.1:60197_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
   [junit4]   2> 1148072 INFO  (jetty-launcher-1994-thread-3) [n:127.0.0.1:60200_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60200_solr
   [junit4]   2> 1148072 INFO  (jetty-launcher-1994-thread-5) [n:127.0.0.1:60199_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60199_solr
   [junit4]   2> 1148074 INFO  (jetty-launcher-1994-thread-5) [n:127.0.0.1:60199_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:60199_solr
   [junit4]   2> 1148074 INFO  (jetty-launcher-1994-thread-3) [n:127.0.0.1:60200_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:60200_solr
   [junit4]   2> 1148078 INFO  (zkCallback-2019-thread-1-processing-n:127.0.0.1:60199_solr) [n:127.0.0.1:60199_solr    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1148093 INFO  (jetty-launcher-1994-thread-3) [n:127.0.0.1:60200_solr    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1148125 INFO  (jetty-launcher-1994-thread-3) [n:127.0.0.1:60200_solr    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1148092 INFO  (jetty-launcher-1994-thread-5) [n:127.0.0.1:60199_solr    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1148125 INFO  (jetty-launcher-1994-thread-5) [n:127.0.0.1:60199_solr    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1148085 INFO  (jetty-launcher-1994-thread-4) [n:127.0.0.1:60197_solr    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1148080 INFO  (jetty-launcher-1994-thread-1) [n:127.0.0.1:60201_solr    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1148079 INFO  (zkCallback-2017-thread-1-processing-n:127.0.0.1:60198_solr) [n:127.0.0.1:60198_solr    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1148079 INFO  (zkCallback-2018-thread-1-processing-n:127.0.0.1:60201_solr) [n:127.0.0.1:60201_solr    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1148078 INFO  (zkCallback-2020-thread-1-processing-n:127.0.0.1:60200_solr) [n:127.0.0.1:60200_solr    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1148078 INFO  (zkCallback-2016-thread-1-processing-n:127.0.0.1:60197_solr) [n:127.0.0.1:60197_solr    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
   [junit4]   2> 1148127 INFO  (jetty-launcher-1994-thread-3) [n:127.0.0.1:60200_solr    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTolerantUpdateProcessorCloud_A9FC1E91EFD4A6DD-001/tempDir-001/node3/.
   [junit4]   2> 1148128 INFO  (jetty-launcher-1994-thread-5) [n:127.0.0.1:60199_solr    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTolerantUpdateProcessorCloud_A9FC1E91EFD4A6DD-001/tempDir-001/node5/.
   [junit4]   2> 1148128 INFO  (jetty-launcher-1994-thread-5) [n:127.0.0.1:60199_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
   [junit4]   2> 1148129 INFO  (jetty-launcher-1994-thread-1) [n:127.0.0.1:60201_solr    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1148129 INFO  (zkCallback-2019-thread-1-processing-n:127.0.0.1:60199_solr) [n:127.0.0.1:60199_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (5)
   [junit4]   2> 1148129 INFO  (jetty-launcher-1994-thread-4) [n:127.0.0.1:60197_solr    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1148129 INFO  (zkCallback-2016-thread-1-processing-n:127.0.0.1:60197_solr) [n:127.0.0.1:60197_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (5)
   [junit4]   2> 1148130 INFO  (jetty-launcher-1994-thread-1) [n:127.0.0.1:60201_solr    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTolerantUpdateProcessorCloud_A9FC1E91EFD4A6DD-001/tempDir-001/node1/.
   [junit4]   2> 1148130 INFO  (jetty-launcher-1994-thread-3) [n:127.0.0.1:60200_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
   [junit4]   2> 1148130 INFO  (jetty-launcher-1994-thread-1) [n:127.0.0.1:60201_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
   [junit4]   2> 1148130 INFO  (zkCallback-2017-thread-1-processing-n:127.0.0.1:60198_solr) [n:127.0.0.1:60198_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (5)
   [junit4]   2> 1148131 INFO  (zkCallback-2018-thread-1-processing-n:127.0.0.1:60201_solr) [n:127.0.0.1:60201_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (5)
   [junit4]   2> 1148131 INFO  (jetty-launcher-1994-thread-4) [n:127.0.0.1:60197_solr    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestTolerantUpdateProcessorCloud_A9FC1E91EFD4A6DD-001/tempDir-001/node4/.
   [junit4]   2> 1148132 INFO  (zkCallback-2020-thread-1-processing-n:127.0.0.1:60200_solr) [n:127.0.0.1:60200_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (5)
   [junit4]   2> 1148132 INFO  (jetty-launcher-1994-thread-4) [n:127.0.0.1:60197_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
   [junit4]   2> 1148133 INFO  (jetty-launcher-1994-thread-5) [n:127.0.0.1:60199_solr    ] o.a.s.s.SolrDispatchFilter user.dir=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 1148133 INFO  (jetty-launcher-1994-thread-5) [n:127.0.0.1:60199_solr    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1148133 INFO  (jetty-launcher-1994-thread-1) [n:127.0.0.1:60201_solr    ] o.a.s.s.SolrDispatchFilter user.dir=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 1148133 INFO  (jetty-launcher-1994-thread-3) [n:127.0.0.1:60200_solr    ] o.a.s.s.SolrDispatchFilter user.dir=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 1148133 INFO  (jetty-launcher-1994-thread-1) [n:127.0.0.1:60201_solr    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1148133 INFO  (jetty-launcher-1994-thread-3) [n:127.0.0.1:60200_solr    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1148134 INFO  (jetty-launcher-1994-thread-4) [n:127.0.0.1:60197_solr    ] o.a.s.s.SolrDispatchFilter user.dir=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 1148134 INFO  (jetty-launcher-1994-thread-4) [n:127.0.0.1:60197_solr    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1148134 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1148135 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1148136 INFO  (zkCallback-2021-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4863898d name:ZooKeeperConnection Watcher:127.0.0.1:60191 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1148177 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1148178 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1148181 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1148182 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1148183 INFO  (zkCallback-2023-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@27900e63 name:ZooKeeperConnection Watcher:127.0.0.1:60191/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1148183 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1148184 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1148184 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1148186 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 1148189 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/addfields.updateprocessor.js
   [junit4]   2> 1148193 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/analyzingInfixSuggest.txt
   [junit4]   2> 1148197 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-currency.xml
   [junit4]   2> 1148200 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-error-solrconfig.xml
   [junit4]   2> 1148203 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-mp-solrconfig.xml
   [junit4]   2> 1148207 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-mpf-solrconfig.xml
   [junit4]   2> 1148210 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-analyzer-class-and-nested.xml
   [junit4]   2> 1148213 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-bogus-analysis-parameters.xml
   [junit4]   2> 1148217 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-bogus-field-parameters.xml
   [junit4]   2> 1148220 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-codec-global-vs-ft-mismatch.xml
   [junit4]   2> 1148223 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-currency-dynamic-multivalued.xml
   [junit4]   2> 1148226 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-currency-ft-bogus-code-in-xml.xml
   [junit4]   2> 1148230 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-currency-ft-bogus-default-code.xml
   [junit4]   2> 1148233 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-currency-ft-multivalued.xml
   [junit4]   2> 1148237 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-currency-ft-oer-norates.xml
   [junit4]   2> 1148240 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-currency-multivalued.xml
   [junit4]   2> 1148243 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-dup-dynamicField.xml
   [junit4]   2> 1148247 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-dup-field.xml
   [junit4]   2> 1148250 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-dup-fieldType.xml
   [junit4]   2> 1148255 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-dynamicfield-default-val.xml
   [junit4]   2> 1148258 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-dynamicfield-required.xml
   [junit4]   2> 1148261 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-external-filefield.xml
   [junit4]   2> 1148264 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-init-error.xml
   [junit4]   2> 1148268 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-misplaced-asterisk-copyfield-dest-should-fail-test.xml
   [junit4]   2> 1148271 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-misplaced-asterisk-copyfield-source-should-fail-test.xml
   [junit4]   2> 1148274 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-multiple-asterisk-copyfield-dest-should-fail-test.xml
   [junit4]   2> 1148278 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-multiple-asterisk-copyfield-source-should-fail-test.xml
   [junit4]   2> 1148281 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-non-glob-copyfield-source-matching-nothing-should-fail-test.xml
   [junit4]   2> 1148285 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-nontext-analyzer.xml
   [junit4]   2> 1148287 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-not-indexed-but-norms.xml
   [junit4]   2> 1148291 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-not-indexed-but-pos.xml
   [junit4]   2> 1148294 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-not-indexed-but-tf.xml
   [junit4]   2> 1148297 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-omit-tf-but-not-pos.xml
   [junit4]   2> 1148300 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-sim-default-does-not-exist.xml
   [junit4]   2> 1148304 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-sim-default-has-no-explicit-sim.xml
   [junit4]   2> 1148307 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-sim-global-vs-ft-mismatch.xml
   [junit4]   2> 1148310 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-sweetspot-both-tf.xml
   [junit4]   2> 1148314 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-sweetspot-partial-baseline.xml
   [junit4]   2> 1148317 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-sweetspot-partial-hyperbolic.xml
   [junit4]   2> 1148321 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-sweetspot-partial-norms.xml
   [junit4]   2> 1148324 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-uniquekey-is-copyfield-dest.xml
   [junit4]   2> 1148327 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-uniquekey-multivalued.xml
   [junit4]   2> 1148330 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-uniquekey-uses-default.xml
   [junit4]   2> 1148334 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-schema-unsupported-docValues.xml
   [junit4]   2> 1148338 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-solrconfig-bogus-scriptengine-name.xml
   [junit4]   2> 1148341 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-solrconfig-invalid-scriptfile.xml
   [junit4]   2> 1148344 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-solrconfig-managed-schema-named-schema.xml.xml
   [junit4]   2> 1148347 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-solrconfig-missing-scriptfile.xml
   [junit4]   2> 1148351 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-solrconfig-multiple-cfs.xml
   [junit4]   2> 1148354 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-solrconfig-multiple-dirfactory.xml
   [junit4]   2> 1148358 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-solrconfig-multiple-indexconfigs.xml
   [junit4]   2> 1148361 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-solrconfig-nrtmode.xml
   [junit4]   2> 1148365 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-solrconfig-schema-mutable-but-not-managed.xml
   [junit4]   2> 1148368 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad-solrconfig-unexpected-schema-attribute.xml
   [junit4]   2> 1148372 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/bad_solrconfig.xml
   [junit4]   2> 1148375 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/blendedInfixSuggest.txt
   [junit4]   2> 1148378 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/compoundDictionary.txt
   [junit4]   2> 1148381 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/conditional.updateprocessor.js
   [junit4]   2> 1148385 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/cross-compatible.js
   [junit4]   2> 1148388 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/currency.xml
   [junit4]   2> 1148391 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/da_compoundDictionary.txt
   [junit4]   2> 1148394 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/da_UTF8.xml
   [junit4]   2> 1148397 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/elevate.xml
   [junit4]   2> 1148401 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/enumsConfig.xml
   [junit4]   2> 1148403 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/freeTextSuggest.txt
   [junit4]   2> 1148406 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/frenchArticles.txt
   [junit4]   2> 1148409 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/fuzzysuggest.txt
   [junit4]   2> 1148413 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/hunspell-test.aff
   [junit4]   2> 1148416 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/hunspell-test.dic
   [junit4]   2> 1148419 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/hyphenation.dtd
   [junit4]   2> 1148422 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/jasuggest.txt
   [junit4]   2> 1148426 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/keep-1.txt
   [junit4]   2> 1148428 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/keep-2.txt
   [junit4]   2> 1148432 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1148435 INFO  (SUITE-TestTolerantUpdateProcessorCloud-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/missing.functions.updateprocessor.js
   [jun

[...truncated too long message...]

llection1/data;done=false>>]
   [junit4]   2> 1520485 INFO  (zkCallback-2239-thread-1-processing-n:127.0.0.1:61334_) [n:127.0.0.1:61334_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory, CoreContainer#isShutdown=true
   [junit4]   2> 1520485 INFO  (zkCallback-2239-thread-1-processing-n:127.0.0.1:61334_) [n:127.0.0.1:61334_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DistribDocExpirationUpdateProcessorTest_A9FC1E91EFD4A6DD-001/shard-4-001/cores/collection1/data
   [junit4]   2> 1520485 INFO  (zkCallback-2239-thread-1-processing-n:127.0.0.1:61334_) [n:127.0.0.1:61334_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DistribDocExpirationUpdateProcessorTest_A9FC1E91EFD4A6DD-001/shard-4-001/cores/collection1/data/index [CachedDir<<refCount=0;path=/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DistribDocExpirationUpdateProcessorTest_A9FC1E91EFD4A6DD-001/shard-4-001/cores/collection1/data/index;done=false>>]
   [junit4]   2> 1520485 INFO  (zkCallback-2239-thread-1-processing-n:127.0.0.1:61334_) [n:127.0.0.1:61334_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory, CoreContainer#isShutdown=true
   [junit4]   2> 1520485 INFO  (zkCallback-2239-thread-1-processing-n:127.0.0.1:61334_) [n:127.0.0.1:61334_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DistribDocExpirationUpdateProcessorTest_A9FC1E91EFD4A6DD-001/shard-4-001/cores/collection1/data/index
   [junit4]   2> 1520487 INFO  (TEST-DistribDocExpirationUpdateProcessorTest.test-seed#[A9FC1E91EFD4A6DD]) [    ] o.e.j.s.ServerConnector Stopped ServerConnector@781bfead{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1520487 INFO  (TEST-DistribDocExpirationUpdateProcessorTest.test-seed#[A9FC1E91EFD4A6DD]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@7ab16c75{/,null,UNAVAILABLE}
   [junit4]   2> 1520489 INFO  (TEST-DistribDocExpirationUpdateProcessorTest.test-seed#[A9FC1E91EFD4A6DD]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:61276 61276
   [junit4]   2> 1520509 INFO  (Thread-2823) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:61276 61276
   [junit4]   2> 1523242 WARN  (Thread-2823) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/aliases.json
   [junit4]   2> 	5	/solr/security.json
   [junit4]   2> 	5	/solr/configs/conf1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/live_nodes
   [junit4]   2> 	6	/solr/collections
   [junit4]   2> 	3	/solr/overseer/queue
   [junit4]   2> 	3	/solr/overseer/collection-queue-work
   [junit4]   2> 	2	/solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=DistribDocExpirationUpdateProcessorTest -Dtests.method=test -Dtests.seed=A9FC1E91EFD4A6DD -Dtests.slow=true -Dtests.locale=ar -Dtests.timezone=America/Juneau -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] FAILURE 72.4s J0 | DistribDocExpirationUpdateProcessorTest.test <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: There are still nodes recoverying - waited for 45 seconds
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([A9FC1E91EFD4A6DD:21A8214B4128CB25]:0)
   [junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:173)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:856)
   [junit4]    > 	at org.apache.solr.cloud.DistribDocExpirationUpdateProcessorTest.test(DistribDocExpirationUpdateProcessorTest.java:73)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1523244 INFO  (SUITE-DistribDocExpirationUpdateProcessorTest-seed#[A9FC1E91EFD4A6DD]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.DistribDocExpirationUpdateProcessorTest_A9FC1E91EFD4A6DD-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene60): {_version_=PostingsFormat(name=LuceneVarGapFixedInterval), id=FSTOrd50}, docValues:{}, maxPointsInLeafNode=1608, maxMBSortInHeap=5.2807533636655695, sim=ClassicSimilarity, locale=ar, timezone=America/Juneau
   [junit4]   2> NOTE: Mac OS X 10.11.3 x86_64/Oracle Corporation 1.8.0_72 (64-bit)/cpus=3,threads=1,free=142997528,total=398766080
   [junit4]   2> NOTE: All tests run in this JVM: [TestSolrDeletionPolicy1, TestCoreContainer, TestSolrConfigHandlerCloud, DistributedFacetPivotWhiteBoxTest, TestSolrCLIRunExample, TestFieldSortValues, PeerSyncTest, OverriddenZkACLAndCredentialsProvidersTest, UnloadDistributedZkTest, DocValuesTest, IndexBasedSpellCheckerTest, URLClassifyProcessorTest, UUIDUpdateProcessorFallbackTest, DocumentAnalysisRequestHandlerTest, FacetPivotSmallTest, TestMaxScoreQueryParser, DocExpirationUpdateProcessorFactoryTest, RecoveryZkTest, SuggesterFSTTest, PrimitiveFieldTypeTest, TestWordDelimiterFilterFactory, TestDFISimilarityFactory, TestDocSet, SSLMigrationTest, DistributedFacetPivotSmallAdvancedTest, TestGeoJSONResponseWriter, DeleteReplicaTest, TestCursorMarkWithoutUniqueKey, TestLazyCores, TestScoreJoinQPNoScore, SOLR749Test, FullHLLTest, SimpleFacetsTest, PrimUtilsTest, DeleteStatusTest, TestMiniSolrCloudCluster, TestRandomDVFaceting, PreAnalyzedFieldTest, TestQuerySenderNoQuery, TestAuthorizationFramework, TestDistribIDF, CoreAdminCreateDiscoverTest, TestDownShardTolerantSearch, EnumFieldTest, TermsComponentTest, TestNoOpRegenerator, TestStressLucene, CdcrUpdateLogTest, DateRangeFieldTest, TestGroupingSearch, FastVectorHighlighterTest, TestStressUserVersions, TestPhraseSuggestions, TestCodecSupport, TestSolrXml, ClusterStateUpdateTest, ZkCLITest, TestSearchPerf, CoreMergeIndexesAdminHandlerTest, HLLUtilTest, TestDistributedStatsComponentCardinality, TestPivotHelperCode, TestRecoveryHdfs, HdfsBasicDistributedZkTest, DistributedSpellCheckComponentTest, SolrRequestParserTest, TestFieldTypeCollectionResource, TlogReplayBufferedWhileIndexingTest, TestFunctionQuery, TestSortingResponseWriter, QueryResultKeyTest, TestConfigSetsAPIExclusivity, OverseerTest, HardAutoCommitTest, TestCollationFieldDocValues, DistributedFacetPivotLargeTest, DirectSolrSpellCheckerTest, QueryEqualityTest, TestClusterStateMutator, RemoteQueryErrorTest, TestFaceting, AssignTest, TestJmxIntegration, SolrIndexConfigTest, HdfsChaosMonkeySafeLeaderTest, PolyFieldTest, RuleEngineTest, ChaosMonkeyNothingIsSafeTest, BitVectorTest, StandardRequestHandlerTest, TestSort, TestBlobHandler, HighlighterTest, TestCloudInspectUtil, TestTolerantUpdateProcessorCloud, AnalysisAfterCoreReloadTest, AddBlockUpdateTest, TestSerializedLuceneMatchVersion, SyncSliceTest, TestPostingsSolrHighlighter, JavabinLoaderTest, PingRequestHandlerTest, TestObjectReleaseTracker, TestMinMaxOnMultiValuedField, CircularListTest, JSONWriterTest, ShardSplitTest, TestElisionMultitermQuery, TestHighFrequencyDictionaryFactory, TestSearcherReuse, ClassificationUpdateProcessorFactoryTest, DistribDocExpirationUpdateProcessorTest]
   [junit4] Completed [229/585 (2!)] on J0 in 72.42s, 1 test, 1 failure <<< FAILURES!

[...truncated 1139 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/build.xml:740: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/build.xml:684: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/build.xml:59: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/build.xml:233: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/solr/common-build.xml:529: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/lucene/common-build.xml:1457: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-6.x-MacOSX/lucene/common-build.xml:1014: There were test failures: 585 suites (10 ignored), 2341 tests, 1 suite-level error, 1 failure, 119 ignored (69 assumptions) [seed: A9FC1E91EFD4A6DD]

Total time: 82 minutes 42 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any