You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2016/03/08 03:58:11 UTC

[JENKINS] Lucene-Solr-Tests-6.x - Build # 23 - Failure

Build: https://builds.apache.org/job/Lucene-Solr-Tests-6.x/23/

1 tests failed.
FAILED:  org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy

Error Message:
Could not find collection : c1

Stack Trace:
org.apache.solr.common.SolrException: Could not find collection : c1
	at __randomizedtesting.SeedInfo.seed([B4B08B517EE7D45C:DFFF2B2C07E80966]:0)
	at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:170)
	at org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdate(ZkStateReaderTest.java:135)
	at org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy(ZkStateReaderTest.java:46)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11989 lines...]
   [junit4] Suite: org.apache.solr.cloud.overseer.ZkStateReaderTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.overseer.ZkStateReaderTest_B4B08B517EE7D45C-001/init-core-data-001
   [junit4]   2> 1682060 INFO  (SUITE-ZkStateReaderTest-seed#[B4B08B517EE7D45C]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true)
   [junit4]   2> 1682061 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testStateFormatUpdateWithExplicitRefreshLazy
   [junit4]   2> 1682062 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1682062 INFO  (Thread-5664) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1682062 INFO  (Thread-5664) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1682162 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.ZkTestServer start zk server on port:46806
   [junit4]   2> 1682162 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1682163 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1682165 INFO  (zkCallback-1924-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@28bb19c7 name:ZooKeeperConnection Watcher:127.0.0.1:46806 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1682165 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1682165 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1682166 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1682172 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1682172 INFO  (zkCallback-1925-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@76a11732 name:ZooKeeperConnection Watcher:127.0.0.1:46806 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1682172 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1682172 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1682172 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1682182 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1682183 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1682184 INFO  (zkCallback-1926-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2669971f name:ZooKeeperConnection Watcher:127.0.0.1:46806/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1682184 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1682184 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1682184 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1682185 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1682186 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1682187 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1682187 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1682188 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1682189 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1682189 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 1682191 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 1682193 INFO  (zkCallback-1926-thread-2) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 1682193 WARN  (zkCallback-1926-thread-2) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /collections]
   [junit4]   2> 1682194 ERROR (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B4B08B517EE7D45C]-EventThread) [    ] o.a.z.ClientCnxn Error while calling watcher 
   [junit4]   2> java.util.concurrent.RejectedExecutionException: Task org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$6/1139868387@3a719380 rejected from org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@7f730aaa[Shutting down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 1]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:214)
   [junit4]   2> 	at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:266)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 1682195 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46806 46806
   [junit4]   2> 1682425 INFO  (Thread-5664) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46806 46806
   [junit4]   2> 1682425 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testStateFormatUpdateWithExplicitRefreshLazy
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ZkStateReaderTest -Dtests.method=testStateFormatUpdateWithExplicitRefreshLazy -Dtests.seed=B4B08B517EE7D45C -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=es-VE -Dtests.timezone=America/Rosario -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.37s J0 | ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy <<<
   [junit4]    > Throwable #1: org.apache.solr.common.SolrException: Could not find collection : c1
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([B4B08B517EE7D45C:DFFF2B2C07E80966]:0)
   [junit4]    > 	at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:170)
   [junit4]    > 	at org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdate(ZkStateReaderTest.java:135)
   [junit4]    > 	at org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy(ZkStateReaderTest.java:46)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1682430 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B4B08B517EE7D45C]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testExternalCollectionWatchedNotWatched
   [junit4]   2> 1682430 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1682430 INFO  (Thread-5665) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1682430 INFO  (Thread-5665) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1682530 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.ZkTestServer start zk server on port:38581
   [junit4]   2> 1682530 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1682531 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1682533 INFO  (zkCallback-1927-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@35f7807b name:ZooKeeperConnection Watcher:127.0.0.1:38581 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1682533 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1682533 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1682535 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x153541ecdee0000, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1682535 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1682536 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1682539 INFO  (zkCallback-1928-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@10fe077f name:ZooKeeperConnection Watcher:127.0.0.1:38581 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1682539 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1682539 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1682539 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1682542 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1682543 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1682544 INFO  (zkCallback-1929-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6cc5e702 name:ZooKeeperConnection Watcher:127.0.0.1:38581/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1682544 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1682544 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1682545 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1682546 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1682546 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1682548 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1682549 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1682549 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1682551 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1682551 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 1682552 INFO  (zkCallback-1929-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 1682553 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 1682554 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ZkStateReader addZkWatch [c1]
   [junit4]   2> 1682554 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ZkStateReader Add data for [c1] ver [0]
   [junit4]   2> 1682554 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ZkStateReader Removing watch for uninteresting collection [c1]
   [junit4]   2> 1682555 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:38581 38581
   [junit4]   2> 1682908 INFO  (Thread-5665) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:38581 38581
   [junit4]   2> 1682908 INFO  (TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[B4B08B517EE7D45C]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testExternalCollectionWatchedNotWatched
   [junit4]   2> 1682911 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B4B08B517EE7D45C]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testStateFormatUpdateWithTimeDelay
   [junit4]   2> 1682911 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1682912 INFO  (Thread-5666) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1682912 INFO  (Thread-5666) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1683012 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.ZkTestServer start zk server on port:40868
   [junit4]   2> 1683012 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1683012 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1683014 INFO  (zkCallback-1930-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@517e8247 name:ZooKeeperConnection Watcher:127.0.0.1:40868 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1683014 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1683014 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1683019 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1683019 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1683020 INFO  (zkCallback-1931-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@d2dfc1b name:ZooKeeperConnection Watcher:127.0.0.1:40868 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1683020 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1683020 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1683020 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1683022 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1683023 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1683024 INFO  (zkCallback-1932-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2c86dbc name:ZooKeeperConnection Watcher:127.0.0.1:40868/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1683024 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1683024 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1683024 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1683025 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1683027 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1683028 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1683029 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1683030 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1683031 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1683031 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ZkStateReader addZkWatch [c1]
   [junit4]   2> 1683032 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 1683032 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 1683032 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 1683033 INFO  (zkCallback-1932-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 1683040 INFO  (zkCallback-1932-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 1683041 INFO  (zkCallback-1932-thread-1) [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 1683092 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 1683093 INFO  (zkCallback-1932-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 1683094 INFO  (zkCallback-1932-thread-2) [    ] o.a.s.c.c.ZkStateReader Add data for [c1] ver [0]
   [junit4]   2> 1683145 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:40868 40868
   [junit4]   2> 1683321 INFO  (Thread-5666) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:40868 40868
   [junit4]   2> 1683322 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[B4B08B517EE7D45C]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testStateFormatUpdateWithTimeDelay
   [junit4]   2> 1683324 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B4B08B517EE7D45C]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testStateFormatUpdateWithExplicitRefresh
   [junit4]   2> 1683324 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1683324 INFO  (Thread-5667) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1683325 INFO  (Thread-5667) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1683425 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.ZkTestServer start zk server on port:56716
   [junit4]   2> 1683425 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1683425 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1683427 INFO  (zkCallback-1933-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2005a279 name:ZooKeeperConnection Watcher:127.0.0.1:56716 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1683427 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1683428 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1683428 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1683429 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1683429 INFO  (zkCallback-1934-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6e796537 name:ZooKeeperConnection Watcher:127.0.0.1:56716 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1683429 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1683430 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1683430 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1683432 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1683432 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1683433 INFO  (zkCallback-1935-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6496d971 name:ZooKeeperConnection Watcher:127.0.0.1:56716/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1683433 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1683433 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1683433 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1683435 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1683436 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1683437 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1683438 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1683439 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1683440 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1683440 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ZkStateReader addZkWatch [c1]
   [junit4]   2> 1683440 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 1683441 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 1683441 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 1683442 INFO  (zkCallback-1935-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 1683443 INFO  (zkCallback-1935-thread-1) [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 1683443 INFO  (zkCallback-1935-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 1683444 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 1683445 INFO  (zkCallback-1935-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 1683445 INFO  (zkCallback-1935-thread-2) [    ] o.a.s.c.c.ZkStateReader Add data for [c1] ver [0]
   [junit4]   2> 1683447 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:56716 56716
   [junit4]   2> 1683599 INFO  (Thread-5667) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:56716 56716
   [junit4]   2> 1683600 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[B4B08B517EE7D45C]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testStateFormatUpdateWithExplicitRefresh
   [junit4]   2> 1683602 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testStateFormatUpdateWithTimeDelayLazy
   [junit4]   2> 1683603 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1683603 INFO  (Thread-5668) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1683603 INFO  (Thread-5668) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1683703 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.ZkTestServer start zk server on port:37181
   [junit4]   2> 1683703 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1683704 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1683706 INFO  (zkCallback-1936-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1d4f19ad name:ZooKeeperConnection Watcher:127.0.0.1:37181 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1683706 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1683706 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1683707 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1683707 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1683708 INFO  (zkCallback-1937-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7a8b95bb name:ZooKeeperConnection Watcher:127.0.0.1:37181 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1683708 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1683708 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1683708 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1683711 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1683711 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1683712 INFO  (zkCallback-1938-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@50bf8de6 name:ZooKeeperConnection Watcher:127.0.0.1:37181/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1683712 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1683712 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1683712 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1683713 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1683714 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1683715 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1683716 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1683717 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1683718 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1683719 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 1683719 INFO  (zkCallback-1938-thread-1) [    ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 1683720 INFO  (zkCallback-1938-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 1683721 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 1683722 INFO  (zkCallback-1938-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
   [junit4]   2> 1683723 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:37181 37181
   [junit4]   2> 1684028 INFO  (Thread-5668) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:37181 37181
   [junit4]   2> 1684029 INFO  (TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[B4B08B517EE7D45C]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testStateFormatUpdateWithTimeDelayLazy
   [junit4]   2> 1684030 INFO  (SUITE-ZkStateReaderTest-seed#[B4B08B517EE7D45C]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.overseer.ZkStateReaderTest_B4B08B517EE7D45C-001
   [junit4]   2> Mar 08, 2016 2:46:59 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene60): {}, docValues:{}, maxPointsInLeafNode=862, maxMBSortInHeap=5.511216995087956, sim=RandomSimilarity(queryNorm=false,coord=crazy): {}, locale=es-VE, timezone=America/Rosario
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=1,free=192072296,total=517996544
   [junit4]   2> NOTE: All tests run in this JVM: [QueryEqualityTest, OutOfBoxZkACLAndCredentialsProvidersTest, TestConfigSetImmutable, CopyFieldTest, HdfsBasicDistributedZk2Test, DistributedFacetPivotLargeTest, BasicDistributedZkTest, SharedFSAutoReplicaFailoverUtilsTest, BasicZkTest, DeleteReplicaTest, TestSearcherReuse, TestReplicaProperties, TestReplicationHandler, DataDrivenBlockJoinTest, JSONWriterTest, TestSolrQueryParserDefaultOperatorResource, TestManagedResource, TestClusterStateMutator, TestReRankQParserPlugin, TestFunctionQuery, CloudExitableDirectoryReaderTest, TestCryptoKeys, TestHighlightDedupGrouping, TestBlendedInfixSuggestions, TestLMDirichletSimilarityFactory, TestMinMaxOnMultiValuedField, TestExactSharedStatsCache, BJQParserTest, SmileWriterTest, TestRealTimeGet, HdfsChaosMonkeySafeLeaderTest, UUIDFieldTest, RecoveryAfterSoftCommitTest, LeaderElectionIntegrationTest, TestChildDocTransformer, TestRandomDVFaceting, SolrXmlInZkTest, BasicAuthIntegrationTest, PingRequestHandlerTest, SaslZkACLProviderTest, DateFieldTest, TestArbitraryIndexDir, TestFieldTypeResource, SynonymTokenizerTest, DocumentAnalysisRequestHandlerTest, HttpPartitionTest, DistributedQueueTest, TestTrieFacet, TestSolr4Spatial, CollectionTooManyReplicasTest, DistributedSpellCheckComponentTest, TestConfig, DistributedFacetPivotSmallTest, TestDocSet, FileBasedSpellCheckerTest, TestPseudoReturnFields, DistributedQueryElevationComponentTest, SystemInfoHandlerTest, TestTrackingShardHandlerFactory, AddBlockUpdateTest, RequiredFieldsTest, TestSchemaSimilarityResource, SpatialHeatmapFacetsTest, ActionThrottleTest, TestRestoreCore, TestLazyCores, ResponseLogComponentTest, AtomicUpdatesTest, CurrencyFieldOpenExchangeTest, SolrRequestParserTest, SegmentsInfoRequestHandlerTest, TestRandomFaceting, StandardRequestHandlerTest, TestCloudManagedSchema, TestDistributedSearch, BlockJoinFacetSimpleTest, TestShortCircuitedRequests, TestInitParams, TestHashQParserPlugin, TestAtomicUpdateErrorCases, RestartWhileUpdatingTest, TestShardHandlerFactory, CursorPagingTest, TestCloudInspectUtil, PolyFieldTest, TestMiniSolrCloudCluster, RAMDirectoryFactoryTest, TestNonDefinedSimilarityFactory, TlogReplayBufferedWhileIndexingTest, HdfsRecoverLeaseTest, TestSolr4Spatial2, TestMergePolicyConfig, TestTestInjection, TestZkChroot, TestFaceting, TestStressReorder, TestJoin, HardAutoCommitTest, TestGroupingSearch, QueryElevationComponentTest, TestSort, TestIndexSearcher, SolrIndexSplitterTest, SimplePostToolTest, TestCoreDiscovery, SpellCheckCollatorTest, TestStressLucene, NoCacheHeaderTest, SolrCoreCheckLockOnStartupTest, TestUpdate, DirectUpdateHandlerOptimizeTest, TestRemoteStreaming, DocValuesMultiTest, DistanceFunctionTest, SolrInfoMBeanTest, DebugComponentTest, IndexBasedSpellCheckerTest, LukeRequestHandlerTest, PrimitiveFieldTypeTest, TestOmitPositions, RequestHandlersTest, PathHierarchyTokenizerFactoryTest, TestSolrQueryParser, SolrPluginUtilsTest, TestJmxIntegration, UpdateRequestProcessorFactoryTest, TestCSVResponseWriter, TestAnalyzedSuggestions, TestPHPSerializedResponseWriter, TestComponentsName, HighlighterConfigTest, AlternateDirectoryTest, TestSolrIndexConfig, TestBinaryField, TestElisionMultitermQuery, TestFuzzyAnalyzedSuggestions, ExternalFileFieldSortTest, DirectSolrConnectionTest, TestPhraseSuggestions, EchoParamsTest, TestPerFieldSimilarity, TestIBSimilarityFactory, TimeZoneUtilsTest, TestFastOutputStream, OpenExchangeRatesOrgProviderTest, TestFastLRUCache, PreAnalyzedFieldTest, PrimUtilsTest, ClusterStateTest, TestLRUCache, ZkNodePropsTest, FileUtilsTest, TestRTGBase, TestCrossCoreJoin, TestCursorMarkWithoutUniqueKey, TestDistributedMissingSort, TestSimpleTrackingShardHandler, TestEmbeddedSolrServerConstructors, AliasIntegrationTest, CollectionsAPISolrJTest, ConcurrentDeleteAndCreateCollectionTest, ConfigSetsAPITest, DeleteShardTest, DistribCursorPagingTest, LeaderInitiatedRecoveryOnCommitTest, OverseerStatusTest, TestCloudPivotFacet, TestMiniSolrCloudClusterSSL, TestRequestStatusCollectionAPI, HdfsUnloadDistributedZkTest, HdfsWriteToMultipleCollectionsTest, ZkStateReaderTest]
   [junit4] Completed [465/579 (1!)] on J0 in 2.23s, 5 tests, 1 error <<< FAILURES!

[...truncated 358 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/build.xml:740: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/build.xml:684: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/common-build.xml:524: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/lucene/common-build.xml:1457: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/lucene/common-build.xml:1014: There were test failures: 579 suites (10 ignored), 2309 tests, 1 error, 88 ignored (71 assumptions) [seed: B4B08B517EE7D45C]

Total time: 56 minutes 35 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any