You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2016/07/21 00:42:52 UTC
[JENKINS] Lucene-Solr-master-Linux (64bit/jdk1.8.0_92) - Build #
17315 - Unstable!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/17315/
Java: 64bit/jdk1.8.0_92 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
2 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.overseer.ZkStateWriterTest
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.overseer.ZkStateWriterTest: 1) Thread[id=378, name=watches-52-thread-1, state=TIMED_WAITING, group=TGRP-ZkStateWriterTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.overseer.ZkStateWriterTest:
1) Thread[id=378, name=watches-52-thread-1, state=TIMED_WAITING, group=TGRP-ZkStateWriterTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([8E642426B76959AA]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.overseer.ZkStateWriterTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=378, name=watches-52-thread-1, state=TIMED_WAITING, group=TGRP-ZkStateWriterTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=378, name=watches-52-thread-1, state=TIMED_WAITING, group=TGRP-ZkStateWriterTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([8E642426B76959AA]:0)
Build Log:
[...truncated 10702 lines...]
[junit4] Suite: org.apache.solr.cloud.overseer.ZkStateWriterTest
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.overseer.ZkStateWriterTest_8E642426B76959AA-001/init-core-data-001
[junit4] 2> 62878 INFO (SUITE-ZkStateWriterTest-seed#[8E642426B76959AA]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 62881 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[8E642426B76959AA]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testSingleExternalCollection
[junit4] 2> 62881 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 62881 INFO (Thread-95) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 62881 INFO (Thread-95) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 62981 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.ZkTestServer start zk server on port:43076
[junit4] 2> 62982 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 62984 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 62986 INFO (zkCallback-45-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@66a2e4e7 name:ZooKeeperConnection Watcher:127.0.0.1:43076 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 62986 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 62986 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 62988 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 62989 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 62990 INFO (zkCallback-46-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4e8ab4cf name:ZooKeeperConnection Watcher:127.0.0.1:43076 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 62990 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 62990 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 62990 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 62994 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 62995 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 62996 INFO (zkCallback-47-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@34b14a8b name:ZooKeeperConnection Watcher:127.0.0.1:43076/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 62996 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 62996 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 62997 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 62998 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections
[junit4] 2> 62998 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 62999 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 62999 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 63000 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 63000 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
[junit4] 2> 63000 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
[junit4] 2> 63001 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
[junit4] 2> 63002 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
[junit4] 2> 63002 INFO (zkCallback-47-thread-1) [ ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
[junit4] 2> 63011 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:43076 43076
[junit4] 2> 63042 INFO (Thread-95) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:43076 43076
[junit4] 2> 63043 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[8E642426B76959AA]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testSingleExternalCollection
[junit4] 2> 63046 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[8E642426B76959AA]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testExternalModificationToStateFormat2
[junit4] 2> 63046 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[8E642426B76959AA]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 63047 INFO (Thread-96) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 63047 INFO (Thread-96) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 63147 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[8E642426B76959AA]) [ ] o.a.s.c.ZkTestServer start zk server on port:46022
[junit4] 2> 63147 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 63148 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 63151 INFO (zkCallback-49-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1ee4197b name:ZooKeeperConnection Watcher:127.0.0.1:46022 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 63151 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 63152 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 63153 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 63154 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 63157 INFO (zkCallback-50-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6ee90c98 name:ZooKeeperConnection Watcher:127.0.0.1:46022 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 63157 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 63157 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 63157 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 63165 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 63166 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 63172 INFO (zkCallback-51-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@57960334 name:ZooKeeperConnection Watcher:127.0.0.1:46022/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 63172 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 63172 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 63173 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 63176 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections
[junit4] 2> 63176 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 63177 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 63177 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 63179 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 63179 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
[junit4] 2> 63179 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
[junit4] 2> 63180 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
[junit4] 2> 63181 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/c2
[junit4] 2> 63181 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[8E642426B76959AA]) [ ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c2/state.json
[junit4] 2> 63182 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ZkStateReader Checking legacy cluster state for collection c2
[junit4] 2> 63182 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ZkStateReader Adding lazily-loaded reference for collection c2
[junit4] 2> 63183 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[8E642426B76959AA]) [ ] o.a.s.c.o.ZkStateWriterTest Cluster state: live nodes:[]collections:{c2=LazyCollectionRef(c2)}
[junit4] 2> 63184 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ZkStateReader Refreshing lazily-loaded state for collection c2
[junit4] 2> 63184 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[8E642426B76959AA]) [ ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/c2/state.json version: 0
[junit4] 2> 63187 ERROR (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[8E642426B76959AA]-EventThread) [ ] o.a.z.ClientCnxn Error while calling watcher
[junit4] 2> java.util.concurrent.RejectedExecutionException: Task org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$8/1767668507@21832d3e rejected from org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@25bcadd6[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 1]
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:214)
[junit4] 2> at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:266)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2> 63189 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[8E642426B76959AA]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46022 46022
[junit4] 2> 63211 INFO (Thread-96) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46022 46022
[junit4] 2> 63212 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[8E642426B76959AA]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testExternalModificationToStateFormat2
[junit4] 2> 63217 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[8E642426B76959AA]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testSingleLegacyCollection
[junit4] 2> 63217 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 63217 INFO (Thread-97) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 63217 INFO (Thread-97) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 63317 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.ZkTestServer start zk server on port:38114
[junit4] 2> 63317 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 63318 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 63328 INFO (zkCallback-53-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@50ad48fa name:ZooKeeperConnection Watcher:127.0.0.1:38114 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 63328 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 63328 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 63341 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 63341 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 63359 INFO (zkCallback-54-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@587355f7 name:ZooKeeperConnection Watcher:127.0.0.1:38114 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 63359 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 63359 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 63359 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 63362 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 63363 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 63365 INFO (zkCallback-55-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3c22ba20 name:ZooKeeperConnection Watcher:127.0.0.1:38114/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 63365 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 63365 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 63366 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 63367 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections
[junit4] 2> 63368 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 63369 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 63370 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 63370 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 63371 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
[junit4] 2> 63371 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
[junit4] 2> 63372 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
[junit4] 2> 63373 INFO (zkCallback-55-thread-1) [ ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
[junit4] 2> 63375 INFO (zkCallback-55-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
[junit4] 2> 64876 WARN (zkCallback-55-thread-2) [ ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /clusterstate.json]
[junit4] 2> 64878 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[8E642426B76959AA]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:38114 38114
[junit4] 2> 64997 INFO (Thread-97) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:38114 38114
[junit4] 2> 64998 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[8E642426B76959AA]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testSingleLegacyCollection
[junit4] 2> 65001 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[8E642426B76959AA]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testZkStateWriterBatching
[junit4] 2> 65001 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[8E642426B76959AA]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 65001 INFO (Thread-98) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 65001 INFO (Thread-98) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 65101 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[8E642426B76959AA]) [ ] o.a.s.c.ZkTestServer start zk server on port:33913
[junit4] 2> 65101 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 65102 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 65105 INFO (zkCallback-57-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6d3f88ac name:ZooKeeperConnection Watcher:127.0.0.1:33913 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 65105 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 65105 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 65106 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 65107 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 65108 INFO (zkCallback-58-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@51d4597b name:ZooKeeperConnection Watcher:127.0.0.1:33913 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 65108 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 65108 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 65108 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 65111 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 65111 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 65112 INFO (zkCallback-59-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@60420c00 name:ZooKeeperConnection Watcher:127.0.0.1:33913/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 65112 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 65112 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 65113 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 65113 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections
[junit4] 2> 65114 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 65115 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 65116 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 65117 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 65117 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
[junit4] 2> 65117 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
[junit4] 2> 65118 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
[junit4] 2> 65118 INFO (zkCallback-59-thread-1) [ ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
[junit4] 2> 65118 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/c2
[junit4] 2> 65119 INFO (zkCallback-59-thread-1) [ ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
[junit4] 2> 65120 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[8E642426B76959AA]) [ ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
[junit4] 2> 65122 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[8E642426B76959AA]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:33913 33913
[junit4] 2> 65132 INFO (Thread-98) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:33913 33913
[junit4] 2> 65133 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[8E642426B76959AA]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testZkStateWriterBatching
[junit4] 2> 65137 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[8E642426B76959AA]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testExternalModificationToSharedClusterState
[junit4] 2> 65168 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[8E642426B76959AA]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 65169 INFO (Thread-99) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 65169 INFO (Thread-99) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 65269 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[8E642426B76959AA]) [ ] o.a.s.c.ZkTestServer start zk server on port:42641
[junit4] 2> 65269 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 65269 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 65272 INFO (zkCallback-61-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2a86105b name:ZooKeeperConnection Watcher:127.0.0.1:42641 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 65272 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 65273 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 65274 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 65274 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 65287 INFO (zkCallback-62-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@58cf37b8 name:ZooKeeperConnection Watcher:127.0.0.1:42641 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 65287 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 65287 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 65288 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 65290 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 65291 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 65292 INFO (zkCallback-63-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@15e0a809 name:ZooKeeperConnection Watcher:127.0.0.1:42641/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 65292 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 65293 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 65293 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 65294 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections
[junit4] 2> 65295 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 65296 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 65297 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 65297 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 65297 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
[junit4] 2> 65298 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
[junit4] 2> 65298 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
[junit4] 2> 65299 INFO (zkCallback-63-thread-1) [ ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
[junit4] 2> 65299 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/c2
[junit4] 2> 65300 INFO (zkCallback-63-thread-1) [ ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
[junit4] 2> 65301 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ZkStateReader Refreshing lazily-loaded state for collection c1
[junit4] 2> 65301 INFO (zkCallback-63-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
[junit4] 2> 65301 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[8E642426B76959AA]) [ ] o.a.s.c.c.ZkStateReader Refreshing lazily-loaded state for collection c2
[junit4] 2> 65302 INFO (zkCallback-63-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
[junit4] 2> 65309 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[8E642426B76959AA]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:42641 42641
[junit4] 2> 65448 INFO (Thread-99) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:42641 42641
[junit4] 2> 65449 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[8E642426B76959AA]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testExternalModificationToSharedClusterState
[junit4] 2> 65450 INFO (SUITE-ZkStateWriterTest-seed#[8E642426B76959AA]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> Jul 21, 2016 12:10:00 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 4 leaked thread(s).
[junit4] 2> Jul 21, 2016 12:10:20 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.cloud.overseer.ZkStateWriterTest:
[junit4] 2> 1) Thread[id=378, name=watches-52-thread-1, state=TIMED_WAITING, group=TGRP-ZkStateWriterTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] 2> at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] 2> at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] 2> at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Jul 21, 2016 12:10:20 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=378, name=watches-52-thread-1, state=TIMED_WAITING, group=TGRP-ZkStateWriterTest]
[junit4] 2> Jul 21, 2016 12:10:23 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> SEVERE: There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=378, name=watches-52-thread-1, state=TIMED_WAITING, group=TGRP-ZkStateWriterTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] 2> at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] 2> at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] 2> at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> NOTE: test params are: codec=FastDecompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=1, maxDocsPerChunk=68, blockSize=292), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=1, blockSize=292)), sim=ClassicSimilarity, locale=no, timezone=Asia/Shanghai
[junit4] 2> NOTE: Linux 4.4.0-31-generic amd64/Oracle Corporation 1.8.0_92 (64-bit)/cpus=12,threads=2,free=331944344,total=508887040
[junit4] 2> NOTE: All tests run in this JVM: [DocValuesTest, HdfsNNFailoverTest, TestBackupRepositoryFactory, TestTrie, MultiTermTest, AnalyticsQueryTest, TestCustomSort, TestSurroundQueryParser, BadCopyFieldTest, TestStressCloudBlindAtomicUpdates, ZkStateWriterTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ZkStateWriterTest -Dtests.seed=8E642426B76959AA -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=no -Dtests.timezone=Asia/Shanghai -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.00s J1 | ZkStateWriterTest (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.overseer.ZkStateWriterTest:
[junit4] > 1) Thread[id=378, name=watches-52-thread-1, state=TIMED_WAITING, group=TGRP-ZkStateWriterTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > at __randomizedtesting.SeedInfo.seed([8E642426B76959AA]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=378, name=watches-52-thread-1, state=TIMED_WAITING, group=TGRP-ZkStateWriterTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > at __randomizedtesting.SeedInfo.seed([8E642426B76959AA]:0)
[junit4] Completed [46/623 (1!)] on J1 in 25.70s, 5 tests, 2 errors <<< FAILURES!
[...truncated 61903 lines...]