You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2016/07/21 06:09:36 UTC
[JENKINS] Lucene-Solr-master-Solaris (64bit/jdk1.8.0) - Build # 731
- Unstable!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-master-Solaris/731/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseParallelGC
2 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.overseer.ZkStateWriterTest
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.overseer.ZkStateWriterTest: 1) Thread[id=2318, name=watches-260-thread-1, state=TIMED_WAITING, group=TGRP-ZkStateWriterTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.overseer.ZkStateWriterTest:
1) Thread[id=2318, name=watches-260-thread-1, state=TIMED_WAITING, group=TGRP-ZkStateWriterTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([6B1D1A70FDC4548B]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.overseer.ZkStateWriterTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=2318, name=watches-260-thread-1, state=TIMED_WAITING, group=TGRP-ZkStateWriterTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=2318, name=watches-260-thread-1, state=TIMED_WAITING, group=TGRP-ZkStateWriterTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([6B1D1A70FDC4548B]:0)
Build Log:
[...truncated 10701 lines...]
[junit4] Suite: org.apache.solr.cloud.overseer.ZkStateWriterTest
[junit4] 2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.overseer.ZkStateWriterTest_6B1D1A70FDC4548B-001/init-core-data-001
[junit4] 2> 252188 INFO (SUITE-ZkStateWriterTest-seed#[6B1D1A70FDC4548B]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 252195 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testZkStateWriterBatching
[junit4] 2> 252195 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 252199 INFO (Thread-847) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 252199 INFO (Thread-847) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 252297 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.ZkTestServer start zk server on port:60980
[junit4] 2> 252297 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 252298 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 252302 INFO (zkCallback-253-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@57295473 name:ZooKeeperConnection Watcher:127.0.0.1:60980 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 252302 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 252302 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 252305 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 252306 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 252312 INFO (zkCallback-254-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7d083ed7 name:ZooKeeperConnection Watcher:127.0.0.1:60980 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 252312 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 252312 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 252312 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 252336 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 252336 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 252350 INFO (zkCallback-255-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@56e88f35 name:ZooKeeperConnection Watcher:127.0.0.1:60980/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 252351 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 252352 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 252356 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 252363 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections
[junit4] 2> 252367 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 252378 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 252395 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 252396 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 252397 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
[junit4] 2> 252398 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
[junit4] 2> 252400 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
[junit4] 2> 252401 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/c2
[junit4] 2> 252402 INFO (zkCallback-255-thread-1) [ ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
[junit4] 2> 252405 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
[junit4] 2> 252408 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:60980 60980
[junit4] 2> 252434 INFO (Thread-847) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:60980 60980
[junit4] 2> 252435 INFO (TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testZkStateWriterBatching
[junit4] 2> 252441 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testExternalModificationToStateFormat2
[junit4] 2> 252442 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 252442 INFO (Thread-848) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 252442 INFO (Thread-848) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 252542 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.ZkTestServer start zk server on port:33922
[junit4] 2> 252542 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 252543 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 252546 INFO (zkCallback-257-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6df416fb name:ZooKeeperConnection Watcher:127.0.0.1:33922 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 252546 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 252546 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 252548 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 252548 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 252562 INFO (zkCallback-258-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@74c8493e name:ZooKeeperConnection Watcher:127.0.0.1:33922 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 252563 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 252563 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 252563 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 252567 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 252567 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 252570 INFO (zkCallback-259-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3c1c312f name:ZooKeeperConnection Watcher:127.0.0.1:33922/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 252570 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 252570 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 252571 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 252572 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections
[junit4] 2> 252574 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 252575 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 252576 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 252577 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 252578 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
[junit4] 2> 252578 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
[junit4] 2> 252579 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
[junit4] 2> 252581 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/c2
[junit4] 2> 252582 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c2/state.json
[junit4] 2> 252584 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ZkStateReader Checking legacy cluster state for collection c2
[junit4] 2> 252584 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ZkStateReader Adding lazily-loaded reference for collection c2
[junit4] 2> 252585 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.o.ZkStateWriterTest Cluster state: live nodes:[]collections:{c2=LazyCollectionRef(c2)}
[junit4] 2> 252585 INFO (zkCallback-259-thread-1) [ ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
[junit4] 2> 252586 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ZkStateReader Refreshing lazily-loaded state for collection c2
[junit4] 2> 252587 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/c2/state.json version: 0
[junit4] 2> 252590 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:33922 33922
[junit4] 2> 252644 INFO (Thread-848) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:33922 33922
[junit4] 2> 252644 INFO (TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testExternalModificationToStateFormat2
[junit4] 2> 252650 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testExternalModificationToSharedClusterState
[junit4] 2> 252650 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 252650 INFO (Thread-849) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 252650 INFO (Thread-849) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 252750 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.ZkTestServer start zk server on port:65177
[junit4] 2> 252750 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 252751 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 252755 INFO (zkCallback-261-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@38583d57 name:ZooKeeperConnection Watcher:127.0.0.1:65177 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 252755 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 252755 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 252758 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 252758 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 252760 INFO (zkCallback-262-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@8405e68 name:ZooKeeperConnection Watcher:127.0.0.1:65177 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 252760 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 252761 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 252761 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 252766 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 252767 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 252769 INFO (zkCallback-263-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@391ab46 name:ZooKeeperConnection Watcher:127.0.0.1:65177/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 252770 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 252770 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 252770 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 252772 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections
[junit4] 2> 252775 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 252777 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 252779 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 252780 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 252781 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
[junit4] 2> 252782 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
[junit4] 2> 252783 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
[junit4] 2> 252785 INFO (zkCallback-263-thread-1) [ ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
[junit4] 2> 252786 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/c2
[junit4] 2> 252790 INFO (zkCallback-263-thread-1) [ ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
[junit4] 2> 252790 INFO (zkCallback-263-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
[junit4] 2> 252790 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ZkStateReader Refreshing lazily-loaded state for collection c1
[junit4] 2> 252791 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ZkStateReader Refreshing lazily-loaded state for collection c2
[junit4] 2> 252794 INFO (zkCallback-263-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
[junit4] 2> 252802 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:65177 65177
[junit4] 2> 252961 INFO (Thread-849) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:65177 65177
[junit4] 2> 252962 INFO (TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testExternalModificationToSharedClusterState
[junit4] 2> 252965 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testSingleExternalCollection
[junit4] 2> 252965 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 252968 INFO (Thread-850) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 252968 INFO (Thread-850) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 253065 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.ZkTestServer start zk server on port:59068
[junit4] 2> 253066 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 253067 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 253075 INFO (zkCallback-265-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@637e8c38 name:ZooKeeperConnection Watcher:127.0.0.1:59068 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 253075 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 253075 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 253078 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 253079 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 253081 INFO (zkCallback-266-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1a67ead1 name:ZooKeeperConnection Watcher:127.0.0.1:59068 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 253081 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 253082 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 253082 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 253088 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 253088 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 253090 INFO (zkCallback-267-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@228f5a0f name:ZooKeeperConnection Watcher:127.0.0.1:59068/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 253090 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 253090 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 253091 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 253094 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections
[junit4] 2> 253097 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 253099 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 253102 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 253103 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 253105 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
[junit4] 2> 253106 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
[junit4] 2> 253108 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
[junit4] 2> 253109 INFO (zkCallback-267-thread-1) [ ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
[junit4] 2> 253111 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
[junit4] 2> 253115 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:59068 59068
[junit4] 2> 253279 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxnFactory Ignoring exception
[junit4] 2> java.nio.channels.ClosedChannelException
[junit4] 2> at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:235)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:188)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 253280 INFO (Thread-850) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:59068 59068
[junit4] 2> 253284 INFO (TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testSingleExternalCollection
[junit4] 2> 253300 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testSingleLegacyCollection
[junit4] 2> 253300 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 253300 INFO (Thread-851) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 253301 INFO (Thread-851) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 253401 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.ZkTestServer start zk server on port:57194
[junit4] 2> 253401 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 253402 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 253415 INFO (zkCallback-269-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7705910f name:ZooKeeperConnection Watcher:127.0.0.1:57194 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 253415 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 253415 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 253417 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 253417 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 253419 INFO (zkCallback-270-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@60d76391 name:ZooKeeperConnection Watcher:127.0.0.1:57194 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 253419 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 253419 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 253420 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 253460 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 253461 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 253463 INFO (zkCallback-271-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1a9fd899 name:ZooKeeperConnection Watcher:127.0.0.1:57194/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 253463 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 253464 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 253467 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 253469 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections
[junit4] 2> 253470 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 253471 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 253473 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 253474 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 253474 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
[junit4] 2> 253475 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
[junit4] 2> 253477 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
[junit4] 2> 253481 INFO (zkCallback-271-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [0])
[junit4] 2> 253482 INFO (zkCallback-271-thread-1) [ ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
[junit4] 2> 253504 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:57194 57194
[junit4] 2> 253531 INFO (Thread-851) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:57194 57194
[junit4] 2> 253539 INFO (TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B1D1A70FDC4548B]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testSingleLegacyCollection
[junit4] 2> 253550 INFO (SUITE-ZkStateWriterTest-seed#[6B1D1A70FDC4548B]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> Jul 21, 2016 5:33:02 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 3 leaked thread(s).
[junit4] 2> Jul 21, 2016 5:33:22 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.cloud.overseer.ZkStateWriterTest:
[junit4] 2> 1) Thread[id=2318, name=watches-260-thread-1, state=TIMED_WAITING, group=TGRP-ZkStateWriterTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] 2> at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] 2> at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] 2> at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Jul 21, 2016 5:33:22 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=2318, name=watches-260-thread-1, state=TIMED_WAITING, group=TGRP-ZkStateWriterTest]
[junit4] 2> Jul 21, 2016 5:33:25 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> SEVERE: There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=2318, name=watches-260-thread-1, state=TIMED_WAITING, group=TGRP-ZkStateWriterTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] 2> at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] 2> at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] 2> at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {}, docValues:{}, maxPointsInLeafNode=287, maxMBSortInHeap=5.5570017240602585, sim=RandomSimilarity(queryNorm=false): {}, locale=es-DO, timezone=Europe/Ljubljana
[junit4] 2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_92 (64-bit)/cpus=3,threads=2,free=36509280,total=291504128
[junit4] 2> NOTE: All tests run in this JVM: [ParsingFieldUpdateProcessorsTest, DistributedExpandComponentTest, ChaosMonkeyNothingIsSafeTest, TestJmxIntegration, TestTolerantUpdateProcessorCloud, TestLockTree, TestReplicationHandler, BlockDirectoryTest, TestClusterStateMutator, TestHighFrequencyDictionaryFactory, DistributedFacetPivotLongTailTest, RegexBoostProcessorTest, TestHighlightDedupGrouping, HdfsNNFailoverTest, TestIBSimilarityFactory, ZkStateWriterTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ZkStateWriterTest -Dtests.seed=6B1D1A70FDC4548B -Dtests.slow=true -Dtests.locale=es-DO -Dtests.timezone=Europe/Ljubljana -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J0 | ZkStateWriterTest (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.overseer.ZkStateWriterTest:
[junit4] > 1) Thread[id=2318, name=watches-260-thread-1, state=TIMED_WAITING, group=TGRP-ZkStateWriterTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > at __randomizedtesting.SeedInfo.seed([6B1D1A70FDC4548B]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=2318, name=watches-260-thread-1, state=TIMED_WAITING, group=TGRP-ZkStateWriterTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > at __randomizedtesting.SeedInfo.seed([6B1D1A70FDC4548B]:0)
[junit4] Completed [55/623 (1!)] on J0 in 24.43s, 5 tests, 2 errors <<< FAILURES!
[...truncated 61864 lines...]
[JENKINS] Lucene-Solr-master-Solaris (64bit/jdk1.8.0) - Build # 734
- Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-master-Solaris/734/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseParallelGC
1 tests failed.
FAILED: org.apache.solr.cloud.ForceLeaderTest.testReplicasInLIRNoLeader
Error Message:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:57096/_/o/forceleader_test_collection_shard1_replica3]
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:57096/_/o/forceleader_test_collection_shard1_replica3]
at __randomizedtesting.SeedInfo.seed([23D48EF620D55667:C543BA361957AF06]:0)
at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:753)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1151)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:1040)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:976)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.sendDocsWithRetry(AbstractFullDistribZkTestBase.java:753)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.sendDocsWithRetry(AbstractFullDistribZkTestBase.java:741)
at org.apache.solr.cloud.ForceLeaderTest.sendDoc(ForceLeaderTest.java:424)
at org.apache.solr.cloud.ForceLeaderTest.assertSendDocFails(ForceLeaderTest.java:315)
at org.apache.solr.cloud.ForceLeaderTest.testReplicasInLIRNoLeader(ForceLeaderTest.java:110)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:985)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:960)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:57096/_/o/forceleader_test_collection_shard1_replica3]
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:393)
at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:747)
... 49 more
Caused by: org.apache.solr.client.solrj.SolrServerException: Server refused connection at: http://127.0.0.1:57096/_/o/forceleader_test_collection_shard1_replica3
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:613)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:259)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:382)
... 50 more
Caused by: org.apache.http.conn.HttpHostConnectException: Connect to 127.0.0.1:57096 [/127.0.0.1] failed: Connection refused
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:353)
at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:380)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:511)
... 54 more
Caused by: java.net.ConnectException: Connection refused
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:589)
at org.apache.http.conn.socket.PlainConnectionSocketFactory.connectSocket(PlainConnectionSocketFactory.java:74)
at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:134)
... 64 more
Build Log:
[...truncated 11038 lines...]
[junit4] Suite: org.apache.solr.cloud.ForceLeaderTest
[junit4] 2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001/init-core-data-001
[junit4] 2> 975111 INFO (SUITE-ForceLeaderTest-seed#[23D48EF620D55667]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
[junit4] 2> 975111 INFO (SUITE-ForceLeaderTest-seed#[23D48EF620D55667]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /_/o
[junit4] 2> 975113 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 975113 INFO (Thread-1776) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 975113 INFO (Thread-1776) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 975213 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.ZkTestServer start zk server on port:52486
[junit4] 2> 975214 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 975214 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 975217 INFO (zkCallback-1030-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1913e9a name:ZooKeeperConnection Watcher:127.0.0.1:52486 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 975217 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 975217 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 975217 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr
[junit4] 2> 975221 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 975221 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 975223 INFO (zkCallback-1031-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6a32c0c5 name:ZooKeeperConnection Watcher:127.0.0.1:52486/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 975223 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 975223 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 975223 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
[junit4] 2> 975225 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
[junit4] 2> 975227 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
[junit4] 2> 975229 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
[junit4] 2> 975231 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 975231 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 975234 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 975235 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
[junit4] 2> 975238 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 975238 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 975241 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 975241 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
[junit4] 2> 975244 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 975244 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
[junit4] 2> 975247 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 975247 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
[junit4] 2> 975250 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 975250 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 975253 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 975253 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 975256 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 975257 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 975260 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 975260 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 975263 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.AbstractZkTestCase put /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 975263 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
[junit4] 2> 975266 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15616b529d60001, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 975957 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001/control-001/cores/collection1
[junit4] 2> 975959 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 975983 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@517bd747{/_/o,null,AVAILABLE}
[junit4] 2> 976030 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.e.j.s.ServerConnector Started ServerConnector@3115e7e7{HTTP/1.1,[http/1.1]}{127.0.0.1:40951}
[junit4] 2> 976030 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.e.j.s.Server Started @981159ms
[junit4] 2> 976030 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001/tempDir-001/control/data, hostContext=/_/o, hostPort=56077, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001/control-001/cores}
[junit4] 2> 976030 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@6d06d69c
[junit4] 2> 976030 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001/control-001'
[junit4] 2> 976030 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 976030 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 976030 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 976057 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 976071 INFO (zkCallback-1032-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@767a9d40 name:ZooKeeperConnection Watcher:127.0.0.1:52486/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 976072 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 976072 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 976081 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 976081 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001/control-001/solr.xml
[junit4] 2> 976086 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001/control-001/cores
[junit4] 2> 976086 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.CoreContainer New CoreContainer 1041484457
[junit4] 2> 976086 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001/control-001]
[junit4] 2> 976086 WARN (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.CoreContainer Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001/control-001/lib to classpath: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001/control-001/lib
[junit4] 2> 976086 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,
[junit4] 2> 976088 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.u.UpdateShardHandler Created UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&maxConnections=100000&maxConnectionsPerHost=100000
[junit4] 2> 976088 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 976088 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 976088 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:52486/solr
[junit4] 2> 976088 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 976089 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 976090 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 976123 INFO (zkCallback-1035-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@c98735f name:ZooKeeperConnection Watcher:127.0.0.1:52486 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 976125 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 976126 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 976130 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$$Lambda$9/1490217453@6f65cf90
[junit4] 2> 976131 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 976143 INFO (zkCallback-1036-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3c8e0875 name:ZooKeeperConnection Watcher:127.0.0.1:52486/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 976143 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 976146 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 976150 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 976157 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 976160 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 976164 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 976167 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 976169 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 976170 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 976172 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 976174 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 976176 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
[junit4] 2> 976177 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
[junit4] 2> 976183 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 976185 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 976186 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 976187 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/96289409381826564-127.0.0.1:56077__%2Fo-n_0000000000
[junit4] 2> 976187 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:56077__%2Fo
[junit4] 2> 976187 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 976188 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.Overseer Overseer (id=96289409381826564-127.0.0.1:56077__%2Fo-n_0000000000) starting
[junit4] 2> 976191 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 976200 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 976205 INFO (OverseerCollectionConfigSetProcessor-96289409381826564-127.0.0.1:56077__%2Fo-n_0000000000) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 976207 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56077__%2Fo
[junit4] 2> 976207 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:56077__%2Fo
[junit4] 2> 976208 INFO (OverseerStateUpdate-96289409381826564-127.0.0.1:56077__%2Fo-n_0000000000) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 976209 INFO (zkCallback-1036-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
[junit4] 2> 976210 INFO (zkCallback-1036-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 976213 INFO (OverseerStateUpdate-96289409381826564-127.0.0.1:56077__%2Fo-n_0000000000) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1)
[junit4] 2> 976227 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 976227 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 976228 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001/control-001/cores
[junit4] 2> 976229 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=control_collection, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 976229 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.CorePropertiesLocator Found core collection1 in /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001/control-001/cores/collection1
[junit4] 2> 976229 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
[junit4] 2> 976244 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:56077__%2Fo ] o.a.s.s.SolrDispatchFilter user.dir=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1
[junit4] 2> 976245 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:56077__%2Fo ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 976245 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 976245 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 976247 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection x:collection1] o.a.s.c.ZkController Collection control_collection not visible yet, but flagging it so a watch is registered when it becomes visible
[junit4] 2> 976248 INFO (OverseerStateUpdate-96289409381826564-127.0.0.1:56077__%2Fo-n_0000000000) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:56077/_/o",
[junit4] 2> "node_name":"127.0.0.1:56077__%2Fo",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 976249 INFO (OverseerStateUpdate-96289409381826564-127.0.0.1:56077__%2Fo-n_0000000000) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:56077/_/o",
[junit4] 2> "node_name":"127.0.0.1:56077__%2Fo",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 976249 INFO (OverseerStateUpdate-96289409381826564-127.0.0.1:56077__%2Fo-n_0000000000) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
[junit4] 2> 976249 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Deleting data for [control_collection]
[junit4] 2> 976250 INFO (OverseerStateUpdate-96289409381826564-127.0.0.1:56077__%2Fo-n_0000000000) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
[junit4] 2> 976251 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 976252 INFO (zkCallback-1036-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
[junit4] 2> 977252 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
[junit4] 2> 977253 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
[junit4] 2> 977253 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 977253 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
[junit4] 2> 977254 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
[junit4] 2> 977254 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001/control-001/cores/collection1'
[junit4] 2> 977254 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 977254 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 977256 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 977287 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 977290 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
[junit4] 2> 977297 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
[junit4] 2> 977302 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 977386 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 977391 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 977392 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 977401 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 977404 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
[junit4] 2> 977406 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 977407 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 977409 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1
[junit4] 2> 977409 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 977409 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 977409 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001/control-001/cores/collection1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001/control-001/cores/collection1/data/]
[junit4] 2> 977409 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@44db2f15
[junit4] 2> 977410 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001/control-001/cores/collection1/data
[junit4] 2> 977410 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001/control-001/cores/collection1/data/index/
[junit4] 2> 977410 WARN (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 977410 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001/control-001/cores/collection1/data/index
[junit4] 2> 977410 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=49, maxMergeAtOnceExplicit=47, maxMergedSegmentMB=65.091796875, floorSegmentMB=0.2705078125, forceMergeDeletesPctAllowed=19.179996108769625, segmentsPerTier=17.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 977411 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@4487150b lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@326c05a),segFN=segments_1,generation=1}
[junit4] 2> 977411 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 977413 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001/control-001/cores/collection1/data/
[junit4] 2> 977413 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 977415 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 977415 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
[junit4] 2> 977415 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 977415 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 977415 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 977415 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 977416 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 977416 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 977416 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 977416 WARN (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
[junit4] 2> 977417 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 977418 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 977419 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 977420 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 977423 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/json/docs,/admin/luke,/export,/get,/admin/properties,/update/json,/admin/threads,/dump,/update/csv,/sql,/graph,/admin/segments,/admin/system,/replication,/config,/stream,/schema,/admin/plugins,/admin/logging,/admin/ping,/update,/admin/file,/terms
[junit4] 2> 977424 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 977424 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 977424 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 977425 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 977425 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 977425 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=65.3603515625, floorSegmentMB=2.197265625, forceMergeDeletesPctAllowed=9.544127638623808, segmentsPerTier=39.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 977425 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@4487150b lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@326c05a),segFN=segments_1,generation=1}
[junit4] 2> 977425 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 977425 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@5cd65e42[collection1] main]
[junit4] 2> 977425 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
[junit4] 2> 977426 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
[junit4] 2> 977426 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 977426 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 977426 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 977427 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 977427 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 977427 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 977427 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 977427 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 977428 INFO (searcherExecutor-3137-thread-1-processing-n:127.0.0.1:56077__%2Fo x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@5cd65e42[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 977428 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 977428 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 977428 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 977428 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1540630552534581248
[junit4] 2> 977430 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 1.0ms to seed version buckets with highest version 1540630552534581248
[junit4] 2> 977430 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
[junit4] 2> 977430 INFO (coreLoadExecutor-3136-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
[junit4] 2> 977432 INFO (coreZkRegister-3130-thread-1-processing-n:127.0.0.1:56077__%2Fo x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:56077/_/o collection:control_collection shard:shard1
[junit4] 2> 977433 INFO (coreZkRegister-3130-thread-1-processing-n:127.0.0.1:56077__%2Fo x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 977443 INFO (coreZkRegister-3130-thread-1-processing-n:127.0.0.1:56077__%2Fo x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/96289409381826564-core_node1-n_0000000000
[junit4] 2> 977444 INFO (coreZkRegister-3130-thread-1-processing-n:127.0.0.1:56077__%2Fo x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 and weAreReplacement=false and leaderVoteWait=10000
[junit4] 2> 977446 INFO (coreZkRegister-3130-thread-1-processing-n:127.0.0.1:56077__%2Fo x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 977446 INFO (coreZkRegister-3130-thread-1-processing-n:127.0.0.1:56077__%2Fo x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 977446 INFO (coreZkRegister-3130-thread-1-processing-n:127.0.0.1:56077__%2Fo x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:56077/_/o/collection1/
[junit4] 2> 977446 INFO (OverseerStateUpdate-96289409381826564-127.0.0.1:56077__%2Fo-n_0000000000) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 977446 INFO (coreZkRegister-3130-thread-1-processing-n:127.0.0.1:56077__%2Fo x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 977446 INFO (coreZkRegister-3130-thread-1-processing-n:127.0.0.1:56077__%2Fo x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:56077/_/o/collection1/ has no replicas
[junit4] 2> 977447 INFO (coreZkRegister-3130-thread-1-processing-n:127.0.0.1:56077__%2Fo x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 977450 INFO (coreZkRegister-3130-thread-1-processing-n:127.0.0.1:56077__%2Fo x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/control_collection/leaders/shard1/leader after winning as /collections/control_collection/leader_elect/shard1/election/96289409381826564-core_node1-n_0000000000
[junit4] 2> 977452 INFO (coreZkRegister-3130-thread-1-processing-n:127.0.0.1:56077__%2Fo x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:56077/_/o/collection1/ shard1
[junit4] 2> 977453 INFO (OverseerStateUpdate-96289409381826564-127.0.0.1:56077__%2Fo-n_0000000000) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:56077/_/o",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 977557 INFO (zkCallback-1036-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
[junit4] 2> 977604 INFO (coreZkRegister-3130-thread-1-processing-n:127.0.0.1:56077__%2Fo x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:56077/_/o/collection1/ and leader is http://127.0.0.1:56077/_/o/collection1/
[junit4] 2> 977604 INFO (coreZkRegister-3130-thread-1-processing-n:127.0.0.1:56077__%2Fo x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56077/_/o
[junit4] 2> 977604 INFO (coreZkRegister-3130-thread-1-processing-n:127.0.0.1:56077__%2Fo x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 977604 INFO (coreZkRegister-3130-thread-1-processing-n:127.0.0.1:56077__%2Fo x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 977604 INFO (coreZkRegister-3130-thread-1-processing-n:127.0.0.1:56077__%2Fo x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 977605 INFO (coreZkRegister-3130-thread-1-processing-n:127.0.0.1:56077__%2Fo x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:56077__%2Fo c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Checking legacy cluster state for collection control_collection
[junit4] 2> 977607 INFO (OverseerStateUpdate-96289409381826564-127.0.0.1:56077__%2Fo-n_0000000000) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:56077/_/o",
[junit4] 2> "node_name":"127.0.0.1:56077__%2Fo",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 977607 INFO (OverseerStateUpdate-96289409381826564-127.0.0.1:56077__%2Fo-n_0000000000) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:56077/_/o",
[junit4] 2> "node_name":"127.0.0.1:56077__%2Fo",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 977709 INFO (zkCallback-1036-thread-3-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
[junit4] 2> 977767 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 977767 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 977772 INFO (zkCallback-1040-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@22beb3f8 name:ZooKeeperConnection Watcher:127.0.0.1:52486/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 977772 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 977772 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 977772 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 977774 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
[junit4] 2> 977775 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 977778 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 977778 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
[junit4] 2> 977778 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 977779 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 977782 INFO (zkCallback-1041-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3ae3c3d7 name:ZooKeeperConnection Watcher:127.0.0.1:52486/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 977783 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 977783 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 977800 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15616b529d60006, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 977801 INFO (OverseerStateUpdate-96289409381826564-127.0.0.1:56077__%2Fo-n_0000000000) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"create",
[junit4] 2> "name":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "stateFormat":"2"} current state version: 3
[junit4] 2> 977801 INFO (OverseerStateUpdate-96289409381826564-127.0.0.1:56077__%2Fo-n_0000000000) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
[junit4] 2> 977904 INFO (OverseerStateUpdate-96289409381826564-127.0.0.1:56077__%2Fo-n_0000000000) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
[junit4] 2> 978228 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001/shard-1-001/cores/collection1
[junit4] 2> 978229 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001/shard-1-001
[junit4] 2> 978229 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 978233 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7f73b058{/_/o,null,AVAILABLE}
[junit4] 2> 978244 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.e.j.s.ServerConnector Started ServerConnector@8cc79b8{HTTP/1.1,[http/1.1]}{127.0.0.1:36204}
[junit4] 2> 978244 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.e.j.s.Server Started @983375ms
[junit4] 2> 978244 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/_/o, hostPort=57096, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001/shard-1-001/cores}
[junit4] 2> 978245 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@6d06d69c
[junit4] 2> 978245 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001/shard-1-001'
[junit4] 2> 978245 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 978245 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 978247 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 978248 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 978254 INFO (zkCallback-1042-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5dee3018 name:ZooKeeperConnection Watcher:127.0.0.1:52486/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 978254 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 978255 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 978395 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 978395 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001/shard-1-001/solr.xml
[junit4] 2> 978402 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001/shard-1-001/cores
[junit4] 2> 978402 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.CoreContainer New CoreContainer 898072580
[junit4] 2> 978402 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001/shard-1-001]
[junit4] 2> 978402 WARN (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.CoreContainer Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001/shard-1-001/lib to classpath: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001/shard-1-001/lib
[junit4] 2> 978403 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,
[junit4] 2> 978406 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.u.UpdateShardHandler Created UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&maxConnections=100000&maxConnectionsPerHost=100000
[junit4] 2> 978406 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 978406 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 978406 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:52486/solr
[junit4] 2> 978406 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 978406 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 978407 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 978415 INFO (zkCallback-1045-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4ac9496 name:ZooKeeperConnection Watcher:127.0.0.1:52486 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 978416 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 978416 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 978417 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:57096__%2Fo ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$$Lambda$9/1490217453@5153f14c
[junit4] 2> 978418 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:57096__%2Fo ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 978429 INFO (zkCallback-1046-thread-1-processing-n:127.0.0.1:57096__%2Fo) [n:127.0.0.1:57096__%2Fo ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7c537352 name:ZooKeeperConnection Watcher:127.0.0.1:52486/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 978429 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:57096__%2Fo ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 978436 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:57096__%2Fo ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 978437 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:57096__%2Fo ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
[junit4] 2> 978438 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:57096__%2Fo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 978441 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:57096__%2Fo ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 978441 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:57096__%2Fo ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/96289409381826569-127.0.0.1:57096__%2Fo-n_0000000001
[junit4] 2> 978442 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:57096__%2Fo ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/96289409381826564-127.0.0.1:56077__%2Fo-n_0000000000 to know if I could be the leader
[junit4] 2> 978442 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:57096__%2Fo ] o.a.s.c.ZkController Publish node=127.0.0.1:57096__%2Fo as DOWN
[junit4] 2> 978444 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:57096__%2Fo ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57096__%2Fo
[junit4] 2> 978444 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:57096__%2Fo ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:57096__%2Fo
[junit4] 2> 978453 INFO (zkCallback-1046-thread-1-processing-n:127.0.0.1:57096__%2Fo) [n:127.0.0.1:57096__%2Fo ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 978454 INFO (zkCallback-1046-thread-1-processing-n:127.0.0.1:57096__%2Fo) [n:127.0.0.1:57096__%2Fo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 978462 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:57096__%2Fo ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 978462 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:57096__%2Fo ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 978462 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:57096__%2Fo ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001/shard-1-001/cores
[junit4] 2> 978463 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:57096__%2Fo ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=collection1, coreNodeName=, dataDir=data/, shard=}
[junit4] 2> 978463 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:57096__%2Fo ] o.a.s.c.CorePropertiesLocator Found core collection1 in /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001/shard-1-001/cores/collection1
[junit4] 2> 978463 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:57096__%2Fo ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
[junit4] 2> 978469 INFO (OverseerStateUpdate-96289409381826564-127.0.0.1:56077__%2Fo-n_0000000000) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"downnode",
[junit4] 2> "node_name":"127.0.0.1:57096__%2Fo"} current state version: 3
[junit4] 2> 978469 INFO (OverseerStateUpdate-96289409381826564-127.0.0.1:56077__%2Fo-n_0000000000) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:57096__%2Fo
[junit4] 2> 978473 INFO (zkCallback-1036-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 978473 INFO (zkCallback-1036-thread-3-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
[junit4] 2> 978473 INFO (zkCallback-1040-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 978474 INFO (zkCallback-1036-thread-1-processing-n:127.0.0.1:56077__%2Fo) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 978488 INFO (zkCallback-1040-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 978489 INFO (zkCallback-1040-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [2])
[junit4] 2> 978491 INFO (zkCallback-1046-thread-1-processing-n:127.0.0.1:57096__%2Fo) [n:127.0.0.1:57096__%2Fo ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [2])
[junit4] 2> 978493 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:57096__%2Fo ] o.a.s.s.SolrDispatchFilter user.dir=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1
[junit4] 2> 978493 INFO (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[23D48EF620D55667]) [n:127.0.0.1:57096__%2Fo ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 978498 INFO (coreLoadExecutor-3147-thread-1-processing-n:127.0.0.1:57096__%2Fo) [n:127.0.0.1:57096__%2Fo c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 978498 INFO (coreLoadExecutor-3147-thread-1-processing-n:127.0.0.1:57096__%2Fo) [n:127.0.0.1:57096__%2Fo c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
[junit4] 2> 978500 INFO (OverseerStateUpdate-96289409381826564-127.0.0.1:56077__%2Fo-n_0000000000) [n:127.0.0.1:56077__%2Fo ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4]
[...truncated too long message...]
23D48EF620D55667-001/shard-3-002/cores/collection1/data
[junit4] 2> 1087572 INFO (zkCallback-1092-thread-3-processing-n:127.0.0.1:42266__%2Fo) [n:127.0.0.1:42266__%2Fo c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001/shard-3-002/cores/collection1/data/index [CachedDir<<refCount=0;path=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001/shard-3-002/cores/collection1/data/index;done=false>>]
[junit4] 2> 1087572 INFO (zkCallback-1092-thread-3-processing-n:127.0.0.1:42266__%2Fo) [n:127.0.0.1:42266__%2Fo c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory, CoreContainer#isShutdown=true
[junit4] 2> 1087572 INFO (zkCallback-1092-thread-3-processing-n:127.0.0.1:42266__%2Fo) [n:127.0.0.1:42266__%2Fo c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001/shard-3-002/cores/collection1/data/index
[junit4] 2> 1087572 INFO (zkCallback-1092-thread-3-processing-n:127.0.0.1:42266__%2Fo) [n:127.0.0.1:42266__%2Fo c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.ElectionContext Canceling election /collections/collection1/leader_elect/shard2/election/96289411987210255-core_node3-n_0000000001
[junit4] 2> 1087572 WARN (zkCallback-1092-thread-3-processing-n:127.0.0.1:42266__%2Fo) [n:127.0.0.1:42266__%2Fo c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.LeaderElector
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard2/election/96289411987210255-core_node3-n_0000000001
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:244)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:241)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:241)
[junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:85)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.cancelElection(ElectionContext.java:142)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.cancelElection(ElectionContext.java:274)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:450)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:56)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:348)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.lambda$process$0(SolrZkClient.java:266)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 1087574 INFO (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[23D48EF620D55667]) [ ] o.e.j.s.ServerConnector Stopped ServerConnector@5b701f51{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 1087575 INFO (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[23D48EF620D55667]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@fbd5ce9{/_/o,null,UNAVAILABLE}
[junit4] 2> 1087579 INFO (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[23D48EF620D55667]) [ ] o.a.s.c.ChaosMonkey monkey: stop shard! 64364
[junit4] 2> 1087585 INFO (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[23D48EF620D55667]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41042 41042
[junit4] 2> 1087608 INFO (Thread-1823) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41042 41042
[junit4] 2> 1087609 WARN (Thread-1823) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 5 /solr/aliases.json
[junit4] 2> 5 /solr/clusterprops.json
[junit4] 2> 4 /solr/security.json
[junit4] 2> 4 /solr/configs/conf1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 5 /solr/clusterstate.json
[junit4] 2> 3 /solr/collections/forceleader_last_published/state.json
[junit4] 2> 3 /solr/collections/collection1/state.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 65 /solr/overseer/collection-queue-work
[junit4] 2> 39 /solr/overseer/queue
[junit4] 2> 11 /solr/overseer/queue-work
[junit4] 2> 5 /solr/live_nodes
[junit4] 2> 5 /solr/collections
[junit4] 2>
[junit4] 2> 1087609 WARN (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[23D48EF620D55667]) [ ] o.a.s.c.SocketProxy Closing 8 connections to: http://127.0.0.1:56351/_/o, target: http://127.0.0.1:63539/_/o
[junit4] 2> 1087609 WARN (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[23D48EF620D55667]) [ ] o.a.s.c.SocketProxy Closing 4 connections to: http://127.0.0.1:64364/_/o, target: http://127.0.0.1:47204/_/o
[junit4] 2> 1087609 WARN (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[23D48EF620D55667]) [ ] o.a.s.c.SocketProxy Closing 6 connections to: http://127.0.0.1:34795/_/o, target: http://127.0.0.1:34874/_/o
[junit4] 2> 1087609 WARN (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[23D48EF620D55667]) [ ] o.a.s.c.SocketProxy Closing 0 connections to: http://127.0.0.1:42266/_/o, target: http://127.0.0.1:41034/_/o
[junit4] 2> 1087611 INFO (SUITE-ForceLeaderTest-seed#[23D48EF620D55667]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_23D48EF620D55667-001
[junit4] 2> Jul 23, 2016 7:44:59 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Lucene62, sim=ClassicSimilarity, locale=fi, timezone=Asia/Rangoon
[junit4] 2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_92 (64-bit)/cpus=3,threads=1,free=112528472,total=480247808
[junit4] 2> NOTE: All tests run in this JVM: [MultiThreadedOCPTest, TestSolrQueryParser, TestSolrQueryParserResource, TestCrossCoreJoin, TestSolrCloudWithKerberosAlt, TestRealTimeGet, FullSolrCloudDistribCmdsTest, TestConfigSetsAPI, HdfsRestartWhileUpdatingTest, RecoveryAfterSoftCommitTest, SaslZkACLProviderTest, TestUseDocValuesAsStored2, TestCollationField, TestReload, TestGraphTermsQParserPlugin, ExitableDirectoryReaderTest, CreateCollectionCleanupTest, TestSolrCoreProperties, MinimalSchemaTest, HLLSerializationTest, MergeStrategyTest, TestCloudManagedSchema, TestComplexPhraseQParserPlugin, DocValuesMissingTest, DistributedFacetPivotSmallAdvancedTest, TestSimpleTrackingShardHandler, DistributedDebugComponentTest, TestDynamicFieldCollectionResource, IndexSchemaRuntimeFieldTest, CacheHeaderTest, TestTestInjection, TestReplicaProperties, TestSlowCompositeReaderWrapper, CSVRequestHandlerTest, SimpleMLTQParserTest, NotRequiredUniqueKeyTest, HdfsUnloadDistributedZkTest, DistributedQueryComponentOptimizationTest, TestCloudSchemaless, TestReRankQParserPlugin, StressHdfsTest, DistributedIntervalFacetingTest, CollectionsAPIDistributedZkTest, SolrCoreCheckLockOnStartupTest, TestRawTransformer, TestPKIAuthenticationPlugin, TestQueryUtils, DeleteStatusTest, SpellingQueryConverterTest, TestLocalFSCloudBackupRestore, TestCustomDocTransformer, TestLRUStatsCache, TestIndexingPerformance, TestIndexSearcher, HdfsCollectionsAPIDistributedZkTest, DistributedQueueTest, JavabinLoaderTest, TestFieldCollectionResource, TestSchemaNameResource, TestTolerantUpdateProcessorRandomCloud, QueryResultKeyTest, FieldMutatingUpdateProcessorTest, TestFieldCacheSanityChecker, TestUninvertingReader, TestUtils, TestRandomRequestDistribution, BasicFunctionalityTest, SortByFunctionTest, SuggesterWFSTTest, AnalyticsQueryTest, TermVectorComponentDistributedTest, TestSha256AuthenticationProvider, DistanceFunctionTest, DeleteInactiveReplicaTest, TestIntervalFaceting, TestRandomFaceting, ChaosMonkeySafeLeaderTest, TriLevelCompositeIdRoutingTest, ResourceLoaderTest, SpellCheckCollatorTest, PKIAuthenticationIntegrationTest, LoggingHandlerTest, TestNumericTerms32, TestBinaryField, ForceLeaderTest]
[junit4] Completed [175/623 (1!)] on J1 in 113.54s, 3 tests, 1 error, 1 skipped <<< FAILURES!
[...truncated 61540 lines...]
[JENKINS] Lucene-Solr-master-Solaris (64bit/jdk1.8.0) - Build # 733
- Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-master-Solaris/733/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseG1GC
1 tests failed.
FAILED: org.apache.solr.common.cloud.TestCollectionStateWatchers.testSimpleCollectionWatch
Error Message:
Stack Trace:
java.util.concurrent.TimeoutException
at __randomizedtesting.SeedInfo.seed([69598012341D8BF5:34624F62731014CB]:0)
at org.apache.solr.common.cloud.ZkStateReader.waitForState(ZkStateReader.java:1233)
at org.apache.solr.client.solrj.impl.CloudSolrClient.waitForState(CloudSolrClient.java:630)
at org.apache.solr.common.cloud.TestCollectionStateWatchers.testSimpleCollectionWatch(TestCollectionStateWatchers.java:92)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 13150 lines...]
[junit4] Suite: org.apache.solr.common.cloud.TestCollectionStateWatchers
[junit4] 2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_69598012341D8BF5-001/init-core-data-001
[junit4] 2> 163277 INFO (SUITE-TestCollectionStateWatchers-seed#[69598012341D8BF5]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 163278 INFO (SUITE-TestCollectionStateWatchers-seed#[69598012341D8BF5]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 163278 INFO (Thread-297) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 163278 INFO (Thread-297) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 163378 INFO (SUITE-TestCollectionStateWatchers-seed#[69598012341D8BF5]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:51185
[junit4] 2> 163378 INFO (SUITE-TestCollectionStateWatchers-seed#[69598012341D8BF5]-worker) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 163379 INFO (SUITE-TestCollectionStateWatchers-seed#[69598012341D8BF5]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 163382 INFO (zkCallback-893-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4aaf6062 name:ZooKeeperConnection Watcher:127.0.0.1:51185 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 163382 INFO (SUITE-TestCollectionStateWatchers-seed#[69598012341D8BF5]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 163382 INFO (SUITE-TestCollectionStateWatchers-seed#[69598012341D8BF5]-worker) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 163382 INFO (SUITE-TestCollectionStateWatchers-seed#[69598012341D8BF5]-worker) [ ] o.a.s.c.c.SolrZkClient makePath: /solr/solr.xml
[junit4] 2> 163389 INFO (jetty-launcher-892-thread-1) [ ] o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 163389 INFO (jetty-launcher-892-thread-2) [ ] o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 163390 INFO (jetty-launcher-892-thread-4) [ ] o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 163390 INFO (jetty-launcher-892-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@39327201{/solr,null,AVAILABLE}
[junit4] 2> 163390 INFO (jetty-launcher-892-thread-3) [ ] o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 163395 INFO (jetty-launcher-892-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@49ab9757{/solr,null,AVAILABLE}
[junit4] 2> 163398 INFO (jetty-launcher-892-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@661665ca{/solr,null,AVAILABLE}
[junit4] 2> 163398 INFO (jetty-launcher-892-thread-3) [ ] o.e.j.s.ServerConnector Started ServerConnector@42014737{HTTP/1.1,[http/1.1]}{127.0.0.1:53638}
[junit4] 2> 163398 INFO (jetty-launcher-892-thread-3) [ ] o.e.j.s.Server Started @166605ms
[junit4] 2> 163398 INFO (jetty-launcher-892-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=53638}
[junit4] 2> 163398 INFO (jetty-launcher-892-thread-2) [ ] o.e.j.s.ServerConnector Started ServerConnector@29f174c3{HTTP/1.1,[http/1.1]}{127.0.0.1:55333}
[junit4] 2> 163398 INFO (jetty-launcher-892-thread-2) [ ] o.e.j.s.Server Started @166606ms
[junit4] 2> 163398 INFO (jetty-launcher-892-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=55333}
[junit4] 2> 163398 INFO (jetty-launcher-892-thread-3) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@6d06d69c
[junit4] 2> 163399 INFO (jetty-launcher-892-thread-3) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_69598012341D8BF5-001/tempDir-001/node4'
[junit4] 2> 163399 INFO (jetty-launcher-892-thread-2) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@6d06d69c
[junit4] 2> 163399 INFO (jetty-launcher-892-thread-3) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 163399 INFO (jetty-launcher-892-thread-2) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_69598012341D8BF5-001/tempDir-001/node2'
[junit4] 2> 163399 INFO (jetty-launcher-892-thread-3) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 163399 INFO (jetty-launcher-892-thread-2) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 163399 INFO (jetty-launcher-892-thread-2) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 163399 INFO (jetty-launcher-892-thread-3) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 163399 INFO (jetty-launcher-892-thread-2) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 163400 INFO (jetty-launcher-892-thread-3) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 163401 INFO (jetty-launcher-892-thread-1) [ ] o.e.j.s.ServerConnector Started ServerConnector@4d37afa6{HTTP/1.1,[http/1.1]}{127.0.0.1:44832}
[junit4] 2> 163401 INFO (jetty-launcher-892-thread-1) [ ] o.e.j.s.Server Started @166609ms
[junit4] 2> 163401 INFO (jetty-launcher-892-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=44832}
[junit4] 2> 163402 INFO (jetty-launcher-892-thread-1) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@6d06d69c
[junit4] 2> 163402 INFO (jetty-launcher-892-thread-1) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_69598012341D8BF5-001/tempDir-001/node1'
[junit4] 2> 163402 INFO (jetty-launcher-892-thread-1) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 163402 INFO (jetty-launcher-892-thread-1) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 163403 INFO (jetty-launcher-892-thread-1) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 163403 INFO (jetty-launcher-892-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 163406 INFO (jetty-launcher-892-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 163408 INFO (jetty-launcher-892-thread-4) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@596df5de{/solr,null,AVAILABLE}
[junit4] 2> 163408 INFO (jetty-launcher-892-thread-4) [ ] o.e.j.s.ServerConnector Started ServerConnector@7e56cc6c{HTTP/1.1,[http/1.1]}{127.0.0.1:54781}
[junit4] 2> 163408 INFO (jetty-launcher-892-thread-4) [ ] o.e.j.s.Server Started @166615ms
[junit4] 2> 163408 INFO (jetty-launcher-892-thread-4) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=54781}
[junit4] 2> 163408 INFO (zkCallback-894-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@684a21e0 name:ZooKeeperConnection Watcher:127.0.0.1:51185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 163408 INFO (jetty-launcher-892-thread-4) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@6d06d69c
[junit4] 2> 163408 INFO (jetty-launcher-892-thread-4) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_69598012341D8BF5-001/tempDir-001/node3'
[junit4] 2> 163408 INFO (jetty-launcher-892-thread-4) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 163408 INFO (jetty-launcher-892-thread-4) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 163409 INFO (zkCallback-896-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@f885e39 name:ZooKeeperConnection Watcher:127.0.0.1:51185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 163409 INFO (jetty-launcher-892-thread-3) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 163409 INFO (jetty-launcher-892-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 163409 INFO (jetty-launcher-892-thread-4) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 163409 INFO (jetty-launcher-892-thread-3) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 163409 INFO (jetty-launcher-892-thread-1) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 163410 INFO (jetty-launcher-892-thread-4) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 163410 INFO (jetty-launcher-892-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 163412 INFO (zkCallback-895-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@65c5d0f4 name:ZooKeeperConnection Watcher:127.0.0.1:51185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 163412 INFO (jetty-launcher-892-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 163412 INFO (jetty-launcher-892-thread-2) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 163412 INFO (jetty-launcher-892-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 163414 INFO (jetty-launcher-892-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 163419 INFO (zkCallback-897-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3df73ba0 name:ZooKeeperConnection Watcher:127.0.0.1:51185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 163419 INFO (jetty-launcher-892-thread-4) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 163419 INFO (jetty-launcher-892-thread-4) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 163419 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15614a61ade0002, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 163420 INFO (jetty-launcher-892-thread-4) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 163420 INFO (jetty-launcher-892-thread-2) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_69598012341D8BF5-001/tempDir-001/node2/.
[junit4] 2> 163420 INFO (jetty-launcher-892-thread-2) [ ] o.a.s.c.CoreContainer New CoreContainer 848857858
[junit4] 2> 163420 INFO (jetty-launcher-892-thread-2) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_69598012341D8BF5-001/tempDir-001/node2]
[junit4] 2> 163421 WARN (jetty-launcher-892-thread-2) [ ] o.a.s.c.CoreContainer Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_69598012341D8BF5-001/tempDir-001/node2/lib to classpath: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_69598012341D8BF5-001/tempDir-001/node2/lib
[junit4] 2> 163421 INFO (jetty-launcher-892-thread-2) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,
[junit4] 2> 163421 INFO (jetty-launcher-892-thread-1) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_69598012341D8BF5-001/tempDir-001/node1/.
[junit4] 2> 163421 INFO (jetty-launcher-892-thread-1) [ ] o.a.s.c.CoreContainer New CoreContainer 1317128654
[junit4] 2> 163421 INFO (jetty-launcher-892-thread-1) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_69598012341D8BF5-001/tempDir-001/node1]
[junit4] 2> 163421 WARN (jetty-launcher-892-thread-1) [ ] o.a.s.c.CoreContainer Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_69598012341D8BF5-001/tempDir-001/node1/lib to classpath: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_69598012341D8BF5-001/tempDir-001/node1/lib
[junit4] 2> 163421 INFO (jetty-launcher-892-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,
[junit4] 2> 163422 INFO (jetty-launcher-892-thread-2) [ ] o.a.s.u.UpdateShardHandler Created UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&maxConnections=100000&maxConnectionsPerHost=100000
[junit4] 2> 163422 INFO (jetty-launcher-892-thread-2) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 163422 INFO (jetty-launcher-892-thread-2) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 163423 INFO (jetty-launcher-892-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51185/solr
[junit4] 2> 163423 INFO (jetty-launcher-892-thread-2) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 163423 INFO (jetty-launcher-892-thread-2) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 163423 INFO (jetty-launcher-892-thread-1) [ ] o.a.s.u.UpdateShardHandler Created UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&maxConnections=100000&maxConnectionsPerHost=100000
[junit4] 2> 163423 INFO (jetty-launcher-892-thread-1) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 163423 INFO (jetty-launcher-892-thread-1) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 163424 INFO (jetty-launcher-892-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51185/solr
[junit4] 2> 163424 INFO (jetty-launcher-892-thread-3) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_69598012341D8BF5-001/tempDir-001/node4/.
[junit4] 2> 163425 INFO (jetty-launcher-892-thread-3) [ ] o.a.s.c.CoreContainer New CoreContainer 1187193632
[junit4] 2> 163425 INFO (jetty-launcher-892-thread-3) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_69598012341D8BF5-001/tempDir-001/node4]
[junit4] 2> 163425 WARN (jetty-launcher-892-thread-3) [ ] o.a.s.c.CoreContainer Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_69598012341D8BF5-001/tempDir-001/node4/lib to classpath: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_69598012341D8BF5-001/tempDir-001/node4/lib
[junit4] 2> 163425 INFO (jetty-launcher-892-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 163425 INFO (jetty-launcher-892-thread-3) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,
[junit4] 2> 163427 INFO (jetty-launcher-892-thread-3) [ ] o.a.s.u.UpdateShardHandler Created UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&maxConnections=100000&maxConnectionsPerHost=100000
[junit4] 2> 163427 INFO (jetty-launcher-892-thread-3) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 163427 INFO (jetty-launcher-892-thread-3) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 163427 INFO (jetty-launcher-892-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51185/solr
[junit4] 2> 163427 INFO (jetty-launcher-892-thread-3) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 163427 INFO (jetty-launcher-892-thread-3) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 163427 INFO (jetty-launcher-892-thread-3) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 163440 INFO (jetty-launcher-892-thread-1) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 163441 INFO (jetty-launcher-892-thread-1) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 163441 INFO (jetty-launcher-892-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 163446 INFO (zkCallback-902-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@22a614fb name:ZooKeeperConnection Watcher:127.0.0.1:51185 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 163447 INFO (zkCallback-905-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@477f59b5 name:ZooKeeperConnection Watcher:127.0.0.1:51185 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 163447 INFO (jetty-launcher-892-thread-3) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 163447 INFO (jetty-launcher-892-thread-3) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 163448 INFO (jetty-launcher-892-thread-3) [n:127.0.0.1:53638_solr ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$$Lambda$80/1333680938@77b8ed5c
[junit4] 2> 163449 INFO (jetty-launcher-892-thread-3) [n:127.0.0.1:53638_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 163450 INFO (zkCallback-907-thread-1-processing-n:127.0.0.1:53638_solr) [n:127.0.0.1:53638_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7b3f5a6 name:ZooKeeperConnection Watcher:127.0.0.1:51185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 163451 INFO (jetty-launcher-892-thread-3) [n:127.0.0.1:53638_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 163452 INFO (jetty-launcher-892-thread-3) [n:127.0.0.1:53638_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 163454 INFO (jetty-launcher-892-thread-3) [n:127.0.0.1:53638_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 163454 INFO (jetty-launcher-892-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 163454 INFO (jetty-launcher-892-thread-2) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 163455 INFO (jetty-launcher-892-thread-4) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_69598012341D8BF5-001/tempDir-001/node3/.
[junit4] 2> 163455 INFO (jetty-launcher-892-thread-4) [ ] o.a.s.c.CoreContainer New CoreContainer 1517558851
[junit4] 2> 163455 INFO (jetty-launcher-892-thread-4) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_69598012341D8BF5-001/tempDir-001/node3]
[junit4] 2> 163455 WARN (jetty-launcher-892-thread-4) [ ] o.a.s.c.CoreContainer Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_69598012341D8BF5-001/tempDir-001/node3/lib to classpath: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_69598012341D8BF5-001/tempDir-001/node3/lib
[junit4] 2> 163456 INFO (jetty-launcher-892-thread-4) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,
[junit4] 2> 163457 INFO (jetty-launcher-892-thread-4) [ ] o.a.s.u.UpdateShardHandler Created UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&maxConnections=100000&maxConnectionsPerHost=100000
[junit4] 2> 163457 INFO (jetty-launcher-892-thread-4) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 163457 INFO (jetty-launcher-892-thread-4) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 163457 INFO (jetty-launcher-892-thread-4) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:51185/solr
[junit4] 2> 163457 INFO (jetty-launcher-892-thread-4) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 163457 INFO (jetty-launcher-892-thread-4) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 163458 INFO (jetty-launcher-892-thread-4) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 163482 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15614a61ade0006, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 163486 INFO (zkCallback-910-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@11095c97 name:ZooKeeperConnection Watcher:127.0.0.1:51185 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 163482 INFO (jetty-launcher-892-thread-2) [n:127.0.0.1:55333_solr ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$$Lambda$80/1333680938@1063eee3
[junit4] 2> 163486 INFO (jetty-launcher-892-thread-4) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 163486 INFO (zkCallback-906-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4a126d70 name:ZooKeeperConnection Watcher:127.0.0.1:51185 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 163487 INFO (jetty-launcher-892-thread-4) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 163487 INFO (jetty-launcher-892-thread-2) [n:127.0.0.1:55333_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 163489 INFO (jetty-launcher-892-thread-3) [n:127.0.0.1:53638_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 163491 INFO (jetty-launcher-892-thread-3) [n:127.0.0.1:53638_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 163493 INFO (jetty-launcher-892-thread-3) [n:127.0.0.1:53638_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 163496 INFO (jetty-launcher-892-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 163496 INFO (jetty-launcher-892-thread-1) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 163496 INFO (jetty-launcher-892-thread-3) [n:127.0.0.1:53638_solr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 163499 INFO (jetty-launcher-892-thread-4) [n:127.0.0.1:54781_solr ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$$Lambda$80/1333680938@20864683
[junit4] 2> 163499 INFO (jetty-launcher-892-thread-4) [n:127.0.0.1:54781_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 163500 INFO (jetty-launcher-892-thread-1) [n:127.0.0.1:44832_solr ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$$Lambda$80/1333680938@40bd63c
[junit4] 2> 163500 INFO (jetty-launcher-892-thread-3) [n:127.0.0.1:53638_solr ] o.a.s.c.c.SolrZkClient makePath: /collections
[junit4] 2> 163502 INFO (jetty-launcher-892-thread-3) [n:127.0.0.1:53638_solr ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 163502 INFO (jetty-launcher-892-thread-1) [n:127.0.0.1:44832_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 163502 INFO (zkCallback-911-thread-1-processing-n:127.0.0.1:55333_solr) [n:127.0.0.1:55333_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1f6de543 name:ZooKeeperConnection Watcher:127.0.0.1:51185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 163503 INFO (jetty-launcher-892-thread-2) [n:127.0.0.1:55333_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 163504 INFO (zkCallback-913-thread-1-processing-n:127.0.0.1:54781_solr) [n:127.0.0.1:54781_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1d65101d name:ZooKeeperConnection Watcher:127.0.0.1:51185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 163505 INFO (jetty-launcher-892-thread-4) [n:127.0.0.1:54781_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 163505 INFO (jetty-launcher-892-thread-3) [n:127.0.0.1:53638_solr ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 163506 INFO (zkCallback-914-thread-1-processing-n:127.0.0.1:44832_solr) [n:127.0.0.1:44832_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@23e96772 name:ZooKeeperConnection Watcher:127.0.0.1:51185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 163507 INFO (jetty-launcher-892-thread-1) [n:127.0.0.1:44832_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 163512 INFO (jetty-launcher-892-thread-3) [n:127.0.0.1:53638_solr ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 163515 INFO (jetty-launcher-892-thread-3) [n:127.0.0.1:53638_solr ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 163516 INFO (jetty-launcher-892-thread-3) [n:127.0.0.1:53638_solr ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
[junit4] 2> 163519 INFO (jetty-launcher-892-thread-3) [n:127.0.0.1:53638_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
[junit4] 2> 163522 INFO (jetty-launcher-892-thread-4) [n:127.0.0.1:54781_solr ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 163523 INFO (jetty-launcher-892-thread-4) [n:127.0.0.1:54781_solr ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
[junit4] 2> 163523 INFO (jetty-launcher-892-thread-2) [n:127.0.0.1:55333_solr ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 163524 INFO (jetty-launcher-892-thread-4) [n:127.0.0.1:54781_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
[junit4] 2> 163525 INFO (jetty-launcher-892-thread-2) [n:127.0.0.1:55333_solr ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
[junit4] 2> 163525 INFO (jetty-launcher-892-thread-3) [n:127.0.0.1:53638_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 163527 INFO (jetty-launcher-892-thread-2) [n:127.0.0.1:55333_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
[junit4] 2> 163527 INFO (jetty-launcher-892-thread-3) [n:127.0.0.1:53638_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 163527 INFO (jetty-launcher-892-thread-1) [n:127.0.0.1:44832_solr ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 163529 INFO (jetty-launcher-892-thread-3) [n:127.0.0.1:53638_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 163529 INFO (jetty-launcher-892-thread-3) [n:127.0.0.1:53638_solr ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/96287145682927623-127.0.0.1:53638_solr-n_0000000000
[junit4] 2> 163530 INFO (jetty-launcher-892-thread-4) [n:127.0.0.1:54781_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 163530 INFO (jetty-launcher-892-thread-3) [n:127.0.0.1:53638_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:53638_solr
[junit4] 2> 163530 INFO (jetty-launcher-892-thread-3) [n:127.0.0.1:53638_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 163530 INFO (jetty-launcher-892-thread-1) [n:127.0.0.1:44832_solr ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
[junit4] 2> 163531 INFO (jetty-launcher-892-thread-4) [n:127.0.0.1:54781_solr ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/96287145682927628-127.0.0.1:54781_solr-n_0000000001
[junit4] 2> 163533 INFO (jetty-launcher-892-thread-4) [n:127.0.0.1:54781_solr ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/96287145682927623-127.0.0.1:53638_solr-n_0000000000 to know if I could be the leader
[junit4] 2> 163533 INFO (jetty-launcher-892-thread-3) [n:127.0.0.1:53638_solr ] o.a.s.c.Overseer Overseer (id=96287145682927623-127.0.0.1:53638_solr-n_0000000000) starting
[junit4] 2> 163533 INFO (jetty-launcher-892-thread-1) [n:127.0.0.1:44832_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
[junit4] 2> 163534 INFO (jetty-launcher-892-thread-4) [n:127.0.0.1:54781_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54781_solr
[junit4] 2> 163534 INFO (jetty-launcher-892-thread-4) [n:127.0.0.1:54781_solr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:54781_solr
[junit4] 2> 163535 INFO (jetty-launcher-892-thread-2) [n:127.0.0.1:55333_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 163536 INFO (jetty-launcher-892-thread-2) [n:127.0.0.1:55333_solr ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/96287145682927626-127.0.0.1:55333_solr-n_0000000002
[junit4] 2> 163536 INFO (zkCallback-907-thread-1-processing-n:127.0.0.1:53638_solr) [n:127.0.0.1:53638_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
[junit4] 2> 163536 INFO (jetty-launcher-892-thread-3) [n:127.0.0.1:53638_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 163536 INFO (zkCallback-913-thread-1-processing-n:127.0.0.1:54781_solr) [n:127.0.0.1:54781_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
[junit4] 2> 163536 INFO (zkCallback-911-thread-1-processing-n:127.0.0.1:55333_solr) [n:127.0.0.1:55333_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
[junit4] 2> 163544 INFO (jetty-launcher-892-thread-3) [n:127.0.0.1:53638_solr ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 163544 INFO (jetty-launcher-892-thread-3) [n:127.0.0.1:53638_solr ] o.a.s.c.ZkController Publish node=127.0.0.1:53638_solr as DOWN
[junit4] 2> 163545 INFO (jetty-launcher-892-thread-3) [n:127.0.0.1:53638_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53638_solr
[junit4] 2> 163546 INFO (jetty-launcher-892-thread-3) [n:127.0.0.1:53638_solr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:53638_solr
[junit4] 2> 163547 INFO (zkCallback-907-thread-2-processing-n:127.0.0.1:53638_solr) [n:127.0.0.1:53638_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
[junit4] 2> 163549 INFO (jetty-launcher-892-thread-2) [n:127.0.0.1:55333_solr ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/96287145682927628-127.0.0.1:54781_solr-n_0000000001 to know if I could be the leader
[junit4] 2> 163555 INFO (zkCallback-914-thread-1-processing-n:127.0.0.1:44832_solr) [n:127.0.0.1:44832_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
[junit4] 2> 163555 INFO (zkCallback-913-thread-2-processing-n:127.0.0.1:54781_solr) [n:127.0.0.1:54781_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
[junit4] 2> 163556 INFO (zkCallback-913-thread-2-processing-n:127.0.0.1:54781_solr) [n:127.0.0.1:54781_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 163556 INFO (OverseerCollectionConfigSetProcessor-96287145682927623-127.0.0.1:53638_solr-n_0000000000) [n:127.0.0.1:53638_solr ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 163558 INFO (OverseerStateUpdate-96287145682927623-127.0.0.1:53638_solr-n_0000000000) [n:127.0.0.1:53638_solr ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 163559 INFO (OverseerStateUpdate-96287145682927623-127.0.0.1:53638_solr-n_0000000000) [n:127.0.0.1:53638_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 163560 INFO (OverseerStateUpdate-96287145682927623-127.0.0.1:53638_solr-n_0000000000) [n:127.0.0.1:53638_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"downnode",
[junit4] 2> "node_name":"127.0.0.1:53638_solr"} current state version: 0
[junit4] 2> 163560 INFO (OverseerStateUpdate-96287145682927623-127.0.0.1:53638_solr-n_0000000000) [n:127.0.0.1:53638_solr ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:53638_solr
[junit4] 2> 163565 INFO (jetty-launcher-892-thread-1) [n:127.0.0.1:44832_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 163565 INFO (jetty-launcher-892-thread-1) [n:127.0.0.1:44832_solr ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/96287145682927627-127.0.0.1:44832_solr-n_0000000003
[junit4] 2> 163566 INFO (jetty-launcher-892-thread-1) [n:127.0.0.1:44832_solr ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/96287145682927626-127.0.0.1:55333_solr-n_0000000002 to know if I could be the leader
[junit4] 2> 163566 INFO (jetty-launcher-892-thread-1) [n:127.0.0.1:44832_solr ] o.a.s.c.ZkController Publish node=127.0.0.1:44832_solr as DOWN
[junit4] 2> 163568 INFO (jetty-launcher-892-thread-1) [n:127.0.0.1:44832_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44832_solr
[junit4] 2> 163568 INFO (jetty-launcher-892-thread-1) [n:127.0.0.1:44832_solr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:44832_solr
[junit4] 2> 163569 INFO (zkCallback-911-thread-2-processing-n:127.0.0.1:55333_solr) [n:127.0.0.1:55333_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
[junit4] 2> 163570 INFO (zkCallback-907-thread-2-processing-n:127.0.0.1:53638_solr) [n:127.0.0.1:53638_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [2])
[junit4] 2> 163570 INFO (zkCallback-907-thread-2-processing-n:127.0.0.1:53638_solr) [n:127.0.0.1:53638_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 163571 INFO (OverseerStateUpdate-96287145682927623-127.0.0.1:53638_solr-n_0000000000) [n:127.0.0.1:53638_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"downnode",
[junit4] 2> "node_name":"127.0.0.1:44832_solr"} current state version: 0
[junit4] 2> 163571 INFO (OverseerStateUpdate-96287145682927623-127.0.0.1:53638_solr-n_0000000000) [n:127.0.0.1:53638_solr ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:44832_solr
[junit4] 2> 163571 INFO (jetty-launcher-892-thread-2) [n:127.0.0.1:55333_solr ] o.a.s.c.ZkController Publish node=127.0.0.1:55333_solr as DOWN
[junit4] 2> 163571 INFO (zkCallback-911-thread-1-processing-n:127.0.0.1:55333_solr) [n:127.0.0.1:55333_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 163571 INFO (zkCallback-914-thread-2-processing-n:127.0.0.1:44832_solr) [n:127.0.0.1:44832_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
[junit4] 2> 163572 INFO (zkCallback-914-thread-1-processing-n:127.0.0.1:44832_solr) [n:127.0.0.1:44832_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 163572 INFO (zkCallback-913-thread-1-processing-n:127.0.0.1:54781_solr) [n:127.0.0.1:54781_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [2])
[junit4] 2> 163573 INFO (zkCallback-911-thread-2-processing-n:127.0.0.1:55333_solr) [n:127.0.0.1:55333_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
[junit4] 2> 163574 INFO (zkCallback-913-thread-1-processing-n:127.0.0.1:54781_solr) [n:127.0.0.1:54781_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 163575 INFO (zkCallback-914-thread-2-processing-n:127.0.0.1:44832_solr) [n:127.0.0.1:44832_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 163575 INFO (jetty-launcher-892-thread-2) [n:127.0.0.1:55333_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55333_solr
[junit4] 2> 163575 INFO (jetty-launcher-892-thread-2) [n:127.0.0.1:55333_solr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:55333_solr
[junit4] 2> 163579 INFO (zkCallback-911-thread-2-processing-n:127.0.0.1:55333_solr) [n:127.0.0.1:55333_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
[junit4] 2> 163579 INFO (zkCallback-914-thread-2-processing-n:127.0.0.1:44832_solr) [n:127.0.0.1:44832_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
[junit4] 2> 163579 INFO (zkCallback-913-thread-1-processing-n:127.0.0.1:54781_solr) [n:127.0.0.1:54781_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
[junit4] 2> 163579 INFO (zkCallback-907-thread-2-processing-n:127.0.0.1:53638_solr) [n:127.0.0.1:53638_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
[junit4] 2> 163582 INFO (zkCallback-907-thread-2-processing-n:127.0.0.1:53638_solr) [n:127.0.0.1:53638_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 163582 INFO (OverseerStateUpdate-96287145682927623-127.0.0.1:53638_solr-n_0000000000) [n:127.0.0.1:53638_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"downnode",
[junit4] 2> "node_name":"127.0.0.1:55333_solr"} current state version: 0
[junit4] 2> 163582 INFO (OverseerStateUpdate-96287145682927623-127.0.0.1:53638_solr-n_0000000000) [n:127.0.0.1:53638_solr ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:55333_solr
[junit4] 2> 163584 INFO (zkCallback-913-thread-1-processing-n:127.0.0.1:54781_solr) [n:127.0.0.1:54781_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 163584 INFO (zkCallback-911-thread-2-processing-n:127.0.0.1:55333_solr) [n:127.0.0.1:55333_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 163584 INFO (zkCallback-914-thread-2-processing-n:127.0.0.1:44832_solr) [n:127.0.0.1:44832_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 163595 INFO (jetty-launcher-892-thread-1) [n:127.0.0.1:44832_solr ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 163595 INFO (jetty-launcher-892-thread-1) [n:127.0.0.1:44832_solr ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 163596 INFO (jetty-launcher-892-thread-1) [n:127.0.0.1:44832_solr ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_69598012341D8BF5-001/tempDir-001/node1/.
[junit4] 2> 163597 INFO (jetty-launcher-892-thread-1) [n:127.0.0.1:44832_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
[junit4] 2> 163598 INFO (jetty-launcher-892-thread-1) [n:127.0.0.1:44832_solr ] o.a.s.s.SolrDispatchFilter user.dir=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1
[junit4] 2> 163598 INFO (jetty-launcher-892-thread-1) [n:127.0.0.1:44832_solr ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 163607 INFO (jetty-launcher-892-thread-4) [n:127.0.0.1:54781_solr ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 163607 INFO (jetty-launcher-892-thread-4) [n:127.0.0.1:54781_solr ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 163608 INFO (jetty-launcher-892-thread-4) [n:127.0.0.1:54781_solr ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_69598012341D8BF5-001/tempDir-001/node3/.
[junit4] 2> 163608 INFO (jetty-launcher-892-thread-4) [n:127.0.0.1:54781_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
[junit4] 2> 163609 INFO (jetty-launcher-892-thread-4) [n:127.0.0.1:54781_solr ] o.a.s.s.SolrDispatchFilter user.dir=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1
[junit4] 2> 163609 INFO (jetty-launcher-892-thread-4) [n:127.0.0.1:54781_solr ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 163614 INFO (jetty-launcher-892-thread-3) [n:127.0.0.1:53638_solr ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 163614 INFO (jetty-launcher-892-thread-3) [n:127.0.0.1:53638_solr ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 163615 INFO (jetty-launcher-892-thread-3) [n:127.0.0.1:53638_solr ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_69598012341D8BF5-001/tempDir-001/node4/.
[junit4] 2> 163615 INFO (jetty-launcher-892-thread-3) [n:127.0.0.1:53638_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
[junit4] 2> 163616 INFO (jetty-launcher-892-thread-3) [n:127.0.0.1:53638_solr ] o.a.s.s.SolrDispatchFilter user.dir=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1
[junit4] 2> 163616 INFO (jetty-launcher-892-thread-3) [n:127.0.0.1:53638_solr ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 163624 INFO (jetty-launcher-892-thread-2) [n:127.0.0.1:55333_solr ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 163624 INFO (jetty-launcher-892-thread-2) [n:127.0.0.1:55333_solr ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 163624 INFO (jetty-launcher-892-thread-2) [n:127.0.0.1:55333_solr ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_69598012341D8BF5-001/tempDir-001/node2/.
[junit4] 2> 163624 INFO (jetty-launcher-892-thread-2) [n:127.0.0.1:55333_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
[junit4] 2> 163626 INFO (jetty-launcher-892-thread-2) [n:127.0.0.1:55333_solr ] o.a.s.s.SolrDispatchFilter user.dir=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1
[junit4] 2> 163626 INFO (jetty-launcher-892-thread-2) [n:127.0.0.1:55333_solr ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 163626 INFO (SUITE-TestCollectionStateWatchers-seed#[69598012341D8BF5]-worker) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 163626 INFO (SUITE-TestCollectionStateWatchers-seed#[69598012341D8BF5]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 163628 INFO (zkCallback-918-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1e77f3d1 name:ZooKeeperConnection Watcher:127.0.0.1:51185 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 163629 INFO (SUITE-TestCollectionStateWatchers-seed#[69598012341D8BF5]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 163629 INFO (SUITE-TestCollectionStateWatchers-seed#[69598012341D8BF5]-worker) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 163631 INFO (SUITE-TestCollectionStateWatchers-seed#[69598012341D8BF5]-worker) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 163632 INFO (SUITE-TestCollectionStateWatchers-seed#[69598012341D8BF5]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 163633 INFO (zkCallback-921-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@252348f6 name:ZooKeeperConnection Watcher:127.0.0.1:51185/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 163633 INFO (SUITE-TestCollectionStateWatchers-seed#[69598012341D8BF5]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 163634 INFO (SUITE-TestCollectionStateWatchers-seed#[69598012341D8BF5]-worker) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 163634 INFO (SUITE-TestCollectionStateWatchers-seed#[69598012341D8BF5]-worker) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 163635 INFO (SUITE-TestCollectionStateWatchers-seed#[69598012341D8BF5]-worker) [ ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
[junit4] 2> 163635 INFO (SUITE-TestCollectionStateWatchers-seed#[69598012341D8BF5]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 163638 INFO (SUITE-TestCollectionStateWatchers-seed#[69598012341D8BF5]-worker) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/config/solrconfig.xml
[junit4] 2> 163641 INFO (SUITE-TestCollectionStateWatchers-seed#[69598012341D8BF5]-worker) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/config/solrconfig-sql.xml
[junit4] 2> 163644 INFO (SUITE-TestCollectionStateWatchers-seed#[69598012341D8BF5]-worker) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/config/schema-replication1.xml
[junit4] 2> 163647 INFO (SUITE-TestCollectionStateWatchers-seed#[69598012341D8BF5]-worker) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/config/solrconfig-managed-schema.xml
[junit4] 2> 163649 INFO (SUITE-TestCollectionStateWatchers-seed#[69598012341D8BF5]-worker) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/config/schema-sql.xml
[junit4] 2> 163652 INFO (SUITE-TestCollectionStateWatchers-seed#[69598012341D8BF5]-worker) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/config/solrconfig-slave1.xml
[junit4] 2> 163655 INFO (SUITE-TestCollectionStateWatchers-seed#[69598012341D8BF5]-worker) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/config/schema.xml
[junit4] 2> 163705 INFO (TEST-TestCollectionStateWatchers.testDeletionsTriggerWatches-seed#[69598012341D8BF5]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testDeletionsTriggerWatches
[junit4] 2> 163705 INFO (TEST-TestCollectionStateWatchers.testDeletionsTriggerWatches-seed#[69598012341D8BF5]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 163706 INFO (TEST-TestCollectionStateWatchers.testDeletionsTriggerWatches-seed#[69598012341D8BF5]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 163708 INFO (zkCallback-922-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3f330ef7 name:ZooKeeperConnection Watcher:127.0.0.1:51185 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 163709 INFO (TEST-TestCollectionStateWatchers.testDeletionsTriggerWatches-seed#[69598012341D8BF5]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 163709 INFO (TEST-TestCollectionStateWatchers.testDeletionsTriggerWatches-seed#[69598012341D8BF5]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 163716 INFO (qtp1365949387-2464) [n:127.0.0.1:53638_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=config&name=tobedeleted&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 163719 INFO (OverseerCollectionConfigSetProcessor-96287145682927623-127.0.0.1:53638_solr-n_0000000000) [n:127.0.0.1:53638_solr ] o.a.s.c.OverseerTaskProcessor Overseer Collection Message Handler: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "name":"tobedeleted",
[junit4] 2> "fromApi":"true",
[junit4] 2> "replicationFactor":"1",
[junit4] 2> "collection.configName":"config",
[junit4] 2> "numShards":"1",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "operation":"create"}
[junit4] 2> 163719 INFO (OverseerThreadFactory-486-thread-1-processing-n:127.0.0.1:53638_solr) [n:127.0.0.1:53638_solr ] o.a.s.c.OverseerCollectionMessageHandler OverseerCollectionMessageHandler.processMessage : create , {
[junit4] 2> "name":"tobedeleted",
[junit4] 2> "fromApi":"true",
[junit4] 2> "replicationFactor":"1",
[junit4] 2> "collection.configName":"config",
[junit4] 2> "numShards":"1",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "operation":"create"}
[junit4] 2> 163719 INFO (OverseerThreadFactory-486-thread-1-processing-n:127.0.0.1:53638_solr) [n:127.0.0.1:53638_solr ] o.a.s.c.OverseerCollectionMessageHandler Create collection tobedeleted
[junit4] 2> 163720 INFO (OverseerThreadFactory-486-thread-1-processing-n:127.0.0.1:53638_solr) [n:127.0.0.1:53638_solr ] o.a.s.c.OverseerCollectionMessageHandler creating collections conf node /collections/tobedeleted
[junit4] 2> 163720 INFO (OverseerThreadFactory-486-thread-1-processing-n:127.0.0.1:53638_solr) [n:127.0.0.1:53638_solr ] o.a.s.c.c.SolrZkClient makePath: /collections/tobedeleted
[junit4] 2> 163722 INFO (zkCallback-911-thread-2-processing-n:127.0.0.1:55333_solr) [n:127.0.0.1:55333_solr ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
[junit4] 2> 163722 INFO (zkCallback-913-thread-1-processing-n:127.0.0.1:54781_solr) [n:127.0.0.1:54781_solr ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
[junit4] 2> 163722 INFO (zkCallback-914-thread-2-processing-n:127.0.0.1:44832_solr) [n:127.0.0.1:44832_solr ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
[junit4] 2> 163723 INFO (zkCallback-907-thread-1-processing-n:127.0.0.1:53638_solr) [n:127.0.0.1:53638_solr ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
[junit4] 2> 163723 INFO (zkCallback-921-thread-1) [ ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
[junit4] 2> 163729 INFO (OverseerStateUpdate-96287145682927623-127.0.0.1:53638_solr-n_0000000000) [n:127.0.0.1:53638_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "name":"tobedeleted",
[junit4] 2> "fromApi":"true",
[junit4] 2> "replicationFactor":"1",
[junit4] 2> "collection.configName":"config",
[junit4] 2> "numShards":"1",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "operation":"create"} current state version: 0
[junit4] 2> 163729 INFO (OverseerStateUpdate-96287145682927623-127.0.0.1:53638_solr-n_0000000000) [n:127.0.0.1:53638_solr ] o.a.s.c.o.ClusterStateMutator building a new cName: tobedeleted
[junit4] 2> 163730 INFO (OverseerStateUpdate-96287145682927623-127.0.0.1:53638_solr-n_0000000000) [n:127.0.0.1:53638_solr ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/tobedeleted/state.json
[junit4] 2> 163829 INFO (OverseerThreadFactory-486-thread-1-processing-n:127.0.0.1:53638_solr) [n:127.0.0.1:53638_solr ] o.a.s.c.OverseerCollectionMessageHandler Creating SolrCores for new collection tobedeleted, shardNames [shard1] , replicationFactor : 1
[junit4] 2> 163829 INFO (OverseerThreadFactory-486-thread-1-processing-n:127.0.0.1:53638_solr) [n:127.0.0.1:53638_solr ] o.a.s.c.OverseerCollectionMessageHandler Creating core tobedeleted_shard1_replica1 as part of shard shard1 of collection tobedeleted on 127.0.0.1:55333_solr
[junit4] 2> 163835 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=config&name=tobedeleted_shard1_replica1&action=CREATE&numShards=1&collection=tobedeleted&shard=shard1&wt=javabin&version=2
[junit4] 2> 163836 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=tobedeleted_shard1_replica1, collection.configName=config, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=tobedeleted, numShards=1, dataDir=data/, shard=shard1}
[junit4] 2> 163837 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 163838 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.c.ZkController Registering watch for collection tobedeleted
[junit4] 2> 163839 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.c.c.ZkStateReader Add data for [tobedeleted] ver [0]
[junit4] 2> 163839 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 163841 INFO (OverseerStateUpdate-96287145682927623-127.0.0.1:53638_solr-n_0000000000) [n:127.0.0.1:53638_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"tobedeleted_shard1_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:55333/solr",
[junit4] 2> "node_name":"127.0.0.1:55333_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"tobedeleted",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 163841 INFO (OverseerStateUpdate-96287145682927623-127.0.0.1:53638_solr-n_0000000000) [n:127.0.0.1:53638_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"tobedeleted_shard1_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:55333/solr",
[junit4] 2> "node_name":"127.0.0.1:55333_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"tobedeleted",
[junit4] 2> "operation":"state"}
[junit4] 2> 163945 INFO (OverseerStateUpdate-96287145682927623-127.0.0.1:53638_solr-n_0000000000) [n:127.0.0.1:53638_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/tobedeleted/state.json version: 0
[junit4] 2> 163945 INFO (zkCallback-911-thread-2-processing-n:127.0.0.1:55333_solr) [n:127.0.0.1:55333_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tobedeleted/state.json] for collection [tobedeleted] has occurred - updating... (live nodes size: [4])
[junit4] 2> 163946 INFO (zkCallback-911-thread-2-processing-n:127.0.0.1:55333_solr) [n:127.0.0.1:55333_solr ] o.a.s.c.c.ZkStateReader Updating data for [tobedeleted] from [0] to [1]
[junit4] 2> 164840 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.c.ZkController waiting to find shard id in clusterstate for tobedeleted_shard1_replica1
[junit4] 2> 164840 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.c.ZkController Check for collection zkNode:tobedeleted
[junit4] 2> 164841 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 164841 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/tobedeleted]
[junit4] 2> 164842 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.c.c.ZkStateReader path=[/collections/tobedeleted] [configName]=[config] specified config exists in ZooKeeper
[junit4] 2> 164843 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_69598012341D8BF5-001/tempDir-001/node2/tobedeleted_shard1_replica1'
[junit4] 2> 164843 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 164843 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 164845 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 164849 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 164852 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
[junit4] 2> 164856 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
[junit4] 2> 164862 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.s.IndexSchema [tobedeleted_shard1_replica1] Schema name=test
[junit4] 2> 164920 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 164921 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 164921 WARN (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.s.IndexSchema Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 164922 WARN (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 164924 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/config', cwd=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1
[junit4] 2> 164924 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 x:tobedeleted_shard1_replica1] o.a.s.c.CoreContainer Creating SolrCore 'tobedeleted_shard1_replica1' using configuration from collection tobedeleted
[junit4] 2> 164924 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 164925 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.SolrCore [[tobedeleted_shard1_replica1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_69598012341D8BF5-001/tempDir-001/node2/tobedeleted_shard1_replica1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_69598012341D8BF5-001/tempDir-001/node2/./tobedeleted_shard1_replica1/data/]
[junit4] 2> 164925 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.SolrCore JMX monitoring not detected for core: tobedeleted_shard1_replica1
[junit4] 2> 164925 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.CachingDirectoryFactory return new directory for /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_69598012341D8BF5-001/tempDir-001/node2/./tobedeleted_shard1_replica1/data
[junit4] 2> 164925 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.SolrCore New index directory detected: old=null new=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_69598012341D8BF5-001/tempDir-001/node2/./tobedeleted_shard1_replica1/data/index/
[junit4] 2> 164925 WARN (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.SolrCore [tobedeleted_shard1_replica1] Solr index directory '/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_69598012341D8BF5-001/tempDir-001/node2/./tobedeleted_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 164925 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.CachingDirectoryFactory return new directory for /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_69598012341D8BF5-001/tempDir-001/node2/./tobedeleted_shard1_replica1/data/index
[junit4] 2> 164926 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@6e3b815f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6b7efdfa),segFN=segments_1,generation=1}
[junit4] 2> 164926 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 164927 INFO (OldIndexDirectoryCleanupThreadForCore-tobedeleted_shard1_replica1) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core tobedeleted_shard1_replica1 in /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_69598012341D8BF5-001/tempDir-001/node2/./tobedeleted_shard1_replica1/data/
[junit4] 2> 164927 WARN (OldIndexDirectoryCleanupThreadForCore-tobedeleted_shard1_replica1) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.DirectoryFactory /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_69598012341D8BF5-001/tempDir-001/node2/./tobedeleted_shard1_replica1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 164928 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 164930 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 164931 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 164931 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 164932 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 164933 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,,/update/json/docs,/admin/luke,/export,/get,/admin/properties,/update/json,/admin/threads,/update/csv,/sql,/graph,/admin/segments,/admin/system,/replication,/config,/stream,/schema,/admin/plugins,/admin/logging,/admin/ping,/update,/admin/file,/terms
[junit4] 2> 164933 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 164934 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 164934 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 164936 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 164936 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 164936 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@6e3b815f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6b7efdfa),segFN=segments_1,generation=1}
[junit4] 2> 164936 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 164936 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@5b54340d[tobedeleted_shard1_replica1] main]
[junit4] 2> 164937 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/tobedeleted]
[junit4] 2> 164938 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.c.ZkStateReader path=[/collections/tobedeleted] [configName]=[config] specified config exists in ZooKeeper
[junit4] 2> 164938 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/config
[junit4] 2> 164939 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
[junit4] 2> 164939 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
[junit4] 2> 164939 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
[junit4] 2> 164939 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/config/_rest_managed.json
[junit4] 2> 164939 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
[junit4] 2> 164939 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
[junit4] 2> 164939 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 164940 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
[junit4] 2> 164940 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 164940 INFO (searcherExecutor-495-thread-1-processing-n:127.0.0.1:55333_solr x:tobedeleted_shard1_replica1 s:shard1 c:tobedeleted r:core_node1) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.SolrCore [tobedeleted_shard1_replica1] Registered new searcher Searcher@5b54340d[tobedeleted_shard1_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 164940 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 164940 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1540594332667478016
[junit4] 2> 164941 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.u.UpdateLog Took 1.0ms to seed version buckets with highest version 1540594332667478016
[junit4] 2> 164941 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.ZkController watch zkdir /configs/config
[junit4] 2> 164942 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.CoreContainer registering core: tobedeleted_shard1_replica1
[junit4] 2> 164942 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.ZkController Register replica - core:tobedeleted_shard1_replica1 address:http://127.0.0.1:55333/solr collection:tobedeleted shard:shard1
[junit4] 2> 164943 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.c.SolrZkClient makePath: /collections/tobedeleted/leader_elect/shard1/election
[junit4] 2> 164948 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/tobedeleted/leader_elect/shard1/election/96287145682927626-core_node1-n_0000000000
[junit4] 2> 164949 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 and weAreReplacement=false and leaderVoteWait=10000
[junit4] 2> 164951 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 164951 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 164951 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:55333/solr/tobedeleted_shard1_replica1/
[junit4] 2> 164951 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 164951 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.SyncStrategy http://127.0.0.1:55333/solr/tobedeleted_shard1_replica1/ has no replicas
[junit4] 2> 164952 INFO (OverseerStateUpdate-96287145682927623-127.0.0.1:53638_solr-n_0000000000) [n:127.0.0.1:53638_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"tobedeleted"} current state version: 0
[junit4] 2> 164953 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.c.SolrZkClient makePath: /collections/tobedeleted/leaders/shard1
[junit4] 2> 164957 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/tobedeleted/leaders/shard1/leader after winning as /collections/tobedeleted/leader_elect/shard1/election/96287145682927626-core_node1-n_0000000000
[junit4] 2> 164960 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:55333/solr/tobedeleted_shard1_replica1/ shard1
[junit4] 2> 164961 INFO (OverseerStateUpdate-96287145682927623-127.0.0.1:53638_solr-n_0000000000) [n:127.0.0.1:53638_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"tobedeleted",
[junit4] 2> "base_url":"http://127.0.0.1:55333/solr",
[junit4] 2> "core":"tobedeleted_shard1_replica1",
[junit4] 2> "state":"active"} current state version: 0
[junit4] 2> 165064 INFO (OverseerStateUpdate-96287145682927623-127.0.0.1:53638_solr-n_0000000000) [n:127.0.0.1:53638_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/tobedeleted/state.json version: 1
[junit4] 2> 165065 INFO (zkCallback-911-thread-2-processing-n:127.0.0.1:55333_solr) [n:127.0.0.1:55333_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tobedeleted/state.json] for collection [tobedeleted] has occurred - updating... (live nodes size: [4])
[junit4] 2> 165065 INFO (zkCallback-911-thread-2-processing-n:127.0.0.1:55333_solr) [n:127.0.0.1:55333_solr ] o.a.s.c.c.ZkStateReader Updating data for [tobedeleted] from [1] to [2]
[junit4] 2> 165111 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.ZkController We are http://127.0.0.1:55333/solr/tobedeleted_shard1_replica1/ and leader is http://127.0.0.1:55333/solr/tobedeleted_shard1_replica1/
[junit4] 2> 165111 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.ZkController No LogReplay needed for core=tobedeleted_shard1_replica1 baseURL=http://127.0.0.1:55333/solr
[junit4] 2> 165111 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 165111 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.ZkController publishing state=active
[junit4] 2> 165113 INFO (qtp1484305615-2473) [n:127.0.0.1:55333_solr c:tobedeleted s:shard1 r:core_node1 x:tobedeleted_shard1_replica1] o.a.s.c.c.ZkStateReader Forcing refresh of watched collection state for tobedeleted
[junit4] 2> 165114 INFO (OverseerStateUpdate-96287145682927623-127.0.0.1:53
[...truncated too long message...]
.SolrZkClient$3.process(SolrZkClient.java:266)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2> 221990 INFO (zkCallback-934-thread-2-processing-n:127.0.0.1:54781_solr) [n:127.0.0.1:54781_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 221991 WARN (zkCallback-934-thread-2-processing-n:127.0.0.1:54781_solr) [n:127.0.0.1:54781_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 221997 INFO (jetty-launcher-892-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@49ab9757{/solr,null,UNAVAILABLE}
[junit4] 2> 223484 WARN (zkCallback-914-thread-1-processing-n:127.0.0.1:44832_solr) [n:127.0.0.1:44832_solr ] o.a.s.c.LeaderElector
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:297)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:294)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:294)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:527)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:458)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:445)
[junit4] 2> at org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:724)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:56)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:348)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.lambda$process$0(SolrZkClient.java:266)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 223485 INFO (jetty-launcher-892-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@39327201{/solr,null,UNAVAILABLE}
[junit4] 2> 223490 WARN (zkCallback-934-thread-1-processing-n:127.0.0.1:54781_solr) [n:127.0.0.1:54781_solr ] o.a.s.c.LeaderElector
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:503)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:500)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:458)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:445)
[junit4] 2> at org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:724)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:56)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:348)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.lambda$process$0(SolrZkClient.java:266)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 223491 INFO (jetty-launcher-892-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6360a582{/solr,null,UNAVAILABLE}
[junit4] 2> 223493 INFO (SUITE-TestCollectionStateWatchers-seed#[69598012341D8BF5]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:51185 51185
[junit4] 2> 223505 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxnFactory Ignoring unexpected runtime exception
[junit4] 2> java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.readyOps(SelectionKeyImpl.java:87)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:187)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 223507 INFO (Thread-297) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:51185 51185
[junit4] 2> 223508 WARN (Thread-297) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/aliases.json
[junit4] 2> 7 /solr/configs/config
[junit4] 2> 7 /solr/clusterprops.json
[junit4] 2> 6 /solr/security.json
[junit4] 2> 3 /solr/collections/stateformat1/state.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 12 /solr/collections/waitforstate/state.json
[junit4] 2> 12 /solr/collections/falsepredicate/state.json
[junit4] 2> 7 /solr/clusterstate.json
[junit4] 2> 3 /solr/collections/stateformat1/state.json
[junit4] 2> 3 /solr/collections/testcollection/state.json
[junit4] 2> 2 /solr/overseer_elect/election/96287145682927628-127.0.0.1:54781_solr-n_0000000001
[junit4] 2> 2 /solr/collections/currentstate/state.json
[junit4] 2> 2 /solr/collections/delayed/state.json
[junit4] 2> 2 /solr/collections/tobedeleted/state.json
[junit4] 2> 2 /solr/overseer_elect/election/96287145682927623-127.0.0.1:53638_solr-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 61 /solr/overseer/queue
[junit4] 2> 39 /solr/overseer/collection-queue-work
[junit4] 2> 13 /solr/overseer/queue-work
[junit4] 2> 7 /solr/collections
[junit4] 2> 5 /solr/live_nodes
[junit4] 2>
[junit4] 2> 223508 INFO (SUITE-TestCollectionStateWatchers-seed#[69598012341D8BF5]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_69598012341D8BF5-001
[junit4] 2> Jul 22, 2016 10:08:25 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {}, docValues:{}, maxPointsInLeafNode=174, maxMBSortInHeap=6.950183509533179, sim=ClassicSimilarity, locale=pt-PT, timezone=Europe/Vaduz
[junit4] 2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_92 (64-bit)/cpus=3,threads=1,free=73603488,total=313524224
[junit4] 2> NOTE: All tests run in this JVM: [LargeVolumeEmbeddedTest, GetByIdTest, TestNamedListCodec, BasicHttpSolrClientTest, StreamExpressionParserTest, TestSuggesterResponse, ClientUtilsTest, ConcurrentUpdateSolrClientBuilderTest, SolrExceptionTest, TestLBHttpSolrClient, LargeVolumeJettyTest, TestJsonRecordReader, StreamExpressionToExplanationTest, HttpSolrClientBuilderTest, SolrQueryTest, TestFastInputStream, SolrPingTest, StreamExpressionTest, CloudSolrClientMultiConstructorTest, SolrExampleBinaryTest, LargeVolumeBinaryJettyTest, TestSpellCheckResponse, SolrParamTest, TermsResponseTest, MergeIndexesEmbeddedTest, TestJavaBinCodec, TestHash, TestXMLEscaping, NamedListTest, FacetFieldTest, TestSolrJErrorHandling, ConcurrentUpdateSolrClientTest, GraphTest, StreamingTest, TestCollectionStateWatchers]
[junit4] Completed [83/83 (1!)] on J1 in 60.75s, 9 tests, 1 error <<< FAILURES!
[...truncated 59421 lines...]
[JENKINS] Lucene-Solr-master-Solaris (64bit/jdk1.8.0) - Build # 732
- Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-master-Solaris/732/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
1 tests failed.
FAILED: org.apache.solr.common.cloud.TestCollectionStateWatchers.testWatchesWorkForStateFormat1
Error Message:
CollectionStateWatcher not notified of stateformat=1 collection creation
Stack Trace:
java.lang.AssertionError: CollectionStateWatcher not notified of stateformat=1 collection creation
at __randomizedtesting.SeedInfo.seed([CF545883CA66C15F:A893446D3EDEE5FE]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.common.cloud.TestCollectionStateWatchers.testWatchesWorkForStateFormat1(TestCollectionStateWatchers.java:267)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 13183 lines...]
[junit4] Suite: org.apache.solr.common.cloud.TestCollectionStateWatchers
[junit4] 2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_CF545883CA66C15F-001/init-core-data-001
[junit4] 2> 170079 INFO (SUITE-TestCollectionStateWatchers-seed#[CF545883CA66C15F]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 170080 INFO (SUITE-TestCollectionStateWatchers-seed#[CF545883CA66C15F]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 170080 INFO (Thread-316) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 170080 INFO (Thread-316) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 170182 INFO (SUITE-TestCollectionStateWatchers-seed#[CF545883CA66C15F]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:35340
[junit4] 2> 170182 INFO (SUITE-TestCollectionStateWatchers-seed#[CF545883CA66C15F]-worker) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 170182 INFO (SUITE-TestCollectionStateWatchers-seed#[CF545883CA66C15F]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 170185 INFO (zkCallback-849-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2f78120f name:ZooKeeperConnection Watcher:127.0.0.1:35340 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 170185 INFO (SUITE-TestCollectionStateWatchers-seed#[CF545883CA66C15F]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 170186 INFO (SUITE-TestCollectionStateWatchers-seed#[CF545883CA66C15F]-worker) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 170186 INFO (SUITE-TestCollectionStateWatchers-seed#[CF545883CA66C15F]-worker) [ ] o.a.s.c.c.SolrZkClient makePath: /solr/solr.xml
[junit4] 2> 170192 INFO (jetty-launcher-848-thread-2) [ ] o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 170193 INFO (jetty-launcher-848-thread-3) [ ] o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 170193 INFO (jetty-launcher-848-thread-4) [ ] o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 170193 INFO (jetty-launcher-848-thread-1) [ ] o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 170195 INFO (jetty-launcher-848-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@111c9e01{/solr,null,AVAILABLE}
[junit4] 2> 170197 INFO (jetty-launcher-848-thread-4) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@161702c9{/solr,null,AVAILABLE}
[junit4] 2> 170199 INFO (jetty-launcher-848-thread-4) [ ] o.e.j.s.ServerConnector Started ServerConnector@606cdc72{HTTP/1.1,[http/1.1]}{127.0.0.1:57902}
[junit4] 2> 170199 INFO (jetty-launcher-848-thread-2) [ ] o.e.j.s.ServerConnector Started ServerConnector@48fd8ccf{HTTP/1.1,[http/1.1]}{127.0.0.1:58494}
[junit4] 2> 170199 INFO (jetty-launcher-848-thread-4) [ ] o.e.j.s.Server Started @173386ms
[junit4] 2> 170199 INFO (jetty-launcher-848-thread-2) [ ] o.e.j.s.Server Started @173386ms
[junit4] 2> 170199 INFO (jetty-launcher-848-thread-4) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=57902}
[junit4] 2> 170199 INFO (jetty-launcher-848-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=58494}
[junit4] 2> 170199 INFO (jetty-launcher-848-thread-4) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@6d06d69c
[junit4] 2> 170199 INFO (jetty-launcher-848-thread-2) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@6d06d69c
[junit4] 2> 170199 INFO (jetty-launcher-848-thread-4) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_CF545883CA66C15F-001/tempDir-001/node4'
[junit4] 2> 170199 INFO (jetty-launcher-848-thread-2) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_CF545883CA66C15F-001/tempDir-001/node2'
[junit4] 2> 170199 INFO (jetty-launcher-848-thread-4) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 170199 INFO (jetty-launcher-848-thread-4) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 170199 INFO (jetty-launcher-848-thread-2) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 170200 INFO (jetty-launcher-848-thread-2) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 170200 INFO (jetty-launcher-848-thread-4) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 170200 INFO (jetty-launcher-848-thread-2) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 170203 INFO (jetty-launcher-848-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 170206 INFO (zkCallback-851-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@25129afd name:ZooKeeperConnection Watcher:127.0.0.1:35340/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 170206 INFO (jetty-launcher-848-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@56fa1cff{/solr,null,AVAILABLE}
[junit4] 2> 170207 INFO (jetty-launcher-848-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 170207 INFO (jetty-launcher-848-thread-2) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 170207 INFO (jetty-launcher-848-thread-1) [ ] o.e.j.s.ServerConnector Started ServerConnector@42a1b873{HTTP/1.1,[http/1.1]}{127.0.0.1:34662}
[junit4] 2> 170207 INFO (jetty-launcher-848-thread-1) [ ] o.e.j.s.Server Started @173394ms
[junit4] 2> 170207 INFO (jetty-launcher-848-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34662}
[junit4] 2> 170207 INFO (jetty-launcher-848-thread-1) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@6d06d69c
[junit4] 2> 170207 INFO (jetty-launcher-848-thread-1) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_CF545883CA66C15F-001/tempDir-001/node1'
[junit4] 2> 170207 INFO (jetty-launcher-848-thread-1) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 170208 INFO (jetty-launcher-848-thread-1) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 170208 INFO (jetty-launcher-848-thread-1) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 170209 INFO (jetty-launcher-848-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 170210 INFO (jetty-launcher-848-thread-4) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 170212 INFO (jetty-launcher-848-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1be65ce5{/solr,null,AVAILABLE}
[junit4] 2> 170213 INFO (jetty-launcher-848-thread-3) [ ] o.e.j.s.ServerConnector Started ServerConnector@6eb4fff{HTTP/1.1,[http/1.1]}{127.0.0.1:39176}
[junit4] 2> 170213 INFO (jetty-launcher-848-thread-3) [ ] o.e.j.s.Server Started @173400ms
[junit4] 2> 170213 INFO (jetty-launcher-848-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39176}
[junit4] 2> 170213 INFO (jetty-launcher-848-thread-3) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@6d06d69c
[junit4] 2> 170213 INFO (jetty-launcher-848-thread-3) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_CF545883CA66C15F-001/tempDir-001/node3'
[junit4] 2> 170213 INFO (jetty-launcher-848-thread-3) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 170213 INFO (jetty-launcher-848-thread-3) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 170214 INFO (jetty-launcher-848-thread-3) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 170214 INFO (jetty-launcher-848-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 170214 INFO (zkCallback-850-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@42028c1d name:ZooKeeperConnection Watcher:127.0.0.1:35340/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 170215 INFO (jetty-launcher-848-thread-4) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 170215 INFO (jetty-launcher-848-thread-4) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 170216 INFO (jetty-launcher-848-thread-3) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 170219 INFO (zkCallback-852-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@23f85088 name:ZooKeeperConnection Watcher:127.0.0.1:35340/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 170220 INFO (jetty-launcher-848-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 170220 INFO (jetty-launcher-848-thread-1) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 170220 INFO (jetty-launcher-848-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 170221 INFO (jetty-launcher-848-thread-4) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 170222 INFO (zkCallback-853-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@691a5874 name:ZooKeeperConnection Watcher:127.0.0.1:35340/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 170226 INFO (jetty-launcher-848-thread-3) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 170230 INFO (jetty-launcher-848-thread-3) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 170237 INFO (jetty-launcher-848-thread-1) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_CF545883CA66C15F-001/tempDir-001/node1/.
[junit4] 2> 170237 INFO (jetty-launcher-848-thread-1) [ ] o.a.s.c.CoreContainer New CoreContainer 17262990
[junit4] 2> 170237 INFO (jetty-launcher-848-thread-1) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_CF545883CA66C15F-001/tempDir-001/node1]
[junit4] 2> 170237 WARN (jetty-launcher-848-thread-1) [ ] o.a.s.c.CoreContainer Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_CF545883CA66C15F-001/tempDir-001/node1/lib to classpath: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_CF545883CA66C15F-001/tempDir-001/node1/lib
[junit4] 2> 170237 INFO (jetty-launcher-848-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 170237 INFO (jetty-launcher-848-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,
[junit4] 2> 170238 INFO (jetty-launcher-848-thread-4) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_CF545883CA66C15F-001/tempDir-001/node4/.
[junit4] 2> 170238 INFO (jetty-launcher-848-thread-4) [ ] o.a.s.c.CoreContainer New CoreContainer 65878365
[junit4] 2> 170238 INFO (jetty-launcher-848-thread-4) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_CF545883CA66C15F-001/tempDir-001/node4]
[junit4] 2> 170238 WARN (jetty-launcher-848-thread-4) [ ] o.a.s.c.CoreContainer Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_CF545883CA66C15F-001/tempDir-001/node4/lib to classpath: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_CF545883CA66C15F-001/tempDir-001/node4/lib
[junit4] 2> 170238 INFO (jetty-launcher-848-thread-4) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,
[junit4] 2> 170239 INFO (jetty-launcher-848-thread-1) [ ] o.a.s.u.UpdateShardHandler Created UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&maxConnections=100000&maxConnectionsPerHost=100000
[junit4] 2> 170239 INFO (jetty-launcher-848-thread-1) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 170239 INFO (jetty-launcher-848-thread-1) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 170239 INFO (jetty-launcher-848-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35340/solr
[junit4] 2> 170239 INFO (jetty-launcher-848-thread-1) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 170239 INFO (jetty-launcher-848-thread-1) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 170240 INFO (jetty-launcher-848-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 170240 INFO (jetty-launcher-848-thread-4) [ ] o.a.s.u.UpdateShardHandler Created UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&maxConnections=100000&maxConnectionsPerHost=100000
[junit4] 2> 170241 INFO (jetty-launcher-848-thread-4) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 170242 INFO (jetty-launcher-848-thread-4) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 170242 INFO (jetty-launcher-848-thread-4) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35340/solr
[junit4] 2> 170242 INFO (jetty-launcher-848-thread-4) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 170242 INFO (jetty-launcher-848-thread-4) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 170242 INFO (jetty-launcher-848-thread-4) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 170246 INFO (jetty-launcher-848-thread-2) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_CF545883CA66C15F-001/tempDir-001/node2/.
[junit4] 2> 170247 INFO (jetty-launcher-848-thread-2) [ ] o.a.s.c.CoreContainer New CoreContainer 118911097
[junit4] 2> 170247 INFO (jetty-launcher-848-thread-2) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_CF545883CA66C15F-001/tempDir-001/node2]
[junit4] 2> 170247 WARN (jetty-launcher-848-thread-2) [ ] o.a.s.c.CoreContainer Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_CF545883CA66C15F-001/tempDir-001/node2/lib to classpath: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_CF545883CA66C15F-001/tempDir-001/node2/lib
[junit4] 2> 170247 INFO (jetty-launcher-848-thread-2) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,
[junit4] 2> 170248 INFO (zkCallback-859-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@556d5732 name:ZooKeeperConnection Watcher:127.0.0.1:35340 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 170248 INFO (jetty-launcher-848-thread-4) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 170249 INFO (jetty-launcher-848-thread-4) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 170250 INFO (jetty-launcher-848-thread-2) [ ] o.a.s.u.UpdateShardHandler Created UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&maxConnections=100000&maxConnectionsPerHost=100000
[junit4] 2> 170250 INFO (jetty-launcher-848-thread-2) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 170250 INFO (jetty-launcher-848-thread-2) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 170250 INFO (jetty-launcher-848-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35340/solr
[junit4] 2> 170250 INFO (jetty-launcher-848-thread-2) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 170250 INFO (jetty-launcher-848-thread-2) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 170251 INFO (jetty-launcher-848-thread-2) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 170252 INFO (jetty-launcher-848-thread-4) [n:127.0.0.1:57902_solr ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$$Lambda$10/1750338284@51d80687
[junit4] 2> 170253 INFO (jetty-launcher-848-thread-4) [n:127.0.0.1:57902_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 170254 INFO (jetty-launcher-848-thread-3) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_CF545883CA66C15F-001/tempDir-001/node3/.
[junit4] 2> 170254 INFO (jetty-launcher-848-thread-3) [ ] o.a.s.c.CoreContainer New CoreContainer 138031843
[junit4] 2> 170254 INFO (jetty-launcher-848-thread-3) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_CF545883CA66C15F-001/tempDir-001/node3]
[junit4] 2> 170254 WARN (jetty-launcher-848-thread-3) [ ] o.a.s.c.CoreContainer Couldn't add files from /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_CF545883CA66C15F-001/tempDir-001/node3/lib to classpath: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_CF545883CA66C15F-001/tempDir-001/node3/lib
[junit4] 2> 170256 INFO (zkCallback-856-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@166ac228 name:ZooKeeperConnection Watcher:127.0.0.1:35340 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 170256 INFO (jetty-launcher-848-thread-3) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,
[junit4] 2> 170256 INFO (zkCallback-863-thread-1-processing-n:127.0.0.1:57902_solr) [n:127.0.0.1:57902_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3ca5b7b9 name:ZooKeeperConnection Watcher:127.0.0.1:35340/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 170257 INFO (jetty-launcher-848-thread-4) [n:127.0.0.1:57902_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 170257 INFO (jetty-launcher-848-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 170257 INFO (jetty-launcher-848-thread-1) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 170259 INFO (jetty-launcher-848-thread-3) [ ] o.a.s.u.UpdateShardHandler Created UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&maxConnections=100000&maxConnectionsPerHost=100000
[junit4] 2> 170259 INFO (jetty-launcher-848-thread-3) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 170259 INFO (jetty-launcher-848-thread-3) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 170259 INFO (jetty-launcher-848-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35340/solr
[junit4] 2> 170259 INFO (jetty-launcher-848-thread-3) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 170259 INFO (jetty-launcher-848-thread-3) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 170260 INFO (jetty-launcher-848-thread-3) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 170261 INFO (zkCallback-862-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@385956a4 name:ZooKeeperConnection Watcher:127.0.0.1:35340 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 170262 INFO (jetty-launcher-848-thread-2) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 170262 INFO (jetty-launcher-848-thread-2) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 170263 INFO (jetty-launcher-848-thread-4) [n:127.0.0.1:57902_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 170264 INFO (zkCallback-866-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1258093f name:ZooKeeperConnection Watcher:127.0.0.1:35340 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 170265 INFO (jetty-launcher-848-thread-3) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 170265 INFO (jetty-launcher-848-thread-3) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 170265 INFO (jetty-launcher-848-thread-1) [n:127.0.0.1:34662_solr ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$$Lambda$10/1750338284@3bee7112
[junit4] 2> 170266 INFO (jetty-launcher-848-thread-1) [n:127.0.0.1:34662_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 170266 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:58494_solr ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$$Lambda$10/1750338284@22fe2b64
[junit4] 2> 170266 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:58494_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 170268 INFO (jetty-launcher-848-thread-3) [n:127.0.0.1:39176_solr ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$$Lambda$10/1750338284@2894df15
[junit4] 2> 170269 INFO (jetty-launcher-848-thread-3) [n:127.0.0.1:39176_solr ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 170269 INFO (jetty-launcher-848-thread-4) [n:127.0.0.1:57902_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 170270 INFO (zkCallback-868-thread-1-processing-n:127.0.0.1:58494_solr) [n:127.0.0.1:58494_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@35a731ee name:ZooKeeperConnection Watcher:127.0.0.1:35340/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 170270 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:58494_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 170272 INFO (zkCallback-867-thread-1-processing-n:127.0.0.1:34662_solr) [n:127.0.0.1:34662_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@17758396 name:ZooKeeperConnection Watcher:127.0.0.1:35340/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 170272 INFO (zkCallback-869-thread-1-processing-n:127.0.0.1:39176_solr) [n:127.0.0.1:39176_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@eef47b8 name:ZooKeeperConnection Watcher:127.0.0.1:35340/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 170272 INFO (jetty-launcher-848-thread-3) [n:127.0.0.1:39176_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 170272 INFO (jetty-launcher-848-thread-1) [n:127.0.0.1:34662_solr ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 170279 INFO (jetty-launcher-848-thread-4) [n:127.0.0.1:57902_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 170279 INFO (jetty-launcher-848-thread-1) [n:127.0.0.1:34662_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 170279 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:58494_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 170283 INFO (jetty-launcher-848-thread-1) [n:127.0.0.1:34662_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 170283 INFO (jetty-launcher-848-thread-4) [n:127.0.0.1:57902_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 170285 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:58494_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 170286 INFO (jetty-launcher-848-thread-3) [n:127.0.0.1:39176_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 170288 INFO (jetty-launcher-848-thread-4) [n:127.0.0.1:57902_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 170289 INFO (jetty-launcher-848-thread-1) [n:127.0.0.1:34662_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 170292 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:58494_solr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 170292 INFO (jetty-launcher-848-thread-1) [n:127.0.0.1:34662_solr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 170292 INFO (jetty-launcher-848-thread-3) [n:127.0.0.1:39176_solr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 170293 INFO (jetty-launcher-848-thread-3) [n:127.0.0.1:39176_solr ] o.a.s.c.c.SolrZkClient makePath: /collections
[junit4] 2> 170294 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:58494_solr ] o.a.s.c.c.SolrZkClient makePath: /collections
[junit4] 2> 170295 INFO (jetty-launcher-848-thread-1) [n:127.0.0.1:34662_solr ] o.a.s.c.c.SolrZkClient makePath: /collections
[junit4] 2> 170295 INFO (jetty-launcher-848-thread-4) [n:127.0.0.1:57902_solr ] o.a.s.c.c.SolrZkClient makePath: /collections
[junit4] 2> 170296 INFO (jetty-launcher-848-thread-3) [n:127.0.0.1:39176_solr ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 170296 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:58494_solr ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 170297 INFO (jetty-launcher-848-thread-1) [n:127.0.0.1:34662_solr ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 170298 INFO (jetty-launcher-848-thread-3) [n:127.0.0.1:39176_solr ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 170299 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:58494_solr ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 170299 INFO (jetty-launcher-848-thread-1) [n:127.0.0.1:34662_solr ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 170301 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:58494_solr ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 170301 INFO (jetty-launcher-848-thread-3) [n:127.0.0.1:39176_solr ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 170301 INFO (jetty-launcher-848-thread-4) [n:127.0.0.1:57902_solr ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 170302 INFO (jetty-launcher-848-thread-1) [n:127.0.0.1:34662_solr ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 170303 INFO (jetty-launcher-848-thread-3) [n:127.0.0.1:39176_solr ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 170303 INFO (jetty-launcher-848-thread-1) [n:127.0.0.1:34662_solr ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 170303 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:58494_solr ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 170305 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:58494_solr ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
[junit4] 2> 170306 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:58494_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
[junit4] 2> 170308 INFO (jetty-launcher-848-thread-1) [n:127.0.0.1:34662_solr ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
[junit4] 2> 170309 INFO (jetty-launcher-848-thread-3) [n:127.0.0.1:39176_solr ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
[junit4] 2> 170309 INFO (jetty-launcher-848-thread-4) [n:127.0.0.1:57902_solr ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 170310 INFO (jetty-launcher-848-thread-1) [n:127.0.0.1:34662_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
[junit4] 2> 170310 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:58494_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 170311 INFO (jetty-launcher-848-thread-3) [n:127.0.0.1:39176_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
[junit4] 2> 170312 INFO (jetty-launcher-848-thread-4) [n:127.0.0.1:57902_solr ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
[junit4] 2> 170313 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:58494_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 170314 INFO (jetty-launcher-848-thread-4) [n:127.0.0.1:57902_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
[junit4] 2> 170316 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:58494_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 170316 INFO (jetty-launcher-848-thread-1) [n:127.0.0.1:34662_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 170316 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:58494_solr ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/96280136924397579-127.0.0.1:58494_solr-n_0000000000
[junit4] 2> 170317 INFO (jetty-launcher-848-thread-1) [n:127.0.0.1:34662_solr ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/96280136924397578-127.0.0.1:34662_solr-n_0000000001
[junit4] 2> 170317 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:58494_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:58494_solr
[junit4] 2> 170317 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:58494_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 170318 INFO (jetty-launcher-848-thread-1) [n:127.0.0.1:34662_solr ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/96280136924397579-127.0.0.1:58494_solr-n_0000000000 to know if I could be the leader
[junit4] 2> 170319 INFO (jetty-launcher-848-thread-3) [n:127.0.0.1:39176_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 170319 INFO (jetty-launcher-848-thread-1) [n:127.0.0.1:34662_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34662_solr
[junit4] 2> 170319 INFO (jetty-launcher-848-thread-1) [n:127.0.0.1:34662_solr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:34662_solr
[junit4] 2> 170320 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:58494_solr ] o.a.s.c.Overseer Overseer (id=96280136924397579-127.0.0.1:58494_solr-n_0000000000) starting
[junit4] 2> 170320 INFO (jetty-launcher-848-thread-3) [n:127.0.0.1:39176_solr ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/96280136924397580-127.0.0.1:39176_solr-n_0000000002
[junit4] 2> 170321 INFO (jetty-launcher-848-thread-3) [n:127.0.0.1:39176_solr ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/96280136924397578-127.0.0.1:34662_solr-n_0000000001 to know if I could be the leader
[junit4] 2> 170321 INFO (jetty-launcher-848-thread-3) [n:127.0.0.1:39176_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39176_solr
[junit4] 2> 170321 INFO (jetty-launcher-848-thread-3) [n:127.0.0.1:39176_solr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:39176_solr
[junit4] 2> 170323 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:58494_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 170324 INFO (zkCallback-863-thread-1-processing-n:127.0.0.1:57902_solr) [n:127.0.0.1:57902_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
[junit4] 2> 170324 INFO (zkCallback-869-thread-1-processing-n:127.0.0.1:39176_solr) [n:127.0.0.1:39176_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
[junit4] 2> 170330 INFO (jetty-launcher-848-thread-4) [n:127.0.0.1:57902_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 170331 INFO (jetty-launcher-848-thread-4) [n:127.0.0.1:57902_solr ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/96280136924397576-127.0.0.1:57902_solr-n_0000000003
[junit4] 2> 170331 INFO (zkCallback-863-thread-1-processing-n:127.0.0.1:57902_solr) [n:127.0.0.1:57902_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 170332 INFO (zkCallback-869-thread-1-processing-n:127.0.0.1:39176_solr) [n:127.0.0.1:39176_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 170332 INFO (zkCallback-867-thread-1-processing-n:127.0.0.1:34662_solr) [n:127.0.0.1:34662_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
[junit4] 2> 170333 INFO (zkCallback-868-thread-1-processing-n:127.0.0.1:58494_solr) [n:127.0.0.1:58494_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
[junit4] 2> 170336 INFO (zkCallback-867-thread-1-processing-n:127.0.0.1:34662_solr) [n:127.0.0.1:34662_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 170342 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:58494_solr ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 170343 INFO (OverseerCollectionConfigSetProcessor-96280136924397579-127.0.0.1:58494_solr-n_0000000000) [n:127.0.0.1:58494_solr ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 170343 INFO (OverseerStateUpdate-96280136924397579-127.0.0.1:58494_solr-n_0000000000) [n:127.0.0.1:58494_solr ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 170343 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:58494_solr ] o.a.s.c.ZkController Publish node=127.0.0.1:58494_solr as DOWN
[junit4] 2> 170346 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:58494_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58494_solr
[junit4] 2> 170346 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:58494_solr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:58494_solr
[junit4] 2> 170347 INFO (OverseerStateUpdate-96280136924397579-127.0.0.1:58494_solr-n_0000000000) [n:127.0.0.1:58494_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 170349 INFO (zkCallback-868-thread-2-processing-n:127.0.0.1:58494_solr) [n:127.0.0.1:58494_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [2])
[junit4] 2> 170349 INFO (zkCallback-869-thread-1-processing-n:127.0.0.1:39176_solr) [n:127.0.0.1:39176_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [2])
[junit4] 2> 170350 INFO (zkCallback-867-thread-1-processing-n:127.0.0.1:34662_solr) [n:127.0.0.1:34662_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [2])
[junit4] 2> 170350 INFO (zkCallback-869-thread-1-processing-n:127.0.0.1:39176_solr) [n:127.0.0.1:39176_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 170350 INFO (zkCallback-867-thread-1-processing-n:127.0.0.1:34662_solr) [n:127.0.0.1:34662_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 170350 INFO (zkCallback-868-thread-2-processing-n:127.0.0.1:58494_solr) [n:127.0.0.1:58494_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 170350 INFO (jetty-launcher-848-thread-3) [n:127.0.0.1:39176_solr ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 170350 INFO (jetty-launcher-848-thread-3) [n:127.0.0.1:39176_solr ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 170351 INFO (OverseerStateUpdate-96280136924397579-127.0.0.1:58494_solr-n_0000000000) [n:127.0.0.1:58494_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"downnode",
[junit4] 2> "node_name":"127.0.0.1:58494_solr"} current state version: 0
[junit4] 2> 170351 INFO (OverseerStateUpdate-96280136924397579-127.0.0.1:58494_solr-n_0000000000) [n:127.0.0.1:58494_solr ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:58494_solr
[junit4] 2> 170352 INFO (jetty-launcher-848-thread-3) [n:127.0.0.1:39176_solr ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_CF545883CA66C15F-001/tempDir-001/node3/.
[junit4] 2> 170352 INFO (jetty-launcher-848-thread-3) [n:127.0.0.1:39176_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
[junit4] 2> 170353 INFO (zkCallback-863-thread-1-processing-n:127.0.0.1:57902_solr) [n:127.0.0.1:57902_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [2])
[junit4] 2> 170354 INFO (jetty-launcher-848-thread-3) [n:127.0.0.1:39176_solr ] o.a.s.s.SolrDispatchFilter user.dir=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1
[junit4] 2> 170354 INFO (jetty-launcher-848-thread-3) [n:127.0.0.1:39176_solr ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 170354 INFO (zkCallback-863-thread-1-processing-n:127.0.0.1:57902_solr) [n:127.0.0.1:57902_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 170354 INFO (jetty-launcher-848-thread-4) [n:127.0.0.1:57902_solr ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/96280136924397580-127.0.0.1:39176_solr-n_0000000002 to know if I could be the leader
[junit4] 2> 170355 INFO (jetty-launcher-848-thread-4) [n:127.0.0.1:57902_solr ] o.a.s.c.ZkController Publish node=127.0.0.1:57902_solr as DOWN
[junit4] 2> 170356 INFO (jetty-launcher-848-thread-4) [n:127.0.0.1:57902_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57902_solr
[junit4] 2> 170356 INFO (jetty-launcher-848-thread-4) [n:127.0.0.1:57902_solr ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:57902_solr
[junit4] 2> 170357 INFO (zkCallback-863-thread-1-processing-n:127.0.0.1:57902_solr) [n:127.0.0.1:57902_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
[junit4] 2> 170357 INFO (zkCallback-869-thread-1-processing-n:127.0.0.1:39176_solr) [n:127.0.0.1:39176_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
[junit4] 2> 170357 INFO (zkCallback-867-thread-1-processing-n:127.0.0.1:34662_solr) [n:127.0.0.1:34662_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
[junit4] 2> 170358 INFO (zkCallback-869-thread-1-processing-n:127.0.0.1:39176_solr) [n:127.0.0.1:39176_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 170358 INFO (zkCallback-863-thread-1-processing-n:127.0.0.1:57902_solr) [n:127.0.0.1:57902_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 170358 INFO (zkCallback-867-thread-1-processing-n:127.0.0.1:34662_solr) [n:127.0.0.1:34662_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 170361 INFO (zkCallback-868-thread-1-processing-n:127.0.0.1:58494_solr) [n:127.0.0.1:58494_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
[junit4] 2> 170362 INFO (zkCallback-868-thread-1-processing-n:127.0.0.1:58494_solr) [n:127.0.0.1:58494_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 170362 INFO (OverseerStateUpdate-96280136924397579-127.0.0.1:58494_solr-n_0000000000) [n:127.0.0.1:58494_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"downnode",
[junit4] 2> "node_name":"127.0.0.1:57902_solr"} current state version: 0
[junit4] 2> 170362 INFO (OverseerStateUpdate-96280136924397579-127.0.0.1:58494_solr-n_0000000000) [n:127.0.0.1:58494_solr ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:57902_solr
[junit4] 2> 170370 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:58494_solr ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 170370 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:58494_solr ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 170371 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:58494_solr ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_CF545883CA66C15F-001/tempDir-001/node2/.
[junit4] 2> 170371 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:58494_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
[junit4] 2> 170372 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:58494_solr ] o.a.s.s.SolrDispatchFilter user.dir=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1
[junit4] 2> 170372 INFO (jetty-launcher-848-thread-2) [n:127.0.0.1:58494_solr ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 170381 INFO (jetty-launcher-848-thread-1) [n:127.0.0.1:34662_solr ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 170381 INFO (jetty-launcher-848-thread-1) [n:127.0.0.1:34662_solr ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 170382 INFO (jetty-launcher-848-thread-1) [n:127.0.0.1:34662_solr ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_CF545883CA66C15F-001/tempDir-001/node1/.
[junit4] 2> 170382 INFO (jetty-launcher-848-thread-1) [n:127.0.0.1:34662_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
[junit4] 2> 170385 INFO (jetty-launcher-848-thread-1) [n:127.0.0.1:34662_solr ] o.a.s.s.SolrDispatchFilter user.dir=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1
[junit4] 2> 170385 INFO (jetty-launcher-848-thread-1) [n:127.0.0.1:34662_solr ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 170385 INFO (jetty-launcher-848-thread-4) [n:127.0.0.1:57902_solr ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 170386 INFO (jetty-launcher-848-thread-4) [n:127.0.0.1:57902_solr ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 170387 INFO (jetty-launcher-848-thread-4) [n:127.0.0.1:57902_solr ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_CF545883CA66C15F-001/tempDir-001/node4/.
[junit4] 2> 170387 INFO (jetty-launcher-848-thread-4) [n:127.0.0.1:57902_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
[junit4] 2> 170389 INFO (jetty-launcher-848-thread-4) [n:127.0.0.1:57902_solr ] o.a.s.s.SolrDispatchFilter user.dir=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1
[junit4] 2> 170389 INFO (jetty-launcher-848-thread-4) [n:127.0.0.1:57902_solr ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 170389 INFO (SUITE-TestCollectionStateWatchers-seed#[CF545883CA66C15F]-worker) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 170390 INFO (SUITE-TestCollectionStateWatchers-seed#[CF545883CA66C15F]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 170394 INFO (zkCallback-874-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4f8637f0 name:ZooKeeperConnection Watcher:127.0.0.1:35340 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 170394 INFO (SUITE-TestCollectionStateWatchers-seed#[CF545883CA66C15F]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 170395 INFO (SUITE-TestCollectionStateWatchers-seed#[CF545883CA66C15F]-worker) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 170398 INFO (SUITE-TestCollectionStateWatchers-seed#[CF545883CA66C15F]-worker) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 170398 INFO (SUITE-TestCollectionStateWatchers-seed#[CF545883CA66C15F]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 170401 INFO (zkCallback-877-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1ded48e6 name:ZooKeeperConnection Watcher:127.0.0.1:35340/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 170401 INFO (SUITE-TestCollectionStateWatchers-seed#[CF545883CA66C15F]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 170401 INFO (SUITE-TestCollectionStateWatchers-seed#[CF545883CA66C15F]-worker) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 170401 INFO (SUITE-TestCollectionStateWatchers-seed#[CF545883CA66C15F]-worker) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 170403 INFO (SUITE-TestCollectionStateWatchers-seed#[CF545883CA66C15F]-worker) [ ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
[junit4] 2> 170404 INFO (SUITE-TestCollectionStateWatchers-seed#[CF545883CA66C15F]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 170406 INFO (SUITE-TestCollectionStateWatchers-seed#[CF545883CA66C15F]-worker) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/config/solrconfig.xml
[junit4] 2> 170412 INFO (SUITE-TestCollectionStateWatchers-seed#[CF545883CA66C15F]-worker) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/config/solrconfig-sql.xml
[junit4] 2> 170441 INFO (SUITE-TestCollectionStateWatchers-seed#[CF545883CA66C15F]-worker) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/config/schema-replication1.xml
[junit4] 2> 170445 INFO (SUITE-TestCollectionStateWatchers-seed#[CF545883CA66C15F]-worker) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/config/solrconfig-managed-schema.xml
[junit4] 2> 170448 INFO (SUITE-TestCollectionStateWatchers-seed#[CF545883CA66C15F]-worker) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/config/schema-sql.xml
[junit4] 2> 170450 INFO (SUITE-TestCollectionStateWatchers-seed#[CF545883CA66C15F]-worker) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/config/solrconfig-slave1.xml
[junit4] 2> 170453 INFO (SUITE-TestCollectionStateWatchers-seed#[CF545883CA66C15F]-worker) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/config/schema.xml
[junit4] 2> 170640 INFO (TEST-TestCollectionStateWatchers.testWaitForStateChecksCurrentState-seed#[CF545883CA66C15F]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testWaitForStateChecksCurrentState
[junit4] 2> 170640 INFO (TEST-TestCollectionStateWatchers.testWaitForStateChecksCurrentState-seed#[CF545883CA66C15F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 170640 INFO (TEST-TestCollectionStateWatchers.testWaitForStateChecksCurrentState-seed#[CF545883CA66C15F]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 170642 INFO (zkCallback-878-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2e17c82a name:ZooKeeperConnection Watcher:127.0.0.1:35340 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 170642 INFO (TEST-TestCollectionStateWatchers.testWaitForStateChecksCurrentState-seed#[CF545883CA66C15F]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 170642 INFO (TEST-TestCollectionStateWatchers.testWaitForStateChecksCurrentState-seed#[CF545883CA66C15F]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 170652 INFO (qtp1343390010-2584) [n:127.0.0.1:39176_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params async=b96d57d6-137b-4a12-9cb0-3710d97e55d3&replicationFactor=1&collection.configName=config&name=waitforstate&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 170655 INFO (qtp1343390010-2584) [n:127.0.0.1:39176_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={async=b96d57d6-137b-4a12-9cb0-3710d97e55d3&replicationFactor=1&collection.configName=config&name=waitforstate&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=3
[junit4] 2> 170657 INFO (OverseerCollectionConfigSetProcessor-96280136924397579-127.0.0.1:58494_solr-n_0000000000) [n:127.0.0.1:58494_solr ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running/mn-b96d57d6-137b-4a12-9cb0-3710d97e55d3
[junit4] 2> 170659 INFO (OverseerCollectionConfigSetProcessor-96280136924397579-127.0.0.1:58494_solr-n_0000000000) [n:127.0.0.1:58494_solr ] o.a.s.c.OverseerTaskProcessor Overseer Collection Message Handler: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "name":"waitforstate",
[junit4] 2> "fromApi":"true",
[junit4] 2> "replicationFactor":"1",
[junit4] 2> "collection.configName":"config",
[junit4] 2> "numShards":"1",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "async":"b96d57d6-137b-4a12-9cb0-3710d97e55d3",
[junit4] 2> "operation":"create"}
[junit4] 2> 170659 INFO (qtp1343390010-2587) [n:127.0.0.1:39176_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b96d57d6-137b-4a12-9cb0-3710d97e55d3&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 170660 INFO (OverseerThreadFactory-589-thread-1-processing-n:127.0.0.1:58494_solr) [n:127.0.0.1:58494_solr ] o.a.s.c.OverseerCollectionMessageHandler OverseerCollectionMessageHandler.processMessage : create , {
[junit4] 2> "name":"waitforstate",
[junit4] 2> "fromApi":"true",
[junit4] 2> "replicationFactor":"1",
[junit4] 2> "collection.configName":"config",
[junit4] 2> "numShards":"1",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "async":"b96d57d6-137b-4a12-9cb0-3710d97e55d3",
[junit4] 2> "operation":"create"}
[junit4] 2> 170660 INFO (OverseerThreadFactory-589-thread-1-processing-n:127.0.0.1:58494_solr) [n:127.0.0.1:58494_solr ] o.a.s.c.OverseerCollectionMessageHandler Create collection waitforstate
[junit4] 2> 170661 INFO (OverseerThreadFactory-589-thread-1-processing-n:127.0.0.1:58494_solr) [n:127.0.0.1:58494_solr ] o.a.s.c.OverseerCollectionMessageHandler creating collections conf node /collections/waitforstate
[junit4] 2> 170661 INFO (OverseerThreadFactory-589-thread-1-processing-n:127.0.0.1:58494_solr) [n:127.0.0.1:58494_solr ] o.a.s.c.c.SolrZkClient makePath: /collections/waitforstate
[junit4] 2> 170662 INFO (qtp1343390010-2587) [n:127.0.0.1:39176_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b96d57d6-137b-4a12-9cb0-3710d97e55d3&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=3
[junit4] 2> 170663 INFO (zkCallback-867-thread-1-processing-n:127.0.0.1:34662_solr) [n:127.0.0.1:34662_solr ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
[junit4] 2> 170663 INFO (zkCallback-869-thread-1-processing-n:127.0.0.1:39176_solr) [n:127.0.0.1:39176_solr ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
[junit4] 2> 170663 INFO (zkCallback-868-thread-1-processing-n:127.0.0.1:58494_solr) [n:127.0.0.1:58494_solr ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
[junit4] 2> 170664 INFO (zkCallback-863-thread-1-processing-n:127.0.0.1:57902_solr) [n:127.0.0.1:57902_solr ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
[junit4] 2> 170664 INFO (zkCallback-877-thread-1) [ ] o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/collections], has occurred - updating...
[junit4] 2> 170667 INFO (OverseerStateUpdate-96280136924397579-127.0.0.1:58494_solr-n_0000000000) [n:127.0.0.1:58494_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "name":"waitforstate",
[junit4] 2> "fromApi":"true",
[junit4] 2> "replicationFactor":"1",
[junit4] 2> "collection.configName":"config",
[junit4] 2> "numShards":"1",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "async":"b96d57d6-137b-4a12-9cb0-3710d97e55d3",
[junit4] 2> "operation":"create"} current state version: 0
[junit4] 2> 170667 INFO (OverseerStateUpdate-96280136924397579-127.0.0.1:58494_solr-n_0000000000) [n:127.0.0.1:58494_solr ] o.a.s.c.o.ClusterStateMutator building a new cName: waitforstate
[junit4] 2> 170668 INFO (OverseerStateUpdate-96280136924397579-127.0.0.1:58494_solr-n_0000000000) [n:127.0.0.1:58494_solr ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/waitforstate/state.json
[junit4] 2> 170767 INFO (OverseerThreadFactory-589-thread-1-processing-n:127.0.0.1:58494_solr) [n:127.0.0.1:58494_solr ] o.a.s.c.OverseerCollectionMessageHandler Creating SolrCores for new collection waitforstate, shardNames [shard1] , replicationFactor : 1
[junit4] 2> 170767 INFO (OverseerThreadFactory-589-thread-1-processing-n:127.0.0.1:58494_solr) [n:127.0.0.1:58494_solr ] o.a.s.c.OverseerCollectionMessageHandler Creating core waitforstate_shard1_replica1 as part of shard shard1 of collection waitforstate on 127.0.0.1:58494_solr
[junit4] 2> 170774 INFO (qtp172499141-2556) [n:127.0.0.1:58494_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={async=b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264&qt=/admin/cores&collection.configName=config&name=waitforstate_shard1_replica1&action=CREATE&numShards=1&collection=waitforstate&shard=shard1&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 170774 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr ] o.a.s.h.a.CoreAdminOperation core create command async=b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264&qt=/admin/cores&collection.configName=config&name=waitforstate_shard1_replica1&action=CREATE&numShards=1&collection=waitforstate&shard=shard1&wt=javabin&version=2
[junit4] 2> 170775 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=waitforstate_shard1_replica1, collection.configName=config, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=waitforstate, numShards=1, dataDir=data/, shard=shard1}
[junit4] 2> 170775 INFO (qtp172499141-2557) [n:127.0.0.1:58494_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264
[junit4] 2> 170775 INFO (qtp172499141-2557) [n:127.0.0.1:58494_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 170776 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.c.ZkController publishing state=down
[junit4] 2> 170778 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.c.ZkController Registering watch for collection waitforstate
[junit4] 2> 170778 INFO (OverseerStateUpdate-96280136924397579-127.0.0.1:58494_solr-n_0000000000) [n:127.0.0.1:58494_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"waitforstate_shard1_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:58494/solr",
[junit4] 2> "node_name":"127.0.0.1:58494_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"waitforstate",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 170778 INFO (OverseerStateUpdate-96280136924397579-127.0.0.1:58494_solr-n_0000000000) [n:127.0.0.1:58494_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"waitforstate_shard1_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:58494/solr",
[junit4] 2> "node_name":"127.0.0.1:58494_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"waitforstate",
[junit4] 2> "operation":"state"}
[junit4] 2> 170778 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.c.c.ZkStateReader Add data for [waitforstate] ver [0]
[junit4] 2> 170779 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.c.ZkController look for our core node name
[junit4] 2> 170882 INFO (OverseerStateUpdate-96280136924397579-127.0.0.1:58494_solr-n_0000000000) [n:127.0.0.1:58494_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/waitforstate/state.json version: 0
[junit4] 2> 170883 INFO (zkCallback-868-thread-3-processing-n:127.0.0.1:58494_solr) [n:127.0.0.1:58494_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/waitforstate/state.json] for collection [waitforstate] has occurred - updating... (live nodes size: [4])
[junit4] 2> 170884 INFO (zkCallback-868-thread-3-processing-n:127.0.0.1:58494_solr) [n:127.0.0.1:58494_solr ] o.a.s.c.c.ZkStateReader Updating data for [waitforstate] from [0] to [1]
[junit4] 2> 171665 INFO (qtp1343390010-2588) [n:127.0.0.1:39176_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=b96d57d6-137b-4a12-9cb0-3710d97e55d3&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 171667 INFO (qtp1343390010-2588) [n:127.0.0.1:39176_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=b96d57d6-137b-4a12-9cb0-3710d97e55d3&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=2
[junit4] 2> 171784 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.c.ZkController waiting to find shard id in clusterstate for waitforstate_shard1_replica1
[junit4] 2> 171785 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.c.ZkController Check for collection zkNode:waitforstate
[junit4] 2> 171785 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.c.ZkController Collection zkNode exists
[junit4] 2> 171785 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/waitforstate]
[junit4] 2> 171786 INFO (qtp172499141-2558) [n:127.0.0.1:58494_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264
[junit4] 2> 171786 INFO (qtp172499141-2558) [n:127.0.0.1:58494_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 171786 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.c.c.ZkStateReader path=[/collections/waitforstate] [configName]=[config] specified config exists in ZooKeeper
[junit4] 2> 171786 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_CF545883CA66C15F-001/tempDir-001/node2/waitforstate_shard1_replica1'
[junit4] 2> 171787 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 171787 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 171788 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.c.Config loaded config solrconfig.xml with version 0
[junit4] 2> 171793 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.c.SolrConfig current version of requestparams : -1
[junit4] 2> 171795 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
[junit4] 2> 171805 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
[junit4] 2> 171810 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.s.IndexSchema [waitforstate_shard1_replica1] Schema name=test
[junit4] 2> 171883 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.s.IndexSchema default search field in schema is text
[junit4] 2> 171884 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.s.IndexSchema unique key field: id
[junit4] 2> 171885 WARN (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.s.IndexSchema Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
[junit4] 2> 171886 WARN (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (3)
[junit4] 2> 171888 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/config', cwd=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1
[junit4] 2> 171888 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 x:waitforstate_shard1_replica1] o.a.s.c.CoreContainer Creating SolrCore 'waitforstate_shard1_replica1' using configuration from collection waitforstate
[junit4] 2> 171888 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 171888 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.SolrCore [[waitforstate_shard1_replica1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_CF545883CA66C15F-001/tempDir-001/node2/waitforstate_shard1_replica1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_CF545883CA66C15F-001/tempDir-001/node2/./waitforstate_shard1_replica1/data/]
[junit4] 2> 171888 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.SolrCore JMX monitoring not detected for core: waitforstate_shard1_replica1
[junit4] 2> 171889 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.CachingDirectoryFactory return new directory for /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_CF545883CA66C15F-001/tempDir-001/node2/./waitforstate_shard1_replica1/data
[junit4] 2> 171889 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.SolrCore New index directory detected: old=null new=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_CF545883CA66C15F-001/tempDir-001/node2/./waitforstate_shard1_replica1/data/index/
[junit4] 2> 171889 WARN (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.SolrCore [waitforstate_shard1_replica1] Solr index directory '/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_CF545883CA66C15F-001/tempDir-001/node2/./waitforstate_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 171889 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.CachingDirectoryFactory return new directory for /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_CF545883CA66C15F-001/tempDir-001/node2/./waitforstate_shard1_replica1/data/index
[junit4] 2> 171890 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1871d1fc lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4309af36),segFN=segments_1,generation=1}
[junit4] 2> 171890 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 171890 INFO (OldIndexDirectoryCleanupThreadForCore-waitforstate_shard1_replica1) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core waitforstate_shard1_replica1 in /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_CF545883CA66C15F-001/tempDir-001/node2/./waitforstate_shard1_replica1/data/
[junit4] 2> 171890 WARN (OldIndexDirectoryCleanupThreadForCore-waitforstate_shard1_replica1) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.DirectoryFactory /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_CF545883CA66C15F-001/tempDir-001/node2/./waitforstate_shard1_replica1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
[junit4] 2> 171892 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 171894 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 171896 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 171897 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 171898 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
[junit4] 2> 171900 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,,/update/json/docs,/admin/luke,/export,/get,/admin/properties,/update/json,/admin/threads,/update/csv,/sql,/graph,/admin/segments,/admin/system,/replication,/config,/stream,/schema,/admin/plugins,/admin/logging,/admin/ping,/update,/admin/file,/terms
[junit4] 2> 171900 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 171901 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 171901 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 171902 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 171902 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 171903 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1871d1fc lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4309af36),segFN=segments_1,generation=1}
[junit4] 2> 171903 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
[junit4] 2> 171903 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.s.SolrIndexSearcher Opening [Searcher@119a1ec0[waitforstate_shard1_replica1] main]
[junit4] 2> 171903 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/waitforstate]
[junit4] 2> 171904 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1] o.a.s.c.c.ZkStateReader path=[/collections/waitforstate] [configName]=[config] specified config exists in ZooKeeper
[junit4] 2> 171905 INFO (parallelCoreAdminExecutor-592-thread-1-processing-n:127.0.0.1:58494_solr b96d57d6-137b-4a12-9cb0-3710d97e55d31472483166818264 CREATE) [n:127.0.0.1:58494_solr c:waitforstate s:shard1 r:core_node1 x:waitforstate_shard1_replica1]
[...truncated too long message...]
rver.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 202046 INFO (zkCallback-902-thread-1-processing-n:127.0.0.1:39176_solr) [n:127.0.0.1:39176_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 202046 INFO (zkCallback-867-thread-5-processing-n:127.0.0.1:34662_solr) [n:127.0.0.1:34662_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 202048 INFO (zkCallback-863-thread-2-processing-n:127.0.0.1:57902_solr) [n:127.0.0.1:57902_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [4])
[junit4] 2> 202048 INFO (zkCallback-863-thread-2-processing-n:127.0.0.1:57902_solr) [n:127.0.0.1:57902_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 202080 INFO (jetty-launcher-848-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1357976d{/solr,null,UNAVAILABLE}
[junit4] 2> 202086 INFO (zkCallback-863-thread-2-processing-n:127.0.0.1:57902_solr) [n:127.0.0.1:57902_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
[junit4] 2> 202087 INFO (zkCallback-902-thread-1-processing-n:127.0.0.1:39176_solr) [n:127.0.0.1:39176_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
[junit4] 2> 202087 WARN (zkCallback-902-thread-1-processing-n:127.0.0.1:39176_solr) [n:127.0.0.1:39176_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 202087 INFO (zkCallback-867-thread-5-processing-n:127.0.0.1:34662_solr) [n:127.0.0.1:34662_solr ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
[junit4] 2> 202090 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x1560e46404e0008, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 203575 WARN (zkCallback-902-thread-2-processing-n:127.0.0.1:39176_solr) [n:127.0.0.1:39176_solr ] o.a.s.c.LeaderElector
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:331)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:328)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:328)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:105)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:56)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:348)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.lambda$process$0(SolrZkClient.java:266)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 203576 INFO (jetty-launcher-848-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6ee8d288{/solr,null,UNAVAILABLE}
[junit4] 2> 203587 WARN (zkCallback-863-thread-2-processing-n:127.0.0.1:57902_solr) [n:127.0.0.1:57902_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 203587 INFO (jetty-launcher-848-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@161702c9{/solr,null,UNAVAILABLE}
[junit4] 2> 203588 WARN (zkCallback-867-thread-5-processing-n:127.0.0.1:34662_solr) [n:127.0.0.1:34662_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 203588 INFO (jetty-launcher-848-thread-4) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@56fa1cff{/solr,null,UNAVAILABLE}
[junit4] 2> 203590 INFO (SUITE-TestCollectionStateWatchers-seed#[CF545883CA66C15F]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:35340 35340
[junit4] 2> 203641 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxnFactory Ignoring unexpected runtime exception
[junit4] 2> java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.readyOps(SelectionKeyImpl.java:87)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:187)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 203642 INFO (Thread-316) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:35340 35340
[junit4] 2> 203644 WARN (Thread-316) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 8 /solr/aliases.json
[junit4] 2> 8 /solr/clusterprops.json
[junit4] 2> 7 /solr/security.json
[junit4] 2> 7 /solr/configs/config
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 12 /solr/collections/waitforstate/state.json
[junit4] 2> 8 /solr/clusterstate.json
[junit4] 2> 7 /solr/collections/falsepredicate/state.json
[junit4] 2> 7 /solr/collections/testcollection/state.json
[junit4] 2> 2 /solr/overseer_elect/election/96280136924397578-127.0.0.1:34662_solr-n_0000000001
[junit4] 2> 2 /solr/collections/currentstate/state.json
[junit4] 2> 2 /solr/overseer_elect/election/96280136924397576-127.0.0.1:57902_solr-n_0000000003
[junit4] 2> 2 /solr/collections/delayed/state.json
[junit4] 2> 2 /solr/collections/tobedeleted/state.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 62 /solr/overseer/queue
[junit4] 2> 18 /solr/overseer/queue-work
[junit4] 2> 12 /solr/overseer/collection-queue-work
[junit4] 2> 8 /solr/collections
[junit4] 2> 5 /solr/live_nodes
[junit4] 2>
[junit4] 2> 203644 INFO (SUITE-TestCollectionStateWatchers-seed#[CF545883CA66C15F]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_CF545883CA66C15F-001
[junit4] 2> Jul 21, 2016 4:25:33 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene62): {}, docValues:{}, maxPointsInLeafNode=1170, maxMBSortInHeap=5.700057142081769, sim=ClassicSimilarity, locale=ru-RU, timezone=America/Argentina/Cordoba
[junit4] 2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_92 (64-bit)/cpus=3,threads=1,free=59385912,total=128520192
[junit4] 2> NOTE: All tests run in this JVM: [StreamExpressionTest, TestJsonRecordReader, SolrExampleBinaryTest, SolrExampleStreamingBinaryTest, NoOpResponseParserTest, DocumentAnalysisResponseTest, TestSuggesterResponse, GraphTest, TestNamedListCodec, LargeVolumeEmbeddedTest, SolrPingTest, AnlysisResponseBaseTest, ConcurrentUpdateSolrClientBuilderTest, SolrParamTest, CommonParamsTest, TestZkConfigManager, TestCloudSolrClientConnections, ContentStreamTest, SolrExampleJettyTest, LargeVolumeJettyTest, SolrExampleEmbeddedTest, LargeVolumeBinaryJettyTest, TestSpellCheckResponse, TestSolrProperties, MergeIndexesEmbeddedTest, TestEmbeddedSolrServer, QueryResponseTest, TestJavaBinCodec, SolrQueryTest, ModifiableSolrParamsTest, TestFastInputStream, SolrDocumentTest, SolrExceptionTest, ClientUtilsTest, NamedListTest, FacetFieldTest, CollectionAdminRequestRequiredParamsTest, GetByIdTest, TestLBHttpSolrClient, HttpSolrClientBuilderTest, GraphExpressionTest, TestCollectionStateWatchers]
[junit4] Completed [83/83 (1!)] on J1 in 33.85s, 9 tests, 1 failure <<< FAILURES!
[...truncated 59421 lines...]