You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2016/04/17 17:18:03 UTC
[JENKINS-EA] Lucene-Solr-master-Linux (64bit/jdk-9-ea+113) - Build
# 16527 - Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/16527/
Java: 64bit/jdk-9-ea+113 -XX:-UseCompressedOops -XX:+UseParallelGC -XX:-CompactStrings
1 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestStressLiveNodes
Error Message:
Clean up static fields (in @AfterClass?) and null them, your test still has references to classes of which the sizes cannot be measured due to security restrictions or Java 9 module encapsulation: - private static org.apache.solr.client.solrj.impl.CloudSolrClient org.apache.solr.cloud.TestStressLiveNodes.CLOUD_CLIENT
Stack Trace:
junit.framework.AssertionFailedError: Clean up static fields (in @AfterClass?) and null them, your test still has references to classes of which the sizes cannot be measured due to security restrictions or Java 9 module encapsulation:
- private static org.apache.solr.client.solrj.impl.CloudSolrClient org.apache.solr.cloud.TestStressLiveNodes.CLOUD_CLIENT
at __randomizedtesting.SeedInfo.seed([2EE780E8403A3657]:0)
at com.carrotsearch.randomizedtesting.rules.StaticFieldsInvariantRule$1.afterAlways(StaticFieldsInvariantRule.java:146)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(java.base@9-ea/Thread.java:804)
Caused by: java.lang.IllegalStateException: Unable to access 'private final java.lang.reflect.Layer java.lang.reflect.Module.layer' to estimate memory usage
at com.carrotsearch.randomizedtesting.rules.RamUsageEstimator.createCacheEntry(RamUsageEstimator.java:602)
at com.carrotsearch.randomizedtesting.rules.RamUsageEstimator.measureSizeOf(RamUsageEstimator.java:545)
at com.carrotsearch.randomizedtesting.rules.RamUsageEstimator.sizeOfAll(RamUsageEstimator.java:387)
at com.carrotsearch.randomizedtesting.rules.StaticFieldsInvariantRule$1.afterAlways(StaticFieldsInvariantRule.java:129)
... 10 more
Caused by: java.lang.reflect.InaccessibleObjectException: Cannot make a non-public member of class java.lang.reflect.Module accessible
at sun.reflect.Reflection.throwInaccessibleObjectException(java.base@9-ea/Reflection.java:420)
at java.lang.reflect.AccessibleObject.checkCanSetAccessible(java.base@9-ea/AccessibleObject.java:190)
at java.lang.reflect.Field.checkCanSetAccessible(java.base@9-ea/Field.java:170)
at java.lang.reflect.Field.setAccessible(java.base@9-ea/Field.java:164)
at com.carrotsearch.randomizedtesting.rules.RamUsageEstimator$3.run(RamUsageEstimator.java:597)
at com.carrotsearch.randomizedtesting.rules.RamUsageEstimator$3.run(RamUsageEstimator.java:594)
at java.security.AccessController.doPrivileged(java.base@9-ea/Native Method)
at com.carrotsearch.randomizedtesting.rules.RamUsageEstimator.createCacheEntry(RamUsageEstimator.java:594)
... 13 more
Build Log:
[...truncated 12100 lines...]
[junit4] Suite: org.apache.solr.cloud.TestStressLiveNodes
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressLiveNodes_2EE780E8403A3657-001/init-core-data-001
[junit4] 2> 1666912 INFO (SUITE-TestStressLiveNodes-seed#[2EE780E8403A3657]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
[junit4] 2> 1666912 INFO (SUITE-TestStressLiveNodes-seed#[2EE780E8403A3657]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1666913 INFO (Thread-4125) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1666913 INFO (Thread-4125) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1667013 INFO (SUITE-TestStressLiveNodes-seed#[2EE780E8403A3657]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:43050
[junit4] 2> 1667013 INFO (SUITE-TestStressLiveNodes-seed#[2EE780E8403A3657]-worker) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1667013 INFO (SUITE-TestStressLiveNodes-seed#[2EE780E8403A3657]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667015 INFO (zkCallback-1688-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@539ce518 name:ZooKeeperConnection Watcher:127.0.0.1:43050 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667015 INFO (SUITE-TestStressLiveNodes-seed#[2EE780E8403A3657]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667015 INFO (SUITE-TestStressLiveNodes-seed#[2EE780E8403A3657]-worker) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1667015 INFO (SUITE-TestStressLiveNodes-seed#[2EE780E8403A3657]-worker) [ ] o.a.s.c.c.SolrZkClient makePath: /solr/solr.xml
[junit4] 2> 1667016 INFO (jetty-launcher-1687-thread-1) [ ] o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 1667017 INFO (jetty-launcher-1687-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@e836771{/solr,null,AVAILABLE}
[junit4] 2> 1667017 INFO (jetty-launcher-1687-thread-1) [ ] o.e.j.s.ServerConnector Started ServerConnector@4116f09d{HTTP/1.1,[http/1.1]}{127.0.0.1:٣٣٢٦٣}
[junit4] 2> 1667017 INFO (jetty-launcher-1687-thread-1) [ ] o.e.j.s.Server Started @١٦٦٩٢٥٢ms
[junit4] 2> 1667017 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33263}
[junit4] 2> 1667018 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): jdk.internal.loader.ClassLoaders$AppClassLoader@725bef66
[junit4] 2> 1667018 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressLiveNodes_2EE780E8403A3657-001/tempDir-001/node1'
[junit4] 2> 1667018 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1667018 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 1667018 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1667018 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667019 INFO (zkCallback-1689-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@18c42975 name:ZooKeeperConnection Watcher:127.0.0.1:43050/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667019 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667019 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1667019 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1667023 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressLiveNodes_2EE780E8403A3657-001/tempDir-001/node1/.
[junit4] 2> 1667023 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.CoreContainer New CoreContainer 1246352441
[junit4] 2> 1667023 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressLiveNodes_2EE780E8403A3657-001/tempDir-001/node1]
[junit4] 2> 1667024 WARN (jetty-launcher-1687-thread-1) [ ] o.a.s.c.CoreContainer Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressLiveNodes_2EE780E8403A3657-001/tempDir-001/node1/lib to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressLiveNodes_2EE780E8403A3657-001/tempDir-001/node1/lib
[junit4] 2> 1667024 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,
[junit4] 2> 1667025 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params:
[junit4] 2> 1667025 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1667025 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1667025 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43050/solr
[junit4] 2> 1667026 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 1667026 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1667026 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667027 INFO (zkCallback-1692-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@185a75a4 name:ZooKeeperConnection Watcher:127.0.0.1:43050 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667027 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667027 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1667028 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$$Lambda$81/1343099241@5ba7cdb6
[junit4] 2> 1667028 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667028 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@640d19b1 name:ZooKeeperConnection Watcher:127.0.0.1:43050/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667028 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667029 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 1667029 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 1667030 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 1667031 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 1667032 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 1667032 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 1667032 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /collections
[junit4] 2> 1667033 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 1667033 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 1667034 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 1667034 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1667034 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
[junit4] 2> 1667035 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 1667035 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 1667036 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1667036 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95741940838105091-127.0.0.1:33263_solr-n_0000000000
[junit4] 2> 1667036 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:33263_solr
[junit4] 2> 1667036 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 1667036 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.Overseer Overseer (id=95741940838105091-127.0.0.1:33263_solr-n_0000000000) starting
[junit4] 2> 1667037 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 1667039 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 1667040 INFO (OverseerCollectionConfigSetProcessor-95741940838105091-127.0.0.1:33263_solr-n_0000000000) [ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 1667040 INFO (OverseerStateUpdate-95741940838105091-127.0.0.1:33263_solr-n_0000000000) [ ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 1667040 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33263_solr
[junit4] 2> 1667040 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:33263_solr
[junit4] 2> 1667041 INFO (OverseerStateUpdate-95741940838105091-127.0.0.1:33263_solr-n_0000000000) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
[junit4] 2> 1667041 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
[junit4] 2> 1667041 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1667046 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 1667046 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 1667047 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressLiveNodes_2EE780E8403A3657-001/tempDir-001/node1/.
[junit4] 2> 1667047 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
[junit4] 2> 1667047 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.s.SolrDispatchFilter user.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1
[junit4] 2> 1667047 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 1667047 INFO (SUITE-TestStressLiveNodes-seed#[2EE780E8403A3657]-worker) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1667048 INFO (SUITE-TestStressLiveNodes-seed#[2EE780E8403A3657]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667048 INFO (zkCallback-1694-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@69a6a956 name:ZooKeeperConnection Watcher:127.0.0.1:43050 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667048 INFO (SUITE-TestStressLiveNodes-seed#[2EE780E8403A3657]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667048 INFO (SUITE-TestStressLiveNodes-seed#[2EE780E8403A3657]-worker) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1667049 INFO (SUITE-TestStressLiveNodes-seed#[2EE780E8403A3657]-worker) [ ] o.a.s.c.s.i.CloudSolrClient Final constructed zkHost string: 127.0.0.1:43050/solr
[junit4] 2> 1667052 INFO (SUITE-TestStressLiveNodes-seed#[2EE780E8403A3657]-worker) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1667052 INFO (SUITE-TestStressLiveNodes-seed#[2EE780E8403A3657]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667053 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5e1c7cfc name:ZooKeeperConnection Watcher:127.0.0.1:43050/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667053 INFO (SUITE-TestStressLiveNodes-seed#[2EE780E8403A3657]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667053 INFO (SUITE-TestStressLiveNodes-seed#[2EE780E8403A3657]-worker) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1667053 INFO (SUITE-TestStressLiveNodes-seed#[2EE780E8403A3657]-worker) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 1667054 INFO (SUITE-TestStressLiveNodes-seed#[2EE780E8403A3657]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1667062 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testStress
[junit4] 2> 1667063 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1667063 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667063 INFO (zkCallback-1697-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@31d219cc name:ZooKeeperConnection Watcher:127.0.0.1:43050/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667063 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667063 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1667064 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1)
[junit4] 2> 1667064 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.TestStressLiveNodes preparing parallel adds to live nodes: iter=0, numThreads=3 numNodesPerThread=5
[junit4] 2> 1667065 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1667065 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667065 INFO (zkCallback-1698-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6fa7cfca name:ZooKeeperConnection Watcher:127.0.0.1:43050/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667065 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667065 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1667066 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1667066 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667067 INFO (zkCallback-1699-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@666d7a1c name:ZooKeeperConnection Watcher:127.0.0.1:43050/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667067 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667067 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1667067 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1667067 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667068 INFO (zkCallback-1700-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@f3dd0ac name:ZooKeeperConnection Watcher:127.0.0.1:43050/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667068 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667068 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1667068 INFO (test_live_nodes_thrasher_iter0-4967-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T0_0-0
[junit4] 2> 1667068 INFO (test_live_nodes_thrasher_iter0-4967-thread-2) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T0_1-0
[junit4] 2> 1667068 INFO (test_live_nodes_thrasher_iter0-4967-thread-3) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T0_2-0
[junit4] 2> 1667069 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1667069 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1667069 INFO (test_live_nodes_thrasher_iter0-4967-thread-2) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T0_1-1
[junit4] 2> 1667069 INFO (test_live_nodes_thrasher_iter0-4967-thread-3) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T0_2-1
[junit4] 2> 1667069 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (4)
[junit4] 2> 1667069 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (4)
[junit4] 2> 1667069 INFO (test_live_nodes_thrasher_iter0-4967-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T0_0-1
[junit4] 2> 1667070 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [4])
[junit4] 2> 1667070 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [4])
[junit4] 2> 1667070 INFO (test_live_nodes_thrasher_iter0-4967-thread-2) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T0_1-2
[junit4] 2> 1667070 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (6)
[junit4] 2> 1667070 INFO (test_live_nodes_thrasher_iter0-4967-thread-3) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T0_2-2
[junit4] 2> 1667070 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (6)
[junit4] 2> 1667070 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [6])
[junit4] 2> 1667070 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [6])
[junit4] 2> 1667070 INFO (test_live_nodes_thrasher_iter0-4967-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T0_0-2
[junit4] 2> 1667070 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (6) -> (9)
[junit4] 2> 1667070 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (6) -> (9)
[junit4] 2> 1667070 INFO (test_live_nodes_thrasher_iter0-4967-thread-3) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T0_2-3
[junit4] 2> 1667071 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [9])
[junit4] 2> 1667071 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [9])
[junit4] 2> 1667071 INFO (test_live_nodes_thrasher_iter0-4967-thread-2) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T0_1-3
[junit4] 2> 1667071 INFO (test_live_nodes_thrasher_iter0-4967-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T0_0-3
[junit4] 2> 1667071 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (9) -> (10)
[junit4] 2> 1667071 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (9) -> (10)
[junit4] 2> 1667071 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [10])
[junit4] 2> 1667071 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [10])
[junit4] 2> 1667071 INFO (test_live_nodes_thrasher_iter0-4967-thread-3) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T0_2-4
[junit4] 2> 1667071 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (10) -> (11)
[junit4] 2> 1667071 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (10) -> (12)
[junit4] 2> 1667071 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [11])
[junit4] 2> 1667071 INFO (test_live_nodes_thrasher_iter0-4967-thread-2) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T0_1-4
[junit4] 2> 1667071 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [12])
[junit4] 2> 1667071 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (11) -> (13)
[junit4] 2> 1667071 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (12) -> (13)
[junit4] 2> 1667071 INFO (test_live_nodes_thrasher_iter0-4967-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T0_0-4
[junit4] 2> 1667072 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [13])
[junit4] 2> 1667072 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [13])
[junit4] 2> 1667072 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (13) -> (14)
[junit4] 2> 1667072 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [14])
[junit4] 2> 1667072 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (13) -> (15)
[junit4] 2> 1667072 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (14) -> (15)
[junit4] 2> 1667072 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [15])
[junit4] 2> 1667072 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [15])
[junit4] 2> 1667072 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (15) -> (16)
[junit4] 2> 1667072 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (15) -> (16)
[junit4] 2> 1667072 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1667073 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667073 INFO (zkCallback-1701-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@387539b0 name:ZooKeeperConnection Watcher:127.0.0.1:43050/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667073 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667073 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1667074 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [16])
[junit4] 2> 1667074 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [16])
[junit4] 2> 1667074 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (16) -> (11)
[junit4] 2> 1667074 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (16) -> (6)
[junit4] 2> 1667074 INFO (zkCallback-1696-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [11])
[junit4] 2> 1667075 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [6])
[junit4] 2> 1667075 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1667075 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15424c9b5c30009, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(java.base@9-ea/Thread.java:804)
[junit4] 2> 1667075 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667075 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (6) -> (1)
[junit4] 2> 1667075 INFO (zkCallback-1696-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (11) -> (1)
[junit4] 2> 1667076 INFO (zkCallback-1702-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2583e5ca name:ZooKeeperConnection Watcher:127.0.0.1:43050/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667076 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667076 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1667076 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1)
[junit4] 2> 1667076 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.TestStressLiveNodes preparing parallel adds to live nodes: iter=1, numThreads=3 numNodesPerThread=5
[junit4] 2> 1667076 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1667077 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667077 INFO (zkCallback-1703-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@b0789fa name:ZooKeeperConnection Watcher:127.0.0.1:43050/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667077 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667077 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1667077 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1667077 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667078 INFO (zkCallback-1704-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3acf9ad3 name:ZooKeeperConnection Watcher:127.0.0.1:43050/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667078 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667078 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1667078 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1667078 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667079 INFO (zkCallback-1705-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@bc13d66 name:ZooKeeperConnection Watcher:127.0.0.1:43050/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667079 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667079 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1667079 INFO (test_live_nodes_thrasher_iter1-4968-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T1_0-0
[junit4] 2> 1667079 INFO (test_live_nodes_thrasher_iter1-4968-thread-2) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T1_1-0
[junit4] 2> 1667079 INFO (test_live_nodes_thrasher_iter1-4968-thread-3) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T1_2-0
[junit4] 2> 1667080 INFO (zkCallback-1696-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1667080 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1667080 INFO (test_live_nodes_thrasher_iter1-4968-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T1_0-1
[junit4] 2> 1667080 INFO (zkCallback-1696-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (4)
[junit4] 2> 1667080 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (4)
[junit4] 2> 1667080 INFO (test_live_nodes_thrasher_iter1-4968-thread-2) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T1_1-1
[junit4] 2> 1667080 INFO (test_live_nodes_thrasher_iter1-4968-thread-3) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T1_2-1
[junit4] 2> 1667080 INFO (zkCallback-1696-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [4])
[junit4] 2> 1667080 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [4])
[junit4] 2> 1667080 INFO (test_live_nodes_thrasher_iter1-4968-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T1_0-2
[junit4] 2> 1667080 INFO (zkCallback-1696-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (6)
[junit4] 2> 1667080 INFO (zkCallback-1696-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [6])
[junit4] 2> 1667080 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (7)
[junit4] 2> 1667081 INFO (test_live_nodes_thrasher_iter1-4968-thread-2) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T1_1-2
[junit4] 2> 1667081 INFO (zkCallback-1696-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (6) -> (7)
[junit4] 2> 1667081 INFO (zkCallback-1696-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [7])
[junit4] 2> 1667081 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [7])
[junit4] 2> 1667081 INFO (test_live_nodes_thrasher_iter1-4968-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T1_0-3
[junit4] 2> 1667081 INFO (test_live_nodes_thrasher_iter1-4968-thread-3) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T1_2-2
[junit4] 2> 1667081 INFO (zkCallback-1696-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (7) -> (8)
[junit4] 2> 1667081 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (7) -> (8)
[junit4] 2> 1667081 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [8])
[junit4] 2> 1667081 INFO (zkCallback-1696-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [8])
[junit4] 2> 1667081 INFO (test_live_nodes_thrasher_iter1-4968-thread-2) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T1_1-3
[junit4] 2> 1667081 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (8) -> (10)
[junit4] 2> 1667081 INFO (zkCallback-1696-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (8) -> (10)
[junit4] 2> 1667081 INFO (test_live_nodes_thrasher_iter1-4968-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T1_0-4
[junit4] 2> 1667081 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [10])
[junit4] 2> 1667081 INFO (zkCallback-1696-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [10])
[junit4] 2> 1667082 INFO (test_live_nodes_thrasher_iter1-4968-thread-3) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T1_2-3
[junit4] 2> 1667082 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (10) -> (11)
[junit4] 2> 1667082 INFO (zkCallback-1696-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (10) -> (11)
[junit4] 2> 1667082 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [11])
[junit4] 2> 1667082 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [11])
[junit4] 2> 1667082 INFO (test_live_nodes_thrasher_iter1-4968-thread-2) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T1_1-4
[junit4] 2> 1667082 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (11) -> (13)
[junit4] 2> 1667082 INFO (zkCallback-1696-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [13])
[junit4] 2> 1667082 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (11) -> (13)
[junit4] 2> 1667082 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [13])
[junit4] 2> 1667082 INFO (zkCallback-1696-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (13) -> (14)
[junit4] 2> 1667082 INFO (test_live_nodes_thrasher_iter1-4968-thread-3) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T1_2-4
[junit4] 2> 1667083 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (13) -> (14)
[junit4] 2> 1667083 INFO (zkCallback-1696-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [14])
[junit4] 2> 1667083 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [14])
[junit4] 2> 1667083 INFO (zkCallback-1696-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (14) -> (15)
[junit4] 2> 1667083 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (14) -> (15)
[junit4] 2> 1667083 INFO (zkCallback-1696-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [15])
[junit4] 2> 1667083 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [15])
[junit4] 2> 1667083 INFO (zkCallback-1696-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (15) -> (16)
[junit4] 2> 1667083 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (15) -> (16)
[junit4] 2> 1667083 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1667083 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667084 INFO (zkCallback-1706-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@e2050d5 name:ZooKeeperConnection Watcher:127.0.0.1:43050/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667084 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667084 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1667085 INFO (zkCallback-1696-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [16])
[junit4] 2> 1667085 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [16])
[junit4] 2> 1667085 INFO (zkCallback-1696-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (16) -> (11)
[junit4] 2> 1667085 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [11])
[junit4] 2> 1667085 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (16) -> (6)
[junit4] 2> 1667085 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (11) -> (6)
[junit4] 2> 1667085 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [6])
[junit4] 2> 1667085 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [6])
[junit4] 2> 1667085 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1667085 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (6) -> (1)
[junit4] 2> 1667085 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (6) -> (1)
[junit4] 2> 1667085 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667086 INFO (zkCallback-1707-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@398ea12c name:ZooKeeperConnection Watcher:127.0.0.1:43050/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667086 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667086 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1667087 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1)
[junit4] 2> 1667087 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.TestStressLiveNodes preparing parallel adds to live nodes: iter=2, numThreads=5 numNodesPerThread=2
[junit4] 2> 1667087 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1667087 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667088 INFO (zkCallback-1708-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@39d2323a name:ZooKeeperConnection Watcher:127.0.0.1:43050/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667088 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667088 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1667088 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1667088 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667088 INFO (zkCallback-1709-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3f993683 name:ZooKeeperConnection Watcher:127.0.0.1:43050/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667088 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667089 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1667089 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1667089 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667089 INFO (zkCallback-1710-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2acf9045 name:ZooKeeperConnection Watcher:127.0.0.1:43050/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667089 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667089 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1667090 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1667090 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667090 INFO (zkCallback-1711-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@44be3369 name:ZooKeeperConnection Watcher:127.0.0.1:43050/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667090 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667090 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1667091 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1667091 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667091 INFO (zkCallback-1712-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4664fe5a name:ZooKeeperConnection Watcher:127.0.0.1:43050/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667091 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667091 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1667091 INFO (test_live_nodes_thrasher_iter2-4969-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T2_0-0
[junit4] 2> 1667092 INFO (test_live_nodes_thrasher_iter2-4969-thread-2) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T2_1-0
[junit4] 2> 1667092 INFO (test_live_nodes_thrasher_iter2-4969-thread-3) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T2_2-0
[junit4] 2> 1667092 INFO (test_live_nodes_thrasher_iter2-4969-thread-4) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T2_3-0
[junit4] 2> 1667092 INFO (test_live_nodes_thrasher_iter2-4969-thread-5) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T2_4-0
[junit4] 2> 1667092 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1667092 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
[junit4] 2> 1667092 INFO (test_live_nodes_thrasher_iter2-4969-thread-2) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T2_1-1
[junit4] 2> 1667092 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1667092 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
[junit4] 2> 1667092 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (5)
[junit4] 2> 1667093 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (6)
[junit4] 2> 1667093 INFO (test_live_nodes_thrasher_iter2-4969-thread-3) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T2_2-1
[junit4] 2> 1667093 INFO (test_live_nodes_thrasher_iter2-4969-thread-5) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T2_4-1
[junit4] 2> 1667093 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [5])
[junit4] 2> 1667093 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [6])
[junit4] 2> 1667092 INFO (test_live_nodes_thrasher_iter2-4969-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T2_0-1
[junit4] 2> 1667093 INFO (test_live_nodes_thrasher_iter2-4969-thread-4) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T2_3-1
[junit4] 2> 1667093 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (7)
[junit4] 2> 1667093 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (6) -> (7)
[junit4] 2> 1667093 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [7])
[junit4] 2> 1667093 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [7])
[junit4] 2> 1667093 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (7) -> (9)
[junit4] 2> 1667093 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (7) -> (9)
[junit4] 2> 1667093 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [9])
[junit4] 2> 1667093 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [9])
[junit4] 2> 1667094 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (9) -> (11)
[junit4] 2> 1667094 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (9) -> (11)
[junit4] 2> 1667094 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1667094 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667095 INFO (zkCallback-1713-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5eb0602f name:ZooKeeperConnection Watcher:127.0.0.1:43050/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667095 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667095 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1667095 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [11])
[junit4] 2> 1667095 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [11])
[junit4] 2> 1667095 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (11) -> (9)
[junit4] 2> 1667096 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (11) -> (9)
[junit4] 2> 1667096 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [9])
[junit4] 2> 1667096 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [9])
[junit4] 2> 1667096 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (9) -> (7)
[junit4] 2> 1667096 INFO (zkCallback-1696-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [7])
[junit4] 2> 1667096 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (9) -> (5)
[junit4] 2> 1667096 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [5])
[junit4] 2> 1667096 INFO (zkCallback-1696-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (7) -> (3)
[junit4] 2> 1667096 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (3)
[junit4] 2> 1667096 INFO (zkCallback-1696-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
[junit4] 2> 1667096 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15424c9b5c30015, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(java.base@9-ea/Thread.java:804)
[junit4] 2> 1667096 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1667096 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
[junit4] 2> 1667097 INFO (zkCallback-1696-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (1)
[junit4] 2> 1667097 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (1)
[junit4] 2> 1667097 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667097 INFO (zkCallback-1714-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@65d423c5 name:ZooKeeperConnection Watcher:127.0.0.1:43050/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667098 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667098 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1667099 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1)
[junit4] 2> 1667099 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.TestStressLiveNodes preparing parallel adds to live nodes: iter=3, numThreads=3 numNodesPerThread=1
[junit4] 2> 1667099 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1667099 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667099 INFO (zkCallback-1715-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3a1a9ce3 name:ZooKeeperConnection Watcher:127.0.0.1:43050/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667099 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667100 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1667100 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1667100 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667100 INFO (zkCallback-1716-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@72a3ddec name:ZooKeeperConnection Watcher:127.0.0.1:43050/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667100 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667100 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1667100 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1667101 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667101 INFO (zkCallback-1717-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4905956 name:ZooKeeperConnection Watcher:127.0.0.1:43050/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667101 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667101 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1667101 INFO (test_live_nodes_thrasher_iter3-4970-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T3_0-0
[junit4] 2> 1667101 INFO (test_live_nodes_thrasher_iter3-4970-thread-2) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T3_1-0
[junit4] 2> 1667101 INFO (test_live_nodes_thrasher_iter3-4970-thread-3) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T3_2-0
[junit4] 2> 1667102 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1667102 INFO (zkCallback-1696-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1667102 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (4)
[junit4] 2> 1667102 INFO (zkCallback-1696-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (4)
[junit4] 2> 1667102 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1667102 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667103 INFO (zkCallback-1718-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2de54a64 name:ZooKeeperConnection Watcher:127.0.0.1:43050/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667103 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667103 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1667103 INFO (zkCallback-1696-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [4])
[junit4] 2> 1667103 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [4])
[junit4] 2> 1667104 INFO (zkCallback-1696-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 1667104 INFO (zkCallback-1696-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
[junit4] 2> 1667104 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (2)
[junit4] 2> 1667104 INFO (zkCallback-1696-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 1667104 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [2])
[junit4] 2> 1667104 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [2])
[junit4] 2> 1667104 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1667104 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 1667104 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 1667104 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667104 INFO (zkCallback-1719-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@41c5e162 name:ZooKeeperConnection Watcher:127.0.0.1:43050/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667105 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667105 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1667105 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1)
[junit4] 2> 1667105 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.TestStressLiveNodes preparing parallel adds to live nodes: iter=4, numThreads=2 numNodesPerThread=3
[junit4] 2> 1667105 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1667105 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667106 INFO (zkCallback-1720-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5a6d36a2 name:ZooKeeperConnection Watcher:127.0.0.1:43050/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667106 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667106 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1667106 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1667106 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667107 INFO (zkCallback-1721-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@27b5e257 name:ZooKeeperConnection Watcher:127.0.0.1:43050/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667107 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667107 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1667107 INFO (test_live_nodes_thrasher_iter4-4971-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T4_0-0
[junit4] 2> 1667107 INFO (test_live_nodes_thrasher_iter4-4971-thread-2) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T4_1-0
[junit4] 2> 1667107 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1667107 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1667107 INFO (test_live_nodes_thrasher_iter4-4971-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T4_0-1
[junit4] 2> 1667108 INFO (test_live_nodes_thrasher_iter4-4971-thread-2) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T4_1-1
[junit4] 2> 1667108 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
[junit4] 2> 1667108 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
[junit4] 2> 1667108 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
[junit4] 2> 1667108 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
[junit4] 2> 1667108 INFO (test_live_nodes_thrasher_iter4-4971-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T4_0-2
[junit4] 2> 1667108 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (5)
[junit4] 2> 1667108 INFO (test_live_nodes_thrasher_iter4-4971-thread-2) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T4_1-2
[junit4] 2> 1667108 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (5)
[junit4] 2> 1667108 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [5])
[junit4] 2> 1667108 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [5])
[junit4] 2> 1667109 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (7)
[junit4] 2> 1667109 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (7)
[junit4] 2> 1667109 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1667109 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667109 INFO (zkCallback-1722-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7699668 name:ZooKeeperConnection Watcher:127.0.0.1:43050/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667109 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667109 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1667110 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [7])
[junit4] 2> 1667110 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [7])
[junit4] 2> 1667111 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (7) -> (1)
[junit4] 2> 1667111 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (7) -> (1)
[junit4] 2> 1667111 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1667111 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667112 INFO (zkCallback-1723-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3aadea8b name:ZooKeeperConnection Watcher:127.0.0.1:43050/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667112 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667112 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1667112 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1)
[junit4] 2> 1667112 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.TestStressLiveNodes preparing parallel adds to live nodes: iter=5, numThreads=4 numNodesPerThread=2
[junit4] 2> 1667112 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1667113 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667113 INFO (zkCallback-1724-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@24758aeb name:ZooKeeperConnection Watcher:127.0.0.1:43050/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667113 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667113 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1667113 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1667113 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667114 INFO (zkCallback-1725-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@664f5e8c name:ZooKeeperConnection Watcher:127.0.0.1:43050/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667114 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667114 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1667114 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1667115 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667115 INFO (zkCallback-1726-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@68f1cf0c name:ZooKeeperConnection Watcher:127.0.0.1:43050/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667115 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667115 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1667115 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 1667115 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 1667116 INFO (zkCallback-1727-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@655da4e1 name:ZooKeeperConnection Watcher:127.0.0.1:43050/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1667116 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 1667116 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 1667116 INFO (test_live_nodes_thrasher_iter5-4972-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T5_0-0
[junit4] 2> 1667116 INFO (test_live_nodes_thrasher_iter5-4972-thread-2) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T5_1-0
[junit4] 2> 1667116 INFO (test_live_nodes_thrasher_iter5-4972-thread-3) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T5_2-0
[junit4] 2> 1667116 INFO (test_live_nodes_thrasher_iter5-4972-thread-4) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T5_3-0
[junit4] 2> 1667117 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1667117 INFO (zkCallback-1693-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1667117 INFO (test_live_nodes_thrasher_iter5-4972-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T5_0-1
[junit4] 2> 1667117 INFO (test_live_nodes_thrasher_iter5-4972-thread-2) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T5_1-1
[junit4] 2> 1667117 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (5)
[junit4] 2> 1667117 INFO (test_live_nodes_thrasher_iter5-4972-thread-4) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T5_3-1
[junit4] 2> 1667117 INFO (test_live_nodes_thrasher_iter5-4972-thread-3) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T5_2-1
[junit4] 2> 1667117 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [5])
[junit4] 2> 1667118 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (7)
[junit4] 2> 1667118 INFO (zkCallback-1696-thread-2) [ ] o.
[...truncated too long message...]
s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (9) -> (5)
[junit4] 2> 1710831 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [5])
[junit4] 2> 1710831 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [5])
[junit4] 2> 1710831 INFO (TEST-TestStressLiveNodes.testStress-seed#[2EE780E8403A3657]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testStress
[junit4] 2> 1710831 INFO (zkCallback-1696-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (1)
[junit4] 2> 1710831 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (1)
[junit4] 2> 1710832 INFO (jetty-launcher-1687-thread-1) [ ] o.e.j.s.ServerConnector Stopped ServerConnector@4116f09d{HTTP/1.1,[http/1.1]}{127.0.0.1:٠}
[junit4] 2> 1710832 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1246352441
[junit4] 2> 1710832 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.ZkController Publish node=127.0.0.1:33263_solr as DOWN
[junit4] 2> 1710833 INFO (jetty-launcher-1687-thread-1) [ ] o.a.s.c.Overseer Overseer (id=95741940838105091-127.0.0.1:33263_solr-n_0000000000) closing
[junit4] 2> 1710833 INFO (OverseerStateUpdate-95741940838105091-127.0.0.1:33263_solr-n_0000000000) [ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"downnode",
[junit4] 2> "node_name":"127.0.0.1:33263_solr"} current state version: 0
[junit4] 2> 1710833 INFO (OverseerStateUpdate-95741940838105091-127.0.0.1:33263_solr-n_0000000000) [ ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:33263_solr
[junit4] 2> 1710833 INFO (OverseerStateUpdate-95741940838105091-127.0.0.1:33263_solr-n_0000000000) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:33263_solr
[junit4] 2> 1710833 INFO (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 1710833 WARN (zkCallback-1693-thread-1) [ ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 1710834 INFO (jetty-launcher-1687-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@e836771{/solr,null,UNAVAILABLE}
[junit4] 2> 1710834 INFO (SUITE-TestStressLiveNodes-seed#[2EE780E8403A3657]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:43050 43050
[junit4] 2> 1710836 INFO (Thread-4125) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:43050 43050
[junit4] 2> 1710837 WARN (Thread-4125) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 2 /solr/aliases.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 2 /solr/clusterstate.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 2 /solr/live_nodes
[junit4] 2> 2 /solr/collections
[junit4] 2>
[junit4] 2> 1710837 INFO (SUITE-TestStressLiveNodes-seed#[2EE780E8403A3657]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> Apr 17, 2016 3:15:23 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 46 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60): {}, docValues:{}, maxPointsInLeafNode=1979, maxMBSortInHeap=5.939596460262455, sim=RandomSimilarity(queryNorm=true,coord=no): {}, locale=ar-SS, timezone=America/Edmonton
[junit4] 2> NOTE: Linux 4.2.0-34-generic amd64/Oracle Corporation 9-ea (64-bit)/cpus=12,threads=1,free=99459600,total=531103744
[junit4] 2> NOTE: All tests run in this JVM: [TestCloudSchemaless, TestSolrXml, SpatialFilterTest, TestFastLRUCache, CSVRequestHandlerTest, CdcrReplicationHandlerTest, TestDynamicFieldResource, SoftAutoCommitTest, TestFilteredDocIdSet, TestTrie, TestSha256AuthenticationProvider, DistributedMLTComponentTest, TestAnalyzeInfixSuggestions, TestShortCircuitedRequests, TestReloadDeadlock, CachingDirectoryFactoryTest, MultiTermTest, TestCodecSupport, SpatialHeatmapFacetsTest, TestDistribDocBasedVersion, DirectSolrSpellCheckerTest, TestQuerySenderListener, WordBreakSolrSpellCheckerTest, SpellingQueryConverterTest, DistanceFunctionTest, TestInitParams, SolrPluginUtilsTest, GraphQueryTest, SchemaVersionSpecificBehaviorTest, TestJsonRequest, SuggesterFSTTest, ChaosMonkeySafeLeaderTest, TestSortingResponseWriter, ShardRoutingTest, UpdateRequestProcessorFactoryTest, TestOverriddenPrefixQueryForCustomFieldType, AnalyticsMergeStrategyTest, DistributedIntervalFacetingTest, SortByFunctionTest, TestOrdValues, ZkControllerTest, DocValuesTest, TestBulkSchemaConcurrent, TestAuthenticationFramework, OpenCloseCoreStressTest, TestConfigReload, TestQueryTypes, TestDistributedGrouping, TestLFUCache, TolerantUpdateProcessorTest, TestDistributedStatsComponentCardinality, TestRestoreCore, SpellCheckComponentTest, SolrIndexSplitterTest, TestDFRSimilarityFactory, TestPartialUpdateDeduplication, IndexBasedSpellCheckerTest, HdfsChaosMonkeySafeLeaderTest, TestAddFieldRealTimeGet, TestPerFieldSimilarityWithDefaultOverride, TestOnReconnectListenerSupport, SegmentsInfoRequestHandlerTest, TestExceedMaxTermLength, TestFiltering, TestLRUStatsCache, TestEmbeddedSolrServerConstructors, DistributedFacetPivotSmallTest, NotRequiredUniqueKeyTest, ZkCLITest, ShardSplitTest, TestSchemaResource, TestDynamicLoading, ShardRoutingCustomTest, TestTestInjection, ChaosMonkeyNothingIsSafeTest, TestSolrCoreProperties, TestUpdate, TestDistribIDF, LeaderFailoverAfterPartitionTest, TestShardHandlerFactory, MigrateRouteKeyTest, MBeansHandlerTest, TimeZoneUtilsTest, TestCloudPivotFacet, TlogReplayBufferedWhileIndexingTest, CollectionReloadTest, CdcrUpdateLogTest, DocumentBuilderTest, OpenExchangeRatesOrgProviderTest, TestCoreContainer, SmileWriterTest, HdfsUnloadDistributedZkTest, DeleteShardTest, TestQuerySenderNoQuery, DistribCursorPagingTest, DistribDocExpirationUpdateProcessorTest, HttpPartitionTest, SSLMigrationTest, SharedFSAutoReplicaFailoverTest, SimpleCollectionCreateDeleteTest, TestDownShardTolerantSearch, TestExclusionRuleCollectionAccess, TestMiniSolrCloudClusterSSL, TestRandomRequestDistribution, TestSolrCloudWithKerberosAlt, TestStressLiveNodes]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestStressLiveNodes -Dtests.seed=2EE780E8403A3657 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar-SS -Dtests.timezone=America/Edmonton -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J1 | TestStressLiveNodes (suite) <<<
[junit4] > Throwable #1: junit.framework.AssertionFailedError: Clean up static fields (in @AfterClass?) and null them, your test still has references to classes of which the sizes cannot be measured due to security restrictions or Java 9 module encapsulation:
[junit4] > - private static org.apache.solr.client.solrj.impl.CloudSolrClient org.apache.solr.cloud.TestStressLiveNodes.CLOUD_CLIENT
[junit4] > at __randomizedtesting.SeedInfo.seed([2EE780E8403A3657]:0)
[junit4] > at java.lang.Thread.run(java.base@9-ea/Thread.java:804)
[junit4] > Caused by: java.lang.IllegalStateException: Unable to access 'private final java.lang.reflect.Layer java.lang.reflect.Module.layer' to estimate memory usage
[junit4] > ... 10 more
[junit4] > Caused by: java.lang.reflect.InaccessibleObjectException: Cannot make a non-public member of class java.lang.reflect.Module accessible
[junit4] > at java.lang.reflect.AccessibleObject.checkCanSetAccessible(java.base@9-ea/AccessibleObject.java:190)
[junit4] > at java.lang.reflect.Field.checkCanSetAccessible(java.base@9-ea/Field.java:170)
[junit4] > at java.lang.reflect.Field.setAccessible(java.base@9-ea/Field.java:164)
[junit4] > at java.security.AccessController.doPrivileged(java.base@9-ea/Native Method)
[junit4] > ... 13 more
[junit4] Completed [481/586 (1!)] on J1 in 44.46s, 1 test, 1 failure <<< FAILURES!
[...truncated 328 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:740: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:684: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:59: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build.xml:233: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/common-build.xml:529: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1457: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1014: There were test failures: 586 suites (10 ignored), 2359 tests, 1 suite-level error, 116 ignored (70 assumptions) [seed: 2EE780E8403A3657]
Total time: 59 minutes 3 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-master-Linux (64bit/jdk1.8.0_72) - Build #
16529 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/16529/
Java: 64bit/jdk1.8.0_72 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
No tests ran.
Build Log:
[...truncated 36 lines...]
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from git://git.apache.org/lucene-solr.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:810)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1066)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1097)
at hudson.scm.SCM.checkout(SCM.java:485)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1269)
at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:607)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:529)
at hudson.model.Run.execute(Run.java:1738)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:98)
at hudson.model.Executor.run(Executor.java:410)
Caused by: hudson.plugins.git.GitException: org.eclipse.jgit.api.errors.TransportException: Connection reset
at org.jenkinsci.plugins.gitclient.JGitAPIImpl$2.execute(JGitAPIImpl.java:639)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:808)
... 11 more
Caused by: org.eclipse.jgit.api.errors.TransportException: Connection reset
at org.eclipse.jgit.api.FetchCommand.call(FetchCommand.java:139)
at org.jenkinsci.plugins.gitclient.JGitAPIImpl$2.execute(JGitAPIImpl.java:637)
... 12 more
Caused by: org.eclipse.jgit.errors.TransportException: Connection reset
at org.eclipse.jgit.transport.BasePackConnection.readAdvertisedRefs(BasePackConnection.java:182)
at org.eclipse.jgit.transport.TransportGitAnon$TcpFetchConnection.<init>(TransportGitAnon.java:194)
at org.eclipse.jgit.transport.TransportGitAnon.openFetch(TransportGitAnon.java:120)
at org.eclipse.jgit.transport.FetchProcess.executeImp(FetchProcess.java:136)
at org.eclipse.jgit.transport.FetchProcess.execute(FetchProcess.java:122)
at org.eclipse.jgit.transport.Transport.fetch(Transport.java:1138)
at org.eclipse.jgit.api.FetchCommand.call(FetchCommand.java:130)
... 13 more
Caused by: java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:196)
at java.net.SocketInputStream.read(SocketInputStream.java:122)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:275)
at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
at org.eclipse.jgit.util.IO.readFully(IO.java:246)
at org.eclipse.jgit.transport.PacketLineIn.readLength(PacketLineIn.java:186)
at org.eclipse.jgit.transport.PacketLineIn.readString(PacketLineIn.java:138)
at org.eclipse.jgit.transport.BasePackConnection.readAdvertisedRefsImpl(BasePackConnection.java:195)
at org.eclipse.jgit.transport.BasePackConnection.readAdvertisedRefs(BasePackConnection.java:176)
... 19 more
ERROR: null
Retrying after 10 seconds
Fetching changes from the remote Git repository
Cleaning workspace
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from git://git.apache.org/lucene-solr.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:810)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1066)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1097)
at hudson.scm.SCM.checkout(SCM.java:485)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1269)
at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:607)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:529)
at hudson.model.Run.execute(Run.java:1738)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:98)
at hudson.model.Executor.run(Executor.java:410)
Caused by: hudson.plugins.git.GitException: org.eclipse.jgit.api.errors.TransportException: Connection reset
at org.jenkinsci.plugins.gitclient.JGitAPIImpl$2.execute(JGitAPIImpl.java:639)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:808)
... 11 more
Caused by: org.eclipse.jgit.api.errors.TransportException: Connection reset
at org.eclipse.jgit.api.FetchCommand.call(FetchCommand.java:139)
at org.jenkinsci.plugins.gitclient.JGitAPIImpl$2.execute(JGitAPIImpl.java:637)
... 12 more
Caused by: org.eclipse.jgit.errors.TransportException: Connection reset
at org.eclipse.jgit.transport.BasePackConnection.readAdvertisedRefs(BasePackConnection.java:182)
at org.eclipse.jgit.transport.TransportGitAnon$TcpFetchConnection.<init>(TransportGitAnon.java:194)
at org.eclipse.jgit.transport.TransportGitAnon.openFetch(TransportGitAnon.java:120)
at org.eclipse.jgit.transport.FetchProcess.executeImp(FetchProcess.java:136)
at org.eclipse.jgit.transport.FetchProcess.execute(FetchProcess.java:122)
at org.eclipse.jgit.transport.Transport.fetch(Transport.java:1138)
at org.eclipse.jgit.api.FetchCommand.call(FetchCommand.java:130)
... 13 more
Caused by: java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:196)
at java.net.SocketInputStream.read(SocketInputStream.java:122)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:275)
at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
at org.eclipse.jgit.util.IO.readFully(IO.java:246)
at org.eclipse.jgit.transport.PacketLineIn.readLength(PacketLineIn.java:186)
at org.eclipse.jgit.transport.PacketLineIn.readString(PacketLineIn.java:138)
at org.eclipse.jgit.transport.BasePackConnection.readAdvertisedRefsImpl(BasePackConnection.java:195)
at org.eclipse.jgit.transport.BasePackConnection.readAdvertisedRefs(BasePackConnection.java:176)
... 19 more
ERROR: null
Retrying after 10 seconds
Fetching changes from the remote Git repository
Cleaning workspace
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from git://git.apache.org/lucene-solr.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:810)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1066)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1097)
at hudson.scm.SCM.checkout(SCM.java:485)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1269)
at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:607)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:529)
at hudson.model.Run.execute(Run.java:1738)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:98)
at hudson.model.Executor.run(Executor.java:410)
Caused by: hudson.plugins.git.GitException: org.eclipse.jgit.api.errors.TransportException: Connection reset
at org.jenkinsci.plugins.gitclient.JGitAPIImpl$2.execute(JGitAPIImpl.java:639)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:808)
... 11 more
Caused by: org.eclipse.jgit.api.errors.TransportException: Connection reset
at org.eclipse.jgit.api.FetchCommand.call(FetchCommand.java:139)
at org.jenkinsci.plugins.gitclient.JGitAPIImpl$2.execute(JGitAPIImpl.java:637)
... 12 more
Caused by: org.eclipse.jgit.errors.TransportException: Connection reset
at org.eclipse.jgit.transport.BasePackConnection.readAdvertisedRefs(BasePackConnection.java:182)
at org.eclipse.jgit.transport.TransportGitAnon$TcpFetchConnection.<init>(TransportGitAnon.java:194)
at org.eclipse.jgit.transport.TransportGitAnon.openFetch(TransportGitAnon.java:120)
at org.eclipse.jgit.transport.FetchProcess.executeImp(FetchProcess.java:136)
at org.eclipse.jgit.transport.FetchProcess.execute(FetchProcess.java:122)
at org.eclipse.jgit.transport.Transport.fetch(Transport.java:1138)
at org.eclipse.jgit.api.FetchCommand.call(FetchCommand.java:130)
... 13 more
Caused by: java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:196)
at java.net.SocketInputStream.read(SocketInputStream.java:122)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:275)
at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
at org.eclipse.jgit.util.IO.readFully(IO.java:246)
at org.eclipse.jgit.transport.PacketLineIn.readLength(PacketLineIn.java:186)
at org.eclipse.jgit.transport.PacketLineIn.readString(PacketLineIn.java:138)
at org.eclipse.jgit.transport.BasePackConnection.readAdvertisedRefsImpl(BasePackConnection.java:195)
at org.eclipse.jgit.transport.BasePackConnection.readAdvertisedRefs(BasePackConnection.java:176)
... 19 more
ERROR: null
Retrying after 10 seconds
Fetching changes from the remote Git repository
Cleaning workspace
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from git://git.apache.org/lucene-solr.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:810)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1066)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1097)
at hudson.scm.SCM.checkout(SCM.java:485)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1269)
at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:607)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:529)
at hudson.model.Run.execute(Run.java:1738)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:98)
at hudson.model.Executor.run(Executor.java:410)
Caused by: hudson.plugins.git.GitException: org.eclipse.jgit.api.errors.TransportException: Connection reset
at org.jenkinsci.plugins.gitclient.JGitAPIImpl$2.execute(JGitAPIImpl.java:639)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:808)
... 11 more
Caused by: org.eclipse.jgit.api.errors.TransportException: Connection reset
at org.eclipse.jgit.api.FetchCommand.call(FetchCommand.java:139)
at org.jenkinsci.plugins.gitclient.JGitAPIImpl$2.execute(JGitAPIImpl.java:637)
... 12 more
Caused by: org.eclipse.jgit.errors.TransportException: Connection reset
at org.eclipse.jgit.transport.BasePackConnection.readAdvertisedRefs(BasePackConnection.java:182)
at org.eclipse.jgit.transport.TransportGitAnon$TcpFetchConnection.<init>(TransportGitAnon.java:194)
at org.eclipse.jgit.transport.TransportGitAnon.openFetch(TransportGitAnon.java:120)
at org.eclipse.jgit.transport.FetchProcess.executeImp(FetchProcess.java:136)
at org.eclipse.jgit.transport.FetchProcess.execute(FetchProcess.java:122)
at org.eclipse.jgit.transport.Transport.fetch(Transport.java:1138)
at org.eclipse.jgit.api.FetchCommand.call(FetchCommand.java:130)
... 13 more
Caused by: java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:196)
at java.net.SocketInputStream.read(SocketInputStream.java:122)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:275)
at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
at org.eclipse.jgit.util.IO.readFully(IO.java:246)
at org.eclipse.jgit.transport.PacketLineIn.readLength(PacketLineIn.java:186)
at org.eclipse.jgit.transport.PacketLineIn.readString(PacketLineIn.java:138)
at org.eclipse.jgit.transport.BasePackConnection.readAdvertisedRefsImpl(BasePackConnection.java:195)
at org.eclipse.jgit.transport.BasePackConnection.readAdvertisedRefs(BasePackConnection.java:176)
... 19 more
ERROR: null
Retrying after 10 seconds
Fetching changes from the remote Git repository
Cleaning workspace
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from git://git.apache.org/lucene-solr.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:810)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1066)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1097)
at hudson.scm.SCM.checkout(SCM.java:485)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1269)
at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:607)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:529)
at hudson.model.Run.execute(Run.java:1738)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:98)
at hudson.model.Executor.run(Executor.java:410)
Caused by: hudson.plugins.git.GitException: org.eclipse.jgit.api.errors.TransportException: Connection reset
at org.jenkinsci.plugins.gitclient.JGitAPIImpl$2.execute(JGitAPIImpl.java:639)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:808)
... 11 more
Caused by: org.eclipse.jgit.api.errors.TransportException: Connection reset
at org.eclipse.jgit.api.FetchCommand.call(FetchCommand.java:139)
at org.jenkinsci.plugins.gitclient.JGitAPIImpl$2.execute(JGitAPIImpl.java:637)
... 12 more
Caused by: org.eclipse.jgit.errors.TransportException: Connection reset
at org.eclipse.jgit.transport.BasePackConnection.readAdvertisedRefs(BasePackConnection.java:182)
at org.eclipse.jgit.transport.TransportGitAnon$TcpFetchConnection.<init>(TransportGitAnon.java:194)
at org.eclipse.jgit.transport.TransportGitAnon.openFetch(TransportGitAnon.java:120)
at org.eclipse.jgit.transport.FetchProcess.executeImp(FetchProcess.java:136)
at org.eclipse.jgit.transport.FetchProcess.execute(FetchProcess.java:122)
at org.eclipse.jgit.transport.Transport.fetch(Transport.java:1138)
at org.eclipse.jgit.api.FetchCommand.call(FetchCommand.java:130)
... 13 more
Caused by: java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:196)
at java.net.SocketInputStream.read(SocketInputStream.java:122)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:275)
at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
at org.eclipse.jgit.util.IO.readFully(IO.java:246)
at org.eclipse.jgit.transport.PacketLineIn.readLength(PacketLineIn.java:186)
at org.eclipse.jgit.transport.PacketLineIn.readString(PacketLineIn.java:138)
at org.eclipse.jgit.transport.BasePackConnection.readAdvertisedRefsImpl(BasePackConnection.java:195)
at org.eclipse.jgit.transport.BasePackConnection.readAdvertisedRefs(BasePackConnection.java:176)
... 19 more
ERROR: null
Retrying after 10 seconds
Fetching changes from the remote Git repository
Cleaning workspace
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from git://git.apache.org/lucene-solr.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:810)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1066)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1097)
at hudson.scm.SCM.checkout(SCM.java:485)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1269)
at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:607)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:529)
at hudson.model.Run.execute(Run.java:1738)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:98)
at hudson.model.Executor.run(Executor.java:410)
Caused by: hudson.plugins.git.GitException: org.eclipse.jgit.api.errors.TransportException: Connection reset
at org.jenkinsci.plugins.gitclient.JGitAPIImpl$2.execute(JGitAPIImpl.java:639)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:808)
... 11 more
Caused by: org.eclipse.jgit.api.errors.TransportException: Connection reset
at org.eclipse.jgit.api.FetchCommand.call(FetchCommand.java:139)
at org.jenkinsci.plugins.gitclient.JGitAPIImpl$2.execute(JGitAPIImpl.java:637)
... 12 more
Caused by: org.eclipse.jgit.errors.TransportException: Connection reset
at org.eclipse.jgit.transport.BasePackConnection.readAdvertisedRefs(BasePackConnection.java:182)
at org.eclipse.jgit.transport.TransportGitAnon$TcpFetchConnection.<init>(TransportGitAnon.java:194)
at org.eclipse.jgit.transport.TransportGitAnon.openFetch(TransportGitAnon.java:120)
at org.eclipse.jgit.transport.FetchProcess.executeImp(FetchProcess.java:136)
at org.eclipse.jgit.transport.FetchProcess.execute(FetchProcess.java:122)
at org.eclipse.jgit.transport.Transport.fetch(Transport.java:1138)
at org.eclipse.jgit.api.FetchCommand.call(FetchCommand.java:130)
... 13 more
Caused by: java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:196)
at java.net.SocketInputStream.read(SocketInputStream.java:122)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:275)
at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
at org.eclipse.jgit.util.IO.readFully(IO.java:246)
at org.eclipse.jgit.transport.PacketLineIn.readLength(PacketLineIn.java:186)
at org.eclipse.jgit.transport.PacketLineIn.readString(PacketLineIn.java:138)
at org.eclipse.jgit.transport.BasePackConnection.readAdvertisedRefsImpl(BasePackConnection.java:195)
at org.eclipse.jgit.transport.BasePackConnection.readAdvertisedRefs(BasePackConnection.java:176)
... 19 more
ERROR: null
Retrying after 10 seconds
Fetching changes from the remote Git repository
Cleaning workspace
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from git://git.apache.org/lucene-solr.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:810)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1066)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1097)
at hudson.scm.SCM.checkout(SCM.java:485)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1269)
at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:607)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:529)
at hudson.model.Run.execute(Run.java:1738)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:98)
at hudson.model.Executor.run(Executor.java:410)
Caused by: hudson.plugins.git.GitException: org.eclipse.jgit.api.errors.TransportException: Connection reset
at org.jenkinsci.plugins.gitclient.JGitAPIImpl$2.execute(JGitAPIImpl.java:639)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:808)
... 11 more
Caused by: org.eclipse.jgit.api.errors.TransportException: Connection reset
at org.eclipse.jgit.api.FetchCommand.call(FetchCommand.java:139)
at org.jenkinsci.plugins.gitclient.JGitAPIImpl$2.execute(JGitAPIImpl.java:637)
... 12 more
Caused by: org.eclipse.jgit.errors.TransportException: Connection reset
at org.eclipse.jgit.transport.BasePackConnection.readAdvertisedRefs(BasePackConnection.java:182)
at org.eclipse.jgit.transport.TransportGitAnon$TcpFetchConnection.<init>(TransportGitAnon.java:194)
at org.eclipse.jgit.transport.TransportGitAnon.openFetch(TransportGitAnon.java:120)
at org.eclipse.jgit.transport.FetchProcess.executeImp(FetchProcess.java:136)
at org.eclipse.jgit.transport.FetchProcess.execute(FetchProcess.java:122)
at org.eclipse.jgit.transport.Transport.fetch(Transport.java:1138)
at org.eclipse.jgit.api.FetchCommand.call(FetchCommand.java:130)
... 13 more
Caused by: java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:196)
at java.net.SocketInputStream.read(SocketInputStream.java:122)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:275)
at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
at org.eclipse.jgit.util.IO.readFully(IO.java:246)
at org.eclipse.jgit.transport.PacketLineIn.readLength(PacketLineIn.java:186)
at org.eclipse.jgit.transport.PacketLineIn.readString(PacketLineIn.java:138)
at org.eclipse.jgit.transport.BasePackConnection.readAdvertisedRefsImpl(BasePackConnection.java:195)
at org.eclipse.jgit.transport.BasePackConnection.readAdvertisedRefs(BasePackConnection.java:176)
... 19 more
ERROR: null
Retrying after 10 seconds
Fetching changes from the remote Git repository
Cleaning workspace
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from git://git.apache.org/lucene-solr.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:810)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1066)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1097)
at hudson.scm.SCM.checkout(SCM.java:485)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1269)
at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:607)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:529)
at hudson.model.Run.execute(Run.java:1738)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:98)
at hudson.model.Executor.run(Executor.java:410)
Caused by: hudson.plugins.git.GitException: org.eclipse.jgit.api.errors.TransportException: Connection reset
at org.jenkinsci.plugins.gitclient.JGitAPIImpl$2.execute(JGitAPIImpl.java:639)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:808)
... 11 more
Caused by: org.eclipse.jgit.api.errors.TransportException: Connection reset
at org.eclipse.jgit.api.FetchCommand.call(FetchCommand.java:139)
at org.jenkinsci.plugins.gitclient.JGitAPIImpl$2.execute(JGitAPIImpl.java:637)
... 12 more
Caused by: org.eclipse.jgit.errors.TransportException: Connection reset
at org.eclipse.jgit.transport.BasePackConnection.readAdvertisedRefs(BasePackConnection.java:182)
at org.eclipse.jgit.transport.TransportGitAnon$TcpFetchConnection.<init>(TransportGitAnon.java:194)
at org.eclipse.jgit.transport.TransportGitAnon.openFetch(TransportGitAnon.java:120)
at org.eclipse.jgit.transport.FetchProcess.executeImp(FetchProcess.java:136)
at org.eclipse.jgit.transport.FetchProcess.execute(FetchProcess.java:122)
at org.eclipse.jgit.transport.Transport.fetch(Transport.java:1138)
at org.eclipse.jgit.api.FetchCommand.call(FetchCommand.java:130)
... 13 more
Caused by: java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:196)
at java.net.SocketInputStream.read(SocketInputStream.java:122)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:275)
at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
at org.eclipse.jgit.util.IO.readFully(IO.java:246)
at org.eclipse.jgit.transport.PacketLineIn.readLength(PacketLineIn.java:186)
at org.eclipse.jgit.transport.PacketLineIn.readString(PacketLineIn.java:138)
at org.eclipse.jgit.transport.BasePackConnection.readAdvertisedRefsImpl(BasePackConnection.java:195)
at org.eclipse.jgit.transport.BasePackConnection.readAdvertisedRefs(BasePackConnection.java:176)
... 19 more
ERROR: null
Retrying after 10 seconds
Fetching changes from the remote Git repository
Cleaning workspace
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from git://git.apache.org/lucene-solr.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:810)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1066)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1097)
at hudson.scm.SCM.checkout(SCM.java:485)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1269)
at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:607)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:529)
at hudson.model.Run.execute(Run.java:1738)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:98)
at hudson.model.Executor.run(Executor.java:410)
Caused by: hudson.plugins.git.GitException: org.eclipse.jgit.api.errors.TransportException: Connection reset
at org.jenkinsci.plugins.gitclient.JGitAPIImpl$2.execute(JGitAPIImpl.java:639)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:808)
... 11 more
Caused by: org.eclipse.jgit.api.errors.TransportException: Connection reset
at org.eclipse.jgit.api.FetchCommand.call(FetchCommand.java:139)
at org.jenkinsci.plugins.gitclient.JGitAPIImpl$2.execute(JGitAPIImpl.java:637)
... 12 more
Caused by: org.eclipse.jgit.errors.TransportException: Connection reset
at org.eclipse.jgit.transport.BasePackConnection.readAdvertisedRefs(BasePackConnection.java:182)
at org.eclipse.jgit.transport.TransportGitAnon$TcpFetchConnection.<init>(TransportGitAnon.java:194)
at org.eclipse.jgit.transport.TransportGitAnon.openFetch(TransportGitAnon.java:120)
at org.eclipse.jgit.transport.FetchProcess.executeImp(FetchProcess.java:136)
at org.eclipse.jgit.transport.FetchProcess.execute(FetchProcess.java:122)
at org.eclipse.jgit.transport.Transport.fetch(Transport.java:1138)
at org.eclipse.jgit.api.FetchCommand.call(FetchCommand.java:130)
... 13 more
Caused by: java.net.SocketException: Connection reset
at java.net.SocketInputStream.read(SocketInputStream.java:196)
at java.net.SocketInputStream.read(SocketInputStream.java:122)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:275)
at java.io.BufferedInputStream.read(BufferedInputStream.java:334)
at org.eclipse.jgit.util.IO.readFully(IO.java:246)
at org.eclipse.jgit.transport.PacketLineIn.readLength(PacketLineIn.java:186)
at org.eclipse.jgit.transport.PacketLineIn.readString(PacketLineIn.java:138)
at org.eclipse.jgit.transport.BasePackConnection.readAdvertisedRefsImpl(BasePackConnection.java:195)
at org.eclipse.jgit.transport.BasePackConnection.readAdvertisedRefs(BasePackConnection.java:176)
... 19 more
ERROR: null
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS-EA] Lucene-Solr-master-Linux (64bit/jdk-9-ea+113) - Build
# 16528 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/16528/
Java: 64bit/jdk-9-ea+113 -XX:-UseCompressedOops -XX:+UseParallelGC -XX:-CompactStrings
1 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestStressLiveNodes
Error Message:
Clean up static fields (in @AfterClass?) and null them, your test still has references to classes of which the sizes cannot be measured due to security restrictions or Java 9 module encapsulation: - private static org.apache.solr.client.solrj.impl.CloudSolrClient org.apache.solr.cloud.TestStressLiveNodes.CLOUD_CLIENT
Stack Trace:
junit.framework.AssertionFailedError: Clean up static fields (in @AfterClass?) and null them, your test still has references to classes of which the sizes cannot be measured due to security restrictions or Java 9 module encapsulation:
- private static org.apache.solr.client.solrj.impl.CloudSolrClient org.apache.solr.cloud.TestStressLiveNodes.CLOUD_CLIENT
at __randomizedtesting.SeedInfo.seed([95D541ECF64FB480]:0)
at com.carrotsearch.randomizedtesting.rules.StaticFieldsInvariantRule$1.afterAlways(StaticFieldsInvariantRule.java:146)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(java.base@9-ea/Thread.java:804)
Caused by: java.lang.IllegalStateException: Unable to access 'private final java.lang.reflect.Layer java.lang.reflect.Module.layer' to estimate memory usage
at com.carrotsearch.randomizedtesting.rules.RamUsageEstimator.createCacheEntry(RamUsageEstimator.java:602)
at com.carrotsearch.randomizedtesting.rules.RamUsageEstimator.measureSizeOf(RamUsageEstimator.java:545)
at com.carrotsearch.randomizedtesting.rules.RamUsageEstimator.sizeOfAll(RamUsageEstimator.java:387)
at com.carrotsearch.randomizedtesting.rules.StaticFieldsInvariantRule$1.afterAlways(StaticFieldsInvariantRule.java:129)
... 10 more
Caused by: java.lang.reflect.InaccessibleObjectException: Cannot make a non-public member of class java.lang.reflect.Module accessible
at sun.reflect.Reflection.throwInaccessibleObjectException(java.base@9-ea/Reflection.java:420)
at java.lang.reflect.AccessibleObject.checkCanSetAccessible(java.base@9-ea/AccessibleObject.java:190)
at java.lang.reflect.Field.checkCanSetAccessible(java.base@9-ea/Field.java:170)
at java.lang.reflect.Field.setAccessible(java.base@9-ea/Field.java:164)
at com.carrotsearch.randomizedtesting.rules.RamUsageEstimator$3.run(RamUsageEstimator.java:597)
at com.carrotsearch.randomizedtesting.rules.RamUsageEstimator$3.run(RamUsageEstimator.java:594)
at java.security.AccessController.doPrivileged(java.base@9-ea/Native Method)
at com.carrotsearch.randomizedtesting.rules.RamUsageEstimator.createCacheEntry(RamUsageEstimator.java:594)
... 13 more
Build Log:
[...truncated 11276 lines...]
[junit4] Suite: org.apache.solr.cloud.TestStressLiveNodes
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressLiveNodes_95D541ECF64FB480-001/init-core-data-001
[junit4] 2> 674074 INFO (SUITE-TestStressLiveNodes-seed#[95D541ECF64FB480]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
[junit4] 2> 674075 INFO (SUITE-TestStressLiveNodes-seed#[95D541ECF64FB480]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 674076 INFO (Thread-1491) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 674076 INFO (Thread-1491) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 674176 INFO (SUITE-TestStressLiveNodes-seed#[95D541ECF64FB480]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:35120
[junit4] 2> 674176 INFO (SUITE-TestStressLiveNodes-seed#[95D541ECF64FB480]-worker) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674176 INFO (SUITE-TestStressLiveNodes-seed#[95D541ECF64FB480]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674193 INFO (zkCallback-599-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4feebf12 name:ZooKeeperConnection Watcher:127.0.0.1:35120 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674194 INFO (SUITE-TestStressLiveNodes-seed#[95D541ECF64FB480]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674194 INFO (SUITE-TestStressLiveNodes-seed#[95D541ECF64FB480]-worker) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674194 INFO (SUITE-TestStressLiveNodes-seed#[95D541ECF64FB480]-worker) [ ] o.a.s.c.c.SolrZkClient makePath: /solr/solr.xml
[junit4] 2> 674196 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15425604dbc0000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(java.base@9-ea/Thread.java:804)
[junit4] 2> 674199 INFO (jetty-launcher-598-thread-1) [ ] o.e.j.s.Server jetty-9.3.8.v20160314
[junit4] 2> 674200 INFO (jetty-launcher-598-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4b2c0679{/solr,null,AVAILABLE}
[junit4] 2> 674202 INFO (jetty-launcher-598-thread-1) [ ] o.e.j.s.ServerConnector Started ServerConnector@5e2e0d5c{HTTP/1.1,[http/1.1]}{127.0.0.1:43837}
[junit4] 2> 674202 INFO (jetty-launcher-598-thread-1) [ ] o.e.j.s.Server Started @676366ms
[junit4] 2> 674202 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=43837}
[junit4] 2> 674202 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): jdk.internal.loader.ClassLoaders$AppClassLoader@6e3c1e69
[junit4] 2> 674203 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressLiveNodes_95D541ECF64FB480-001/tempDir-001/node1'
[junit4] 2> 674203 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 674203 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 674203 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674203 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674204 INFO (zkCallback-600-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5b0c96cf name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674204 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674204 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674204 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 674207 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressLiveNodes_95D541ECF64FB480-001/tempDir-001/node1/.
[junit4] 2> 674208 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.CoreContainer New CoreContainer 944281460
[junit4] 2> 674208 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressLiveNodes_95D541ECF64FB480-001/tempDir-001/node1]
[junit4] 2> 674208 WARN (jetty-launcher-598-thread-1) [ ] o.a.s.c.CoreContainer Couldn't add files from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressLiveNodes_95D541ECF64FB480-001/tempDir-001/node1/lib to classpath: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressLiveNodes_95D541ECF64FB480-001/tempDir-001/node1/lib
[junit4] 2> 674208 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,
[junit4] 2> 674209 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params:
[junit4] 2> 674210 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 674210 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 674210 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35120/solr
[junit4] 2> 674210 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.ZkController zkHost includes chroot
[junit4] 2> 674210 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674210 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674211 INFO (zkCallback-603-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5d7b80f7 name:ZooKeeperConnection Watcher:127.0.0.1:35120 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674211 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674211 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674214 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.ZkController Added new OnReconnect listener org.apache.solr.cloud.ZkController$$Lambda$104/555988892@7e1380ad
[junit4] 2> 674214 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674215 INFO (zkCallback-604-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2f1344ff name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674215 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674216 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
[junit4] 2> 674216 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
[junit4] 2> 674217 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
[junit4] 2> 674218 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
[junit4] 2> 674219 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
[junit4] 2> 674219 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
[junit4] 2> 674219 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /collections
[junit4] 2> 674220 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
[junit4] 2> 674220 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
[junit4] 2> 674221 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /security.json
[junit4] 2> 674221 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 674221 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
[junit4] 2> 674222 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
[junit4] 2> 674222 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
[junit4] 2> 674222 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 674223 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95742587632877571-127.0.0.1:43837_solr-n_0000000000
[junit4] 2> 674223 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:43837_solr
[junit4] 2> 674223 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
[junit4] 2> 674223 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.Overseer Overseer (id=95742587632877571-127.0.0.1:43837_solr-n_0000000000) starting
[junit4] 2> 674224 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
[junit4] 2> 674227 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 674227 INFO (OverseerCollectionConfigSetProcessor-95742587632877571-127.0.0.1:43837_solr-n_0000000000) [ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
[junit4] 2> 674227 INFO (OverseerStateUpdate-95742587632877571-127.0.0.1:43837_solr-n_0000000000) [ ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 674227 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43837_solr
[junit4] 2> 674228 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:43837_solr
[junit4] 2> 674229 INFO (OverseerStateUpdate-95742587632877571-127.0.0.1:43837_solr-n_0000000000) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
[junit4] 2> 674229 INFO (zkCallback-604-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0])
[junit4] 2> 674229 INFO (zkCallback-604-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 674233 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 674233 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.CoreContainer No authentication plugin used.
[junit4] 2> 674233 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestStressLiveNodes_95D541ECF64FB480-001/tempDir-001/node1/.
[junit4] 2> 674234 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions
[junit4] 2> 674234 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.s.SolrDispatchFilter user.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1
[junit4] 2> 674234 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
[junit4] 2> 674237 INFO (SUITE-TestStressLiveNodes-seed#[95D541ECF64FB480]-worker) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674238 INFO (SUITE-TestStressLiveNodes-seed#[95D541ECF64FB480]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674240 INFO (zkCallback-605-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3e40827 name:ZooKeeperConnection Watcher:127.0.0.1:35120 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674240 INFO (SUITE-TestStressLiveNodes-seed#[95D541ECF64FB480]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674241 INFO (SUITE-TestStressLiveNodes-seed#[95D541ECF64FB480]-worker) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674241 INFO (SUITE-TestStressLiveNodes-seed#[95D541ECF64FB480]-worker) [ ] o.a.s.c.s.i.CloudSolrClient Final constructed zkHost string: 127.0.0.1:35120/solr
[junit4] 2> 674245 INFO (SUITE-TestStressLiveNodes-seed#[95D541ECF64FB480]-worker) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674245 INFO (SUITE-TestStressLiveNodes-seed#[95D541ECF64FB480]-worker) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674246 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@16a01015 name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674246 INFO (SUITE-TestStressLiveNodes-seed#[95D541ECF64FB480]-worker) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674246 INFO (SUITE-TestStressLiveNodes-seed#[95D541ECF64FB480]-worker) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674246 INFO (SUITE-TestStressLiveNodes-seed#[95D541ECF64FB480]-worker) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper...
[junit4] 2> 674247 INFO (SUITE-TestStressLiveNodes-seed#[95D541ECF64FB480]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 674260 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testStress
[junit4] 2> 674260 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674261 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674263 INFO (zkCallback-608-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7f29ef20 name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674263 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674263 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674265 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1)
[junit4] 2> 674266 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.TestStressLiveNodes preparing parallel adds to live nodes: iter=0, numThreads=5 numNodesPerThread=2
[junit4] 2> 674266 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674266 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674267 INFO (zkCallback-609-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@25c3b1b6 name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674267 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674267 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674267 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674267 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674268 INFO (zkCallback-610-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@48d8b73d name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674268 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674268 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674268 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674268 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674269 INFO (zkCallback-611-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@75c42bb4 name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674269 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674269 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674269 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674269 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674270 INFO (zkCallback-612-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@304715e name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674270 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674270 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674270 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674271 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674271 INFO (zkCallback-613-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@311272c8 name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674271 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674271 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674272 INFO (test_live_nodes_thrasher_iter0-2091-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T0_0-0
[junit4] 2> 674272 INFO (test_live_nodes_thrasher_iter0-2091-thread-2) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T0_1-0
[junit4] 2> 674272 INFO (test_live_nodes_thrasher_iter0-2091-thread-3) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T0_2-0
[junit4] 2> 674272 INFO (test_live_nodes_thrasher_iter0-2091-thread-4) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T0_3-0
[junit4] 2> 674272 INFO (test_live_nodes_thrasher_iter0-2091-thread-5) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T0_4-0
[junit4] 2> 674272 INFO (zkCallback-604-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 674273 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 674273 INFO (test_live_nodes_thrasher_iter0-2091-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T0_0-1
[junit4] 2> 674273 INFO (zkCallback-604-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
[junit4] 2> 674273 INFO (test_live_nodes_thrasher_iter0-2091-thread-2) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T0_1-1
[junit4] 2> 674273 INFO (zkCallback-604-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
[junit4] 2> 674279 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (4)
[junit4] 2> 674279 INFO (zkCallback-604-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 674279 INFO (zkCallback-604-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [4])
[junit4] 2> 674279 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [4])
[junit4] 2> 674279 INFO (test_live_nodes_thrasher_iter0-2091-thread-4) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T0_3-1
[junit4] 2> 674279 INFO (test_live_nodes_thrasher_iter0-2091-thread-3) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T0_2-1
[junit4] 2> 674279 INFO (zkCallback-604-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (7)
[junit4] 2> 674280 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (7)
[junit4] 2> 674280 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [7])
[junit4] 2> 674280 INFO (zkCallback-604-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [7])
[junit4] 2> 674280 INFO (test_live_nodes_thrasher_iter0-2091-thread-5) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T0_4-1
[junit4] 2> 674280 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (7) -> (8)
[junit4] 2> 674280 INFO (zkCallback-604-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (7) -> (8)
[junit4] 2> 674280 INFO (zkCallback-604-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [8])
[junit4] 2> 674280 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [8])
[junit4] 2> 674281 INFO (zkCallback-604-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (8) -> (9)
[junit4] 2> 674281 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [9])
[junit4] 2> 674281 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (9) -> (11)
[junit4] 2> 674281 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (8) -> (11)
[junit4] 2> 674282 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674290 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674291 INFO (zkCallback-614-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3bfeb9c9 name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674291 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674291 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674292 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [11])
[junit4] 2> 674292 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [11])
[junit4] 2> 674292 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (11) -> (9)
[junit4] 2> 674292 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [9])
[junit4] 2> 674292 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (9) -> (7)
[junit4] 2> 674293 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (11) -> (7)
[junit4] 2> 674293 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [7])
[junit4] 2> 674293 INFO (zkCallback-607-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [7])
[junit4] 2> 674293 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (7) -> (5)
[junit4] 2> 674293 INFO (zkCallback-607-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (7) -> (5)
[junit4] 2> 674293 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [5])
[junit4] 2> 674293 INFO (zkCallback-607-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [5])
[junit4] 2> 674294 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (3)
[junit4] 2> 674294 INFO (zkCallback-607-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (3)
[junit4] 2> 674294 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
[junit4] 2> 674294 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674294 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (1)
[junit4] 2> 674294 INFO (zkCallback-607-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
[junit4] 2> 674294 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674294 INFO (zkCallback-607-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (1)
[junit4] 2> 674295 INFO (zkCallback-615-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5802d5b1 name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674295 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674295 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674296 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1)
[junit4] 2> 674296 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.TestStressLiveNodes preparing parallel adds to live nodes: iter=1, numThreads=5 numNodesPerThread=1
[junit4] 2> 674296 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674302 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674303 INFO (zkCallback-616-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3c93bac6 name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674303 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674303 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674303 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674303 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674304 INFO (zkCallback-617-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@46e87f4a name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674304 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674304 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674304 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674304 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674305 INFO (zkCallback-618-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1ae911da name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674305 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674305 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674305 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674305 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674306 INFO (zkCallback-619-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6546af16 name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674306 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674306 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674306 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674310 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674310 INFO (zkCallback-620-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4ac3d538 name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674310 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674310 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674310 INFO (test_live_nodes_thrasher_iter1-2092-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T1_0-0
[junit4] 2> 674310 INFO (test_live_nodes_thrasher_iter1-2092-thread-2) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T1_1-0
[junit4] 2> 674311 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 674311 INFO (zkCallback-607-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 674311 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
[junit4] 2> 674311 INFO (zkCallback-607-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
[junit4] 2> 674315 INFO (test_live_nodes_thrasher_iter1-2092-thread-3) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T1_2-0
[junit4] 2> 674316 INFO (test_live_nodes_thrasher_iter1-2092-thread-4) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T1_3-0
[junit4] 2> 674316 INFO (test_live_nodes_thrasher_iter1-2092-thread-5) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T1_4-0
[junit4] 2> 674316 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
[junit4] 2> 674316 INFO (zkCallback-607-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
[junit4] 2> 674316 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 674316 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [4])
[junit4] 2> 674316 INFO (zkCallback-607-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (5)
[junit4] 2> 674317 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (6)
[junit4] 2> 674317 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674317 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [5])
[junit4] 2> 674317 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674317 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (6)
[junit4] 2> 674318 INFO (zkCallback-621-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@69af037c name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674318 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674318 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674319 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [6])
[junit4] 2> 674319 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [6])
[junit4] 2> 674319 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (6) -> (5)
[junit4] 2> 674319 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (6) -> (5)
[junit4] 2> 674319 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [5])
[junit4] 2> 674319 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [5])
[junit4] 2> 674320 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (4)
[junit4] 2> 674320 INFO (zkCallback-604-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [4])
[junit4] 2> 674320 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (3)
[junit4] 2> 674320 INFO (zkCallback-604-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 674320 INFO (zkCallback-604-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
[junit4] 2> 674320 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
[junit4] 2> 674320 INFO (zkCallback-604-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (1)
[junit4] 2> 674320 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (1)
[junit4] 2> 674320 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674321 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674322 INFO (zkCallback-622-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2a3f2dff name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674322 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674322 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674323 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1)
[junit4] 2> 674323 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.TestStressLiveNodes preparing parallel adds to live nodes: iter=2, numThreads=5 numNodesPerThread=1
[junit4] 2> 674323 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674323 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674324 INFO (zkCallback-623-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5a13aa2f name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674324 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674324 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674324 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674324 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674325 INFO (zkCallback-624-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4561f9b9 name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674325 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674325 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674325 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674325 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674326 INFO (zkCallback-625-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7d56fe42 name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674326 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674326 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674326 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674326 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674327 INFO (zkCallback-626-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4580f6ff name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674327 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674327 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674327 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674327 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674328 INFO (zkCallback-627-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7bccb6b0 name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674328 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674328 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674328 INFO (test_live_nodes_thrasher_iter2-2093-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T2_0-0
[junit4] 2> 674328 INFO (test_live_nodes_thrasher_iter2-2093-thread-2) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T2_1-0
[junit4] 2> 674328 INFO (test_live_nodes_thrasher_iter2-2093-thread-4) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T2_3-0
[junit4] 2> 674328 INFO (test_live_nodes_thrasher_iter2-2093-thread-3) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T2_2-0
[junit4] 2> 674328 INFO (test_live_nodes_thrasher_iter2-2093-thread-5) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T2_4-0
[junit4] 2> 674329 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 674329 INFO (zkCallback-604-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 674329 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
[junit4] 2> 674329 INFO (zkCallback-607-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
[junit4] 2> 674330 INFO (zkCallback-604-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (4)
[junit4] 2> 674330 INFO (zkCallback-607-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 674330 INFO (zkCallback-604-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [4])
[junit4] 2> 674330 INFO (zkCallback-607-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [4])
[junit4] 2> 674330 INFO (zkCallback-607-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (6)
[junit4] 2> 674330 INFO (zkCallback-604-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (6)
[junit4] 2> 674331 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674331 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674331 INFO (zkCallback-628-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@74ef9e52 name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674331 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674332 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674332 INFO (zkCallback-604-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [6])
[junit4] 2> 674333 INFO (zkCallback-607-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [6])
[junit4] 2> 674333 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15425604dbc0016, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(java.base@9-ea/Thread.java:804)
[junit4] 2> 674333 INFO (zkCallback-607-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (6) -> (4)
[junit4] 2> 674334 INFO (zkCallback-604-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (6) -> (4)
[junit4] 2> 674334 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [4])
[junit4] 2> 674334 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15425604dbc0017, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(java.base@9-ea/Thread.java:804)
[junit4] 2> 674334 INFO (zkCallback-607-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [4])
[junit4] 2> 674335 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15425604dbc0018, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(java.base@9-ea/Thread.java:804)
[junit4] 2> 674335 INFO (zkCallback-607-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (2)
[junit4] 2> 674335 INFO (zkCallback-607-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [2])
[junit4] 2> 674335 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674336 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (1)
[junit4] 2> 674336 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674336 INFO (zkCallback-607-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 674336 INFO (zkCallback-629-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4a6906b8 name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674336 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674336 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674337 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1)
[junit4] 2> 674337 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.TestStressLiveNodes preparing parallel adds to live nodes: iter=3, numThreads=3 numNodesPerThread=5
[junit4] 2> 674337 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674337 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674338 INFO (zkCallback-630-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7dd21858 name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674338 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674338 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674338 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674338 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674339 INFO (zkCallback-631-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3fec0da6 name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674339 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674339 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674339 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674339 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674340 INFO (zkCallback-632-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@563257d8 name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674340 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674340 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674340 INFO (test_live_nodes_thrasher_iter3-2094-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T3_0-0
[junit4] 2> 674340 INFO (test_live_nodes_thrasher_iter3-2094-thread-2) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T3_1-0
[junit4] 2> 674340 INFO (test_live_nodes_thrasher_iter3-2094-thread-3) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T3_2-0
[junit4] 2> 674341 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 674341 INFO (zkCallback-607-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 674341 INFO (test_live_nodes_thrasher_iter3-2094-thread-3) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T3_2-1
[junit4] 2> 674341 INFO (test_live_nodes_thrasher_iter3-2094-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T3_0-1
[junit4] 2> 674341 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (4)
[junit4] 2> 674341 INFO (test_live_nodes_thrasher_iter3-2094-thread-2) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T3_1-1
[junit4] 2> 674341 INFO (zkCallback-607-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (4)
[junit4] 2> 674342 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [4])
[junit4] 2> 674342 INFO (zkCallback-607-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [4])
[junit4] 2> 674342 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (7)
[junit4] 2> 674342 INFO (zkCallback-607-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (7)
[junit4] 2> 674342 INFO (test_live_nodes_thrasher_iter3-2094-thread-2) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T3_1-2
[junit4] 2> 674342 INFO (test_live_nodes_thrasher_iter3-2094-thread-3) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T3_2-2
[junit4] 2> 674342 INFO (test_live_nodes_thrasher_iter3-2094-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T3_0-2
[junit4] 2> 674342 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [7])
[junit4] 2> 674342 INFO (zkCallback-607-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [7])
[junit4] 2> 674343 INFO (test_live_nodes_thrasher_iter3-2094-thread-3) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T3_2-3
[junit4] 2> 674343 INFO (test_live_nodes_thrasher_iter3-2094-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T3_0-3
[junit4] 2> 674343 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (7) -> (10)
[junit4] 2> 674343 INFO (zkCallback-607-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (7) -> (10)
[junit4] 2> 674343 INFO (test_live_nodes_thrasher_iter3-2094-thread-2) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T3_1-3
[junit4] 2> 674343 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [10])
[junit4] 2> 674343 INFO (zkCallback-607-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [10])
[junit4] 2> 674343 INFO (test_live_nodes_thrasher_iter3-2094-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T3_0-4
[junit4] 2> 674343 INFO (zkCallback-607-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (10) -> (13)
[junit4] 2> 674343 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (10) -> (13)
[junit4] 2> 674343 INFO (test_live_nodes_thrasher_iter3-2094-thread-3) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T3_2-4
[junit4] 2> 674343 INFO (test_live_nodes_thrasher_iter3-2094-thread-2) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T3_1-4
[junit4] 2> 674344 INFO (zkCallback-607-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [13])
[junit4] 2> 674344 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [13])
[junit4] 2> 674344 INFO (zkCallback-607-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (13) -> (14)
[junit4] 2> 674344 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (13) -> (14)
[junit4] 2> 674344 INFO (zkCallback-607-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [14])
[junit4] 2> 674344 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [14])
[junit4] 2> 674344 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (14) -> (15)
[junit4] 2> 674344 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [14])
[junit4] 2> 674344 INFO (zkCallback-607-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (14) -> (15)
[junit4] 2> 674344 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [15])
[junit4] 2> 674344 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (15) -> (16)
[junit4] 2> 674344 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (15) -> (16)
[junit4] 2> 674345 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674345 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674346 INFO (zkCallback-633-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1abe02ce name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674346 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674346 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674347 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [16])
[junit4] 2> 674347 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [16])
[junit4] 2> 674347 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (16) -> (6)
[junit4] 2> 674347 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (16) -> (6)
[junit4] 2> 674347 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [6])
[junit4] 2> 674347 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [6])
[junit4] 2> 674347 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674348 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (6) -> (1)
[junit4] 2> 674348 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (6) -> (1)
[junit4] 2> 674348 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674348 INFO (zkCallback-634-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3f69e141 name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674348 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674349 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674349 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1)
[junit4] 2> 674349 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.TestStressLiveNodes preparing parallel adds to live nodes: iter=4, numThreads=3 numNodesPerThread=2
[junit4] 2> 674349 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674349 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674350 INFO (zkCallback-635-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3d1c6bfa name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674350 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674350 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674350 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674350 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674351 INFO (zkCallback-636-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@19681af4 name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674351 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674351 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674351 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674351 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674352 INFO (zkCallback-637-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7093603b name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674352 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674352 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674352 INFO (test_live_nodes_thrasher_iter4-2095-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T4_0-0
[junit4] 2> 674352 INFO (test_live_nodes_thrasher_iter4-2095-thread-2) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T4_1-0
[junit4] 2> 674352 INFO (test_live_nodes_thrasher_iter4-2095-thread-3) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T4_2-0
[junit4] 2> 674353 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 674353 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 674353 INFO (test_live_nodes_thrasher_iter4-2095-thread-2) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T4_1-1
[junit4] 2> 674353 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (4)
[junit4] 2> 674353 INFO (test_live_nodes_thrasher_iter4-2095-thread-3) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T4_2-1
[junit4] 2> 674353 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (4)
[junit4] 2> 674353 INFO (test_live_nodes_thrasher_iter4-2095-thread-1) [ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/thrasher-T4_0-1
[junit4] 2> 674354 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [4])
[junit4] 2> 674354 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [4])
[junit4] 2> 674354 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 674354 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (6)
[junit4] 2> 674354 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [5])
[junit4] 2> 674354 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [6])
[junit4] 2> 674354 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (7)
[junit4] 2> 674354 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (6) -> (7)
[junit4] 2> 674354 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674355 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674355 INFO (zkCallback-638-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3f472945 name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674355 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674356 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674358 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [7])
[junit4] 2> 674358 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [7])
[junit4] 2> 674358 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (7) -> (5)
[junit4] 2> 674359 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (7) -> (3)
[junit4] 2> 674359 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [5])
[junit4] 2> 674359 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (3)
[junit4] 2> 674359 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
[junit4] 2> 674359 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [3])
[junit4] 2> 674359 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674359 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (1)
[junit4] 2> 674359 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (1)
[junit4] 2> 674359 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674360 INFO (zkCallback-639-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7e8eaecb name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674360 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674360 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674361 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1)
[junit4] 2> 674361 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.TestStressLiveNodes preparing parallel adds to live nodes: iter=5, numThreads=5 numNodesPerThread=3
[junit4] 2> 674361 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674361 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674361 INFO (zkCallback-640-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6acd2cef name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674362 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674362 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674362 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674362 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674362 INFO (zkCallback-641-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2bd4d0f5 name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674363 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674363 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674363 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674363 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674363 INFO (zkCallback-642-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7a5a9348 name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674364 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674364 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674364 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674364 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674364 INFO (zkCallback-643-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@25898602 name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 674365 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 674365 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 674365 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
[junit4] 2> 674365 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 674375 INFO (zkCallback-644-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7557b9a8 name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[...truncated too long message...]
480]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
[junit4] 2> 707456 INFO (zkCallback-17918-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@661692e3 name:ZooKeeperConnection Watcher:127.0.0.1:35120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 707456 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
[junit4] 2> 707456 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
[junit4] 2> 707456 INFO (zkCallback-604-thread-3) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [17])
[junit4] 2> 707456 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [17])
[junit4] 2> 707457 INFO (zkCallback-604-thread-3) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (17) -> (9)
[junit4] 2> 707457 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (17) -> (9)
[junit4] 2> 707457 INFO (zkCallback-604-thread-3) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [9])
[junit4] 2> 707457 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [9])
[junit4] 2> 707457 INFO (zkCallback-604-thread-3) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (9) -> (5)
[junit4] 2> 707457 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [5])
[junit4] 2> 707457 INFO (zkCallback-607-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (9) -> (1)
[junit4] 2> 707457 INFO (TEST-TestStressLiveNodes.testStress-seed#[95D541ECF64FB480]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testStress
[junit4] 2> 707457 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (1)
[junit4] 2> 707459 INFO (jetty-launcher-598-thread-1) [ ] o.e.j.s.ServerConnector Stopped ServerConnector@5e2e0d5c{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 707459 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=944281460
[junit4] 2> 707459 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.ZkController Publish node=127.0.0.1:43837_solr as DOWN
[junit4] 2> 707459 INFO (jetty-launcher-598-thread-1) [ ] o.a.s.c.Overseer Overseer (id=95742587632877571-127.0.0.1:43837_solr-n_0000000000) closing
[junit4] 2> 707459 INFO (OverseerStateUpdate-95742587632877571-127.0.0.1:43837_solr-n_0000000000) [ ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:43837_solr
[junit4] 2> 707460 INFO (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
[junit4] 2> 707460 WARN (zkCallback-604-thread-2) [ ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 707461 INFO (jetty-launcher-598-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4b2c0679{/solr,null,UNAVAILABLE}
[junit4] 2> 707461 INFO (SUITE-TestStressLiveNodes-seed#[95D541ECF64FB480]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:35120 35120
[junit4] 2> 707481 INFO (Thread-1491) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:35120 35120
[junit4] 2> 707483 WARN (Thread-1491) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 2 /solr/aliases.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 2 /solr/clusterstate.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 2 /solr/live_nodes
[junit4] 2> 2 /solr/collections
[junit4] 2>
[junit4] 2> 707483 INFO (SUITE-TestStressLiveNodes-seed#[95D541ECF64FB480]-worker) [ ] o.a.s.SolrTestCaseJ4 ###deleteCore
[junit4] 2> Apr 17, 2016 5:59:42 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 42 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60): {}, docValues:{}, maxPointsInLeafNode=1682, maxMBSortInHeap=5.92058416877971, sim=RandomSimilarity(queryNorm=true,coord=yes): {}, locale=gsw, timezone=Europe/Madrid
[junit4] 2> NOTE: Linux 4.2.0-34-generic amd64/Oracle Corporation 9-ea (64-bit)/cpus=12,threads=1,free=199005712,total=509083648
[junit4] 2> NOTE: All tests run in this JVM: [MultiTermTest, SchemaVersionSpecificBehaviorTest, TestLMJelinekMercerSimilarityFactory, DocValuesTest, CachingDirectoryFactoryTest, FileUtilsTest, TestCloudSchemaless, ConjunctionSolrSpellCheckerTest, PKIAuthenticationIntegrationTest, TestReplicaProperties, HdfsBasicDistributedZk2Test, TestQueryUtils, HdfsDirectoryFactoryTest, TestNamedUpdateProcessors, SolrIndexSplitterTest, SortSpecParsingTest, TestDistribDocBasedVersion, SolrIndexConfigTest, SpellingQueryConverterTest, TestLFUCache, TestUpdate, TestSerializedLuceneMatchVersion, TestFieldTypeCollectionResource, OpenCloseCoreStressTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, HdfsDirectoryTest, TestDistributedGrouping, CollectionsAPIDistributedZkTest, TestSolrXml, TestTrie, SortByFunctionTest, TestDocumentBuilder, TestRandomCollapseQParserPlugin, TestRecoveryHdfs, SpatialFilterTest, BigEndianAscendingWordSerializerTest, BJQParserTest, MBeansHandlerTest, TestBM25SimilarityFactory, SuggesterFSTTest, TestSolrDeletionPolicy2, TestUniqueKeyFieldResource, TestCodecSupport, TestCopyFieldCollectionResource, AsyncMigrateRouteKeyTest, BlockCacheTest, ShardRoutingCustomTest, UniqFieldsUpdateProcessorFactoryTest, CdcrReplicationHandlerTest, TestDFRSimilarityFactory, DeleteInactiveReplicaTest, ChaosMonkeySafeLeaderTest, DistributedQueryComponentOptimizationTest, TestMinMaxOnMultiValuedField, TestStressLiveNodes]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestStressLiveNodes -Dtests.seed=95D541ECF64FB480 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=gsw -Dtests.timezone=Europe/Madrid -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.00s J1 | TestStressLiveNodes (suite) <<<
[junit4] > Throwable #1: junit.framework.AssertionFailedError: Clean up static fields (in @AfterClass?) and null them, your test still has references to classes of which the sizes cannot be measured due to security restrictions or Java 9 module encapsulation:
[junit4] > - private static org.apache.solr.client.solrj.impl.CloudSolrClient org.apache.solr.cloud.TestStressLiveNodes.CLOUD_CLIENT
[junit4] > at __randomizedtesting.SeedInfo.seed([95D541ECF64FB480]:0)
[junit4] > at java.lang.Thread.run(java.base@9-ea/Thread.java:804)
[junit4] > Caused by: java.lang.IllegalStateException: Unable to access 'private final java.lang.reflect.Layer java.lang.reflect.Module.layer' to estimate memory usage
[junit4] > ... 10 more
[junit4] > Caused by: java.lang.reflect.InaccessibleObjectException: Cannot make a non-public member of class java.lang.reflect.Module accessible
[junit4] > at java.lang.reflect.AccessibleObject.checkCanSetAccessible(java.base@9-ea/AccessibleObject.java:190)
[junit4] > at java.lang.reflect.Field.checkCanSetAccessible(java.base@9-ea/Field.java:170)
[junit4] > at java.lang.reflect.Field.setAccessible(java.base@9-ea/Field.java:164)
[junit4] > at java.security.AccessController.doPrivileged(java.base@9-ea/Native Method)
[junit4] > ... 13 more
[junit4] Completed [222/587 (1!)] on J1 in 34.21s, 1 test, 1 failure <<< FAILURES!
[...truncated 1161 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:740: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:684: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:59: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build.xml:233: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/common-build.xml:529: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1457: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:1014: There were test failures: 587 suites (10 ignored), 2360 tests, 1 suite-level error, 116 ignored (70 assumptions) [seed: 95D541ECF64FB480]
Total time: 54 minutes 3 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any