You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/03/24 17:43:55 UTC
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.7.0_15) - Build #
4852 - Still Failing!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/4852/
Java: 32bit/jdk1.7.0_15 -server -XX:+UseConcMarkSweepGC
4 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.OverseerTest
Error Message:
ERROR: SolrZkClient opens=147 closes=116
Stack Trace:
java.lang.AssertionError: ERROR: SolrZkClient opens=147 closes=116
at __randomizedtesting.SeedInfo.seed([9105F4BCCBADB5BB]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.SolrTestCaseJ4.endTrackingZkClients(SolrTestCaseJ4.java:266)
at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:101)
at sun.reflect.GeneratedMethodAccessor31.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.OverseerTest
Error Message:
66 threads leaked from SUITE scope at org.apache.solr.cloud.OverseerTest: 1) Thread[id=2689, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 2) Thread[id=2665, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 3) Thread[id=2661, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 4) Thread[id=2635, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 5) Thread[id=2692, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 6) Thread[id=2686, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 7) Thread[id=2657, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 8) Thread[id=2680, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 9) Thread[id=2675, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 10) Thread[id=2696, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 11) Thread[id=2645, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 12) Thread[id=2640, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 13) Thread[id=2664, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 14) Thread[id=2644, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 15) Thread[id=2693, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 16) Thread[id=2658, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 17) Thread[id=2688, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 18) Thread[id=2679, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 19) Thread[id=2660, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 20) Thread[id=2691, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 21) Thread[id=2695, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 22) Thread[id=2677, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 23) Thread[id=2671, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 24) Thread[id=2556, name=SessionTracker, state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Object.wait(Native Method) at org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:146) 25) Thread[id=2641, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 26) Thread[id=2638, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 27) Thread[id=2655, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 28) Thread[id=2649, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 29) Thread[id=2683, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 30) Thread[id=2694, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 31) Thread[id=2666, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 32) Thread[id=2646, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 33) Thread[id=2637, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 34) Thread[id=2636, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 35) Thread[id=2554, name=Thread-1005, state=WAITING, group=TGRP-OverseerTest] at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1258) at java.lang.Thread.join(Thread.java:1332) at org.apache.zookeeper.server.NIOServerCnxnFactory.join(NIOServerCnxnFactory.java:302) at org.apache.solr.cloud.ZkTestServer$ZKServerMain.runFromConfig(ZkTestServer.java:107) at org.apache.solr.cloud.ZkTestServer$2.run(ZkTestServer.java:221) 36) Thread[id=2654, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 37) Thread[id=2647, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 38) Thread[id=2687, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 39) Thread[id=2668, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 40) Thread[id=2555, name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:178) at java.lang.Thread.run(Thread.java:722) 41) Thread[id=2670, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 42) Thread[id=2673, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 43) Thread[id=2676, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 44) Thread[id=2653, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 45) Thread[id=2684, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 46) Thread[id=2681, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 47) Thread[id=2656, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 48) Thread[id=2674, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 49) Thread[id=2643, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 50) Thread[id=2672, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 51) Thread[id=2652, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 52) Thread[id=2663, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 53) Thread[id=2667, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 54) Thread[id=2651, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 55) Thread[id=2678, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 56) Thread[id=2659, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 57) Thread[id=2682, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 58) Thread[id=2642, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 59) Thread[id=2669, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 60) Thread[id=2685, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 61) Thread[id=2648, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 62) Thread[id=2639, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 63) Thread[id=2690, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 64) Thread[id=2558, name=ProcessThread(sid:0 cport:-1):, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:120) 65) Thread[id=2662, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491) 66) Thread[id=2650, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 66 threads leaked from SUITE scope at org.apache.solr.cloud.OverseerTest:
1) Thread[id=2689, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
2) Thread[id=2665, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
3) Thread[id=2661, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
4) Thread[id=2635, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
5) Thread[id=2692, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
6) Thread[id=2686, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
7) Thread[id=2657, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
8) Thread[id=2680, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
9) Thread[id=2675, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
10) Thread[id=2696, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
11) Thread[id=2645, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
12) Thread[id=2640, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
13) Thread[id=2664, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
14) Thread[id=2644, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
15) Thread[id=2693, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
16) Thread[id=2658, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
17) Thread[id=2688, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
18) Thread[id=2679, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
19) Thread[id=2660, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
20) Thread[id=2691, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
21) Thread[id=2695, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
22) Thread[id=2677, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
23) Thread[id=2671, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
24) Thread[id=2556, name=SessionTracker, state=TIMED_WAITING, group=TGRP-OverseerTest]
at java.lang.Object.wait(Native Method)
at org.apache.zookeeper.server.SessionTrackerImpl.run(SessionTrackerImpl.java:146)
25) Thread[id=2641, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
26) Thread[id=2638, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
27) Thread[id=2655, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
28) Thread[id=2649, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
29) Thread[id=2683, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
30) Thread[id=2694, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
31) Thread[id=2666, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
32) Thread[id=2646, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
33) Thread[id=2637, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
34) Thread[id=2636, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
35) Thread[id=2554, name=Thread-1005, state=WAITING, group=TGRP-OverseerTest]
at java.lang.Object.wait(Native Method)
at java.lang.Thread.join(Thread.java:1258)
at java.lang.Thread.join(Thread.java:1332)
at org.apache.zookeeper.server.NIOServerCnxnFactory.join(NIOServerCnxnFactory.java:302)
at org.apache.solr.cloud.ZkTestServer$ZKServerMain.runFromConfig(ZkTestServer.java:107)
at org.apache.solr.cloud.ZkTestServer$2.run(ZkTestServer.java:221)
36) Thread[id=2654, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
37) Thread[id=2647, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
38) Thread[id=2687, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
39) Thread[id=2668, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
40) Thread[id=2555, name=NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0, state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:178)
at java.lang.Thread.run(Thread.java:722)
41) Thread[id=2670, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
42) Thread[id=2673, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
43) Thread[id=2676, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
44) Thread[id=2653, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
45) Thread[id=2684, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
46) Thread[id=2681, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
47) Thread[id=2656, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
48) Thread[id=2674, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
49) Thread[id=2643, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
50) Thread[id=2672, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
51) Thread[id=2652, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
52) Thread[id=2663, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
53) Thread[id=2667, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
54) Thread[id=2651, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
55) Thread[id=2678, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
56) Thread[id=2659, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
57) Thread[id=2682, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
58) Thread[id=2642, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
59) Thread[id=2669, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
60) Thread[id=2685, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
61) Thread[id=2648, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
62) Thread[id=2639, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=RUNNABLE, group=TGRP-OverseerTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
63) Thread[id=2690, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
64) Thread[id=2558, name=ProcessThread(sid:0 cport:-1):, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.server.PrepRequestProcessor.run(PrepRequestProcessor.java:120)
65) Thread[id=2662, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
66) Thread[id=2650, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-EventThread, state=WAITING, group=TGRP-OverseerTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
at __randomizedtesting.SeedInfo.seed([9105F4BCCBADB5BB]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.OverseerTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=2689, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984) 2) Thread[id=2665, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993) 3) Thread[id=2661, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993) 4) Thread[id=2635, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984) 5) Thread[id=2647, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993) 6) Thread[id=2687, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993) 7) Thread[id=2673, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993) 8) Thread[id=2657, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993) 9) Thread[id=2675, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984) 10) Thread[id=2653, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993) 11) Thread[id=2645, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984) 12) Thread[id=2693, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984) 13) Thread[id=2681, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993) 14) Thread[id=2643, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984) 15) Thread[id=2663, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984) 16) Thread[id=2667, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984) 17) Thread[id=2679, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993) 18) Thread[id=2691, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984) 19) Thread[id=2651, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993) 20) Thread[id=2695, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984) 21) Thread[id=2677, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993) 22) Thread[id=2659, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993) 23) Thread[id=2671, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993) 24) Thread[id=2641, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993) 25) Thread[id=2655, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984) 26) Thread[id=2669, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993) 27) Thread[id=2685, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984) 28) Thread[id=2649, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993) 29) Thread[id=2683, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984) 30) Thread[id=2639, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993) 31) Thread[id=2637, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=2689, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
2) Thread[id=2665, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
3) Thread[id=2661, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
4) Thread[id=2635, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
5) Thread[id=2647, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
6) Thread[id=2687, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
7) Thread[id=2673, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
8) Thread[id=2657, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
9) Thread[id=2675, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
10) Thread[id=2653, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
11) Thread[id=2645, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
12) Thread[id=2693, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
13) Thread[id=2681, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
14) Thread[id=2643, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
15) Thread[id=2663, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
16) Thread[id=2667, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
17) Thread[id=2679, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
18) Thread[id=2691, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
19) Thread[id=2651, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
20) Thread[id=2695, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
21) Thread[id=2677, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
22) Thread[id=2659, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
23) Thread[id=2671, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
24) Thread[id=2641, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
25) Thread[id=2655, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
26) Thread[id=2669, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
27) Thread[id=2685, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
28) Thread[id=2649, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
29) Thread[id=2683, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
30) Thread[id=2639, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
31) Thread[id=2637, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
at __randomizedtesting.SeedInfo.seed([9105F4BCCBADB5BB]:0)
REGRESSION: org.apache.solr.cloud.OverseerTest.testShardAssignmentBigger
Error Message:
Unexpected KeeperException!org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /live_nodes/node33
Stack Trace:
java.lang.AssertionError: Unexpected KeeperException!org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /live_nodes/node33
at __randomizedtesting.SeedInfo.seed([9105F4BCCBADB5BB:2EB0AC721C44AD8]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.OverseerTest$MockZKController.deleteNode(OverseerTest.java:90)
at org.apache.solr.cloud.OverseerTest$MockZKController.close(OverseerTest.java:97)
at org.apache.solr.cloud.OverseerTest.testShardAssignmentBigger(OverseerTest.java:373)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9284 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.OverseerTest
[junit4:junit4] 2> 0 T2536 oas.SolrTestCaseJ4.initCore ####initCore
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-OverseerTest-1364143054240
[junit4:junit4] 2> 1 T2536 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4:junit4] 2> 4 T2536 oas.SolrTestCaseJ4.setUp ###Starting testShardAssignment
[junit4:junit4] 2> 4 T2536 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 5 T2537 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 5 T2537 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 5 T2537 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 5 T2537 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 6 T2537 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 6 T2537 oazsp.FileTxnSnapLog.save Snapshotting: 0x0 to /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-OverseerTest-1364143054240/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 105 T2536 oasc.ZkTestServer.run start zk server on port:48966
[junit4:junit4] 2> 105 T2536 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:48966 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@18f1acd
[junit4:junit4] 2> 106 T2536 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 106 T2542 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:48966. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 107 T2542 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:48966, initiating session
[junit4:junit4] 2> 107 T2538 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:40160
[junit4:junit4] 2> 107 T2538 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:40160
[junit4:junit4] 2> 107 T2540 oazsp.FileTxnLog.append Creating new log file: log.1
[junit4:junit4] 2> 712 T2540 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9d431da60000 with negotiated timeout 10000 for client /127.0.0.1:40160
[junit4:junit4] 2> 712 T2542 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:48966, sessionid = 0x13d9d431da60000, negotiated timeout = 10000
[junit4:junit4] 2> 713 T2543 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18f1acd name:ZooKeeperConnection Watcher:127.0.0.1:48966 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 713 T2536 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 716 T2541 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d9d431da60000
[junit4:junit4] 2> 717 T2538 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:40160 which had sessionid 0x13d9d431da60000
[junit4:junit4] 2> 717 T2543 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 717 T2536 oaz.ZooKeeper.close Session: 0x13d9d431da60000 closed
[junit4:junit4] 2> 718 T2536 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:48966 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@baea11
[junit4:junit4] 2> 720 T2544 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:48966. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 719 T2536 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 720 T2544 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:48966, initiating session
[junit4:junit4] 2> 721 T2538 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:40161
[junit4:junit4] 2> 721 T2538 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:40161
[junit4:junit4] 2> 722 T2540 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9d431da60001 with negotiated timeout 10000 for client /127.0.0.1:40161
[junit4:junit4] 2> 722 T2544 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:48966, sessionid = 0x13d9d431da60001, negotiated timeout = 10000
[junit4:junit4] 2> 723 T2545 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@baea11 name:ZooKeeperConnection Watcher:127.0.0.1:48966 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 723 T2536 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 724 T2536 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 729 T2541 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d9d431da60001
[junit4:junit4] 2> 730 T2545 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 730 T2538 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:40161 which had sessionid 0x13d9d431da60001
[junit4:junit4] 2> 730 T2536 oaz.ZooKeeper.close Session: 0x13d9d431da60001 closed
[junit4:junit4] 2> 731 T2536 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:48966/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@5d496
[junit4:junit4] 2> 733 T2546 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:48966. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 733 T2536 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 733 T2546 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:48966, initiating session
[junit4:junit4] 2> 734 T2538 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:40162
[junit4:junit4] 2> 734 T2538 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:40162
[junit4:junit4] 2> 735 T2540 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9d431da60002 with negotiated timeout 10000 for client /127.0.0.1:40162
[junit4:junit4] 2> 735 T2546 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:48966, sessionid = 0x13d9d431da60002, negotiated timeout = 10000
[junit4:junit4] 2> 736 T2547 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5d496 name:ZooKeeperConnection Watcher:127.0.0.1:48966/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 736 T2536 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 737 T2536 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 741 T2536 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:48966/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@3e88e0
[junit4:junit4] 2> 742 T2536 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 742 T2548 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:48966. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 743 T2548 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:48966, initiating session
[junit4:junit4] 2> 743 T2538 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:40163
[junit4:junit4] 2> 744 T2538 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:40163
[junit4:junit4] 2> 745 T2540 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9d431da60003 with negotiated timeout 10000 for client /127.0.0.1:40163
[junit4:junit4] 2> 745 T2548 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:48966, sessionid = 0x13d9d431da60003, negotiated timeout = 10000
[junit4:junit4] 2> 745 T2549 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3e88e0 name:ZooKeeperConnection Watcher:127.0.0.1:48966/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 746 T2536 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 748 T2536 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 756 T2541 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9d431da60003 type:delete cxid:0x9 zxid:0xc txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 757 T2536 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 760 T2536 oasc.Overseer.start Overseer (id=89400479203065859-127.0.0.1:48966_solr-n_0000000000) starting
[junit4:junit4] 2> 773 T2541 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9d431da60003 type:create cxid:0xf zxid:0xf txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 775 T2536 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 779 T2541 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9d431da60003 type:create cxid:0x15 zxid:0x11 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 781 T2536 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 786 T2541 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9d431da60003 type:create cxid:0x1b zxid:0x13 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 787 T2536 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 792 T2551 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 792 T2536 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 793 T2550 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 796 T2536 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 799 T2536 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 803 T2536 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:48966/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@13000ef
[junit4:junit4] 2> 805 T2552 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:48966. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 804 T2536 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 805 T2552 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:48966, initiating session
[junit4:junit4] 2> 805 T2538 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:40164
[junit4:junit4] 2> 806 T2538 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:40164
[junit4:junit4] 2> 807 T2540 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9d431da60004 with negotiated timeout 10000 for client /127.0.0.1:40164
[junit4:junit4] 2> 807 T2552 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:48966, sessionid = 0x13d9d431da60004, negotiated timeout = 10000
[junit4:junit4] 2> 808 T2553 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13000ef name:ZooKeeperConnection Watcher:127.0.0.1:48966/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 808 T2536 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 811 T2536 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 814 T2536 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1
[junit4:junit4] 2> 819 T2553 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4] 2> 819 T2547 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4] 2> 819 T2541 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9d431da60004 type:create cxid:0xc zxid:0x19 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2299 T2550 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 2301 T2550 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core":"core1",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4:junit4] 2> 2301 T2550 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 3
[junit4:junit4] 2> 2301 T2550 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 2308 T2553 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 2308 T2547 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 2323 T2536 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 2345 T2541 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9d431da60004 type:delete cxid:0x1e zxid:0x25 txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders
[junit4:junit4] 2> 2346 T2536 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 2353 T2541 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9d431da60004 type:create cxid:0x26 zxid:0x28 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 2357 T2541 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9d431da60004 type:create cxid:0x29 zxid:0x2a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3815 T2550 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 3823 T2550 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core":"core2",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4:junit4] 2> 3823 T2550 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 3823 T2550 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 3830 T2547 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3830 T2553 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 3860 T2536 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 3870 T2541 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9d431da60004 type:delete cxid:0x38 zxid:0x36 txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard2 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard2
[junit4:junit4] 2> 3871 T2536 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 3876 T2541 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9d431da60004 type:create cxid:0x3f zxid:0x38 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 3880 T2541 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9d431da60004 type:create cxid:0x42 zxid:0x3a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 5340 T2550 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 5346 T2550 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core":"core3",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4:junit4] 2> 5346 T2550 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 5347 T2550 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4:junit4] 2> 5352 T2553 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 5352 T2547 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 5383 T2536 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4:junit4] 2> 5392 T2541 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9d431da60004 type:delete cxid:0x51 zxid:0x46 txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leaders/shard3 Error:KeeperErrorCode = NoNode for /solr/collections/collection1/leaders/shard3
[junit4:junit4] 2> 5392 T2536 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4:junit4] 2> 5397 T2541 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9d431da60004 type:create cxid:0x58 zxid:0x48 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 5400 T2541 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9d431da60004 type:create cxid:0x5b zxid:0x4a txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 6862 T2550 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 6876 T2550 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core":"core4",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4:junit4] 2> 6876 T2550 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 6876 T2550 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4:junit4] 2> 6883 T2553 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 6883 T2547 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 6904 T2536 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 6908 T2541 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9d431da60004 type:create cxid:0x65 zxid:0x53 txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard1/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 6912 T2541 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9d431da60004 type:create cxid:0x69 zxid:0x55 txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 8393 T2550 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 8395 T2550 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core":"core5",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4:junit4] 2> 8395 T2550 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 8395 T2550 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4:junit4] 2> 8403 T2553 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 8403 T2547 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 8415 T2536 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 8420 T2541 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9d431da60004 type:create cxid:0x73 zxid:0x5b txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard2/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 8425 T2541 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9d431da60004 type:create cxid:0x77 zxid:0x5d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 9910 T2550 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 9911 T2550 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core":"core6",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1",
[junit4:junit4] 2> "base_url":"http://127.0.0.1/solr/"}
[junit4:junit4] 2> 9912 T2550 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 9912 T2550 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4:junit4] 2> 9920 T2547 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 9920 T2553 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 9928 T2536 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4:junit4] 2> 9933 T2541 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9d431da60004 type:create cxid:0x81 zxid:0x63 txntype:-1 reqpath:n/a Error Path:/solr/collections/collection1/leader_elect/shard3/election Error:KeeperErrorCode = NodeExists for /solr/collections/collection1/leader_elect/shard3/election
[junit4:junit4] 2> 9937 T2541 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d9d431da60002
[junit4:junit4] 2> 9938 T2547 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 9938 T2536 oaz.ZooKeeper.close Session: 0x13d9d431da60002 closed
[junit4:junit4] 2> 9938 T2538 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:40162 which had sessionid 0x13d9d431da60002
[junit4:junit4] 2> 9942 T2541 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d9d431da60004
[junit4:junit4] 2> 9942 T2553 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4:junit4] 2> 9942 T2553 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 0)
[junit4:junit4] 2> 9943 T2538 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:40164 which had sessionid 0x13d9d431da60004
[junit4:junit4] 2> 9943 T2536 oaz.ZooKeeper.close Session: 0x13d9d431da60004 closed
[junit4:junit4] 2> 9944 T2541 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d9d431da60003
[junit4:junit4] 2> 9945 T2549 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 9945 T2538 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:40163 which had sessionid 0x13d9d431da60003
[junit4:junit4] 2> 9945 T2536 oaz.ZooKeeper.close Session: 0x13d9d431da60003 closed
[junit4:junit4] 2> 9946 T2536 oazs.ZooKeeperServer.shutdown shutting down
[junit4:junit4] 2> 9946 T2536 oazs.SessionTrackerImpl.shutdown Shutting down
[junit4:junit4] 2> 9947 T2536 oazs.PrepRequestProcessor.shutdown Shutting down
[junit4:junit4] 2> 9947 T2541 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop!
[junit4:junit4] 2> 9947 T2536 oazs.SyncRequestProcessor.shutdown Shutting down
[junit4:junit4] 2> 9948 T2540 oazs.SyncRequestProcessor.run SyncRequestProcessor exited!
[junit4:junit4] 2> 9949 T2536 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4] 2> 9951 T2536 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:48966 48966
[junit4:junit4] 2> 9952 T2538 oazs.NIOServerCnxnFactory.run NIOServerCnxn factory exited run method
[junit4:junit4] 2> 9953 T2536 oazs.ZooKeeperServer.shutdown shutting down
[junit4:junit4] 2> 9953 T2536 oazs.SessionTrackerImpl.shutdown Shutting down
[junit4:junit4] 2> 9954 T2536 oazs.PrepRequestProcessor.shutdown Shutting down
[junit4:junit4] 2> 9954 T2536 oazs.SyncRequestProcessor.shutdown Shutting down
[junit4:junit4] 2> 9954 T2536 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete
[junit4:junit4] 2> 9955 T2536 oas.SolrTestCaseJ4.tearDown ###Ending testShardAssignment
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 9964 T2536 oas.SolrTestCaseJ4.setUp ###Starting testShardAssignmentBigger
[junit4:junit4] 2> 9965 T2536 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 9966 T2554 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 9966 T2554 oazs.ZooKeeperServer.setTickTime tickTime set to 1000
[junit4:junit4] 2> 9966 T2554 oazs.ZooKeeperServer.setMinSessionTimeout minSessionTimeout set to -1
[junit4:junit4] 2> 9966 T2554 oazs.ZooKeeperServer.setMaxSessionTimeout maxSessionTimeout set to -1
[junit4:junit4] 2> 9967 T2554 oazs.NIOServerCnxnFactory.configure binding to port 0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> 9968 T2554 oazsp.FileSnap.deserialize Reading snapshot /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-OverseerTest-1364143054240/zookeeper/server1/data/version-2/snapshot.0
[junit4:junit4] 2> 9978 T2554 oazsp.FileTxnSnapLog.save Snapshotting: 0x68 to /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-OverseerTest-1364143054240/zookeeper/server1/data/version-2/snapshot.68
[junit4:junit4] 2> 10066 T2536 oasc.ZkTestServer.run start zk server on port:33786
[junit4:junit4] 2> 10067 T2536 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33786 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@129930b
[junit4:junit4] 2> 10068 T2559 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33786. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 10068 T2536 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 10068 T2559 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33786, initiating session
[junit4:junit4] 2> 10069 T2555 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48631
[junit4:junit4] 2> 10069 T2555 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48631
[junit4:junit4] 2> 10069 T2557 oazsp.FileTxnLog.append Creating new log file: log.69
[junit4:junit4] 2> 10091 T2557 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9d43449b0000 with negotiated timeout 10000 for client /127.0.0.1:48631
[junit4:junit4] 2> 10091 T2559 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33786, sessionid = 0x13d9d43449b0000, negotiated timeout = 10000
[junit4:junit4] 2> 10092 T2560 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@129930b name:ZooKeeperConnection Watcher:127.0.0.1:33786 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 10092 T2536 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 10132 T2558 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d9d43449b0000
[junit4:junit4] 2> 10133 T2555 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48631 which had sessionid 0x13d9d43449b0000
[junit4:junit4] 2> 10133 T2560 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 10133 T2536 oaz.ZooKeeper.close Session: 0x13d9d43449b0000 closed
[junit4:junit4] 2> 10134 T2536 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33786 sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1a818f4
[junit4:junit4] 2> 10135 T2561 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33786. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 10135 T2536 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 10136 T2561 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33786, initiating session
[junit4:junit4] 2> 10136 T2555 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48632
[junit4:junit4] 2> 10137 T2555 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48632
[junit4:junit4] 2> 10138 T2557 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9d43449b0001 with negotiated timeout 10000 for client /127.0.0.1:48632
[junit4:junit4] 2> 10138 T2561 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33786, sessionid = 0x13d9d43449b0001, negotiated timeout = 10000
[junit4:junit4] 2> 10138 T2562 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a818f4 name:ZooKeeperConnection Watcher:127.0.0.1:33786 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 10139 T2536 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 10139 T2536 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 10144 T2558 oazs.PrepRequestProcessor.pRequest2Txn Processed session termination for sessionid: 0x13d9d43449b0001
[junit4:junit4] 2> 10145 T2555 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:48632 which had sessionid 0x13d9d43449b0001
[junit4:junit4] 2> 10145 T2562 oaz.ClientCnxn$EventThread.run EventThread shut down
[junit4:junit4] 2> 10145 T2536 oaz.ZooKeeper.close Session: 0x13d9d43449b0001 closed
[junit4:junit4] 2> 10146 T2536 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33786/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@14adfa5
[junit4:junit4] 2> 10147 T2563 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33786. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 10147 T2536 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 10147 T2563 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33786, initiating session
[junit4:junit4] 2> 10148 T2555 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48633
[junit4:junit4] 2> 10148 T2555 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48633
[junit4:junit4] 2> 10149 T2557 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9d43449b0002 with negotiated timeout 10000 for client /127.0.0.1:48633
[junit4:junit4] 2> 10149 T2563 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33786, sessionid = 0x13d9d43449b0002, negotiated timeout = 10000
[junit4:junit4] 2> 10150 T2564 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14adfa5 name:ZooKeeperConnection Watcher:127.0.0.1:33786/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 10150 T2536 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 10151 T2536 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 10155 T2536 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33786/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@2c7aaa
[junit4:junit4] 2> 10156 T2565 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33786. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 10156 T2536 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 10156 T2565 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33786, initiating session
[junit4:junit4] 2> 10157 T2555 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48634
[junit4:junit4] 2> 10157 T2555 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48634
[junit4:junit4] 2> 10158 T2557 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9d43449b0003 with negotiated timeout 10000 for client /127.0.0.1:48634
[junit4:junit4] 2> 10158 T2565 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33786, sessionid = 0x13d9d43449b0003, negotiated timeout = 10000
[junit4:junit4] 2> 10159 T2566 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2c7aaa name:ZooKeeperConnection Watcher:127.0.0.1:33786/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 10159 T2536 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 10161 T2536 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 10169 T2558 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9d43449b0003 type:delete cxid:0x9 zxid:0x88 txntype:-1 reqpath:n/a Error Path:/solr/overseer_elect/leader Error:KeeperErrorCode = NoNode for /solr/overseer_elect/leader
[junit4:junit4] 2> 10170 T2536 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 10174 T2536 oasc.Overseer.start Overseer (id=89400479856656387-127.0.0.1:33786_solr-n_0000000000) starting
[junit4:junit4] 2> 10176 T2558 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9d43449b0003 type:create cxid:0xf zxid:0x8b txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 10177 T2536 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 10182 T2558 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9d43449b0003 type:create cxid:0x15 zxid:0x8d txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 10183 T2536 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 10188 T2558 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x13d9d43449b0003 type:create cxid:0x1b zxid:0x8f txntype:-1 reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer
[junit4:junit4] 2> 10189 T2536 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 10193 T2568 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 10194 T2536 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 10194 T2567 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 10197 T2536 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 10199 T2536 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 10202 T2536 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33786/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@12017c1
[junit4:junit4] 2> 10204 T2569 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33786. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 10204 T2536 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 10204 T2569 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33786, initiating session
[junit4:junit4] 2> 10205 T2555 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48635
[junit4:junit4] 2> 10205 T2555 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48635
[junit4:junit4] 2> 10206 T2557 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9d43449b0004 with negotiated timeout 10000 for client /127.0.0.1:48635
[junit4:junit4] 2> 10206 T2569 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33786, sessionid = 0x13d9d43449b0004, negotiated timeout = 10000
[junit4:junit4] 2> 10207 T2570 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12017c1 name:ZooKeeperConnection Watcher:127.0.0.1:33786/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 10207 T2536 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 10210 T2536 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 10213 T2536 oascc.SolrZkClient.makePath makePath: /live_nodes/node0
[junit4:junit4] 2> 10218 T2564 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4] 2> 10218 T2570 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4] 2> 10218 T2536 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33786/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@86ea65
[junit4:junit4] 2> 10219 T2571 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33786. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 10219 T2536 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 10220 T2571 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33786, initiating session
[junit4:junit4] 2> 10220 T2555 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48636
[junit4:junit4] 2> 10220 T2555 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48636
[junit4:junit4] 2> 10222 T2557 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9d43449b0005 with negotiated timeout 10000 for client /127.0.0.1:48636
[junit4:junit4] 2> 10222 T2571 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33786, sessionid = 0x13d9d43449b0005, negotiated timeout = 10000
[junit4:junit4] 2> 10223 T2572 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@86ea65 name:ZooKeeperConnection Watcher:127.0.0.1:33786/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 10223 T2536 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 10226 T2536 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 10230 T2536 oascc.SolrZkClient.makePath makePath: /live_nodes/node1
[junit4:junit4] 2> 10235 T2570 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 10235 T2572 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 10235 T2564 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 10235 T2536 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33786/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@158bca
[junit4:junit4] 2> 10237 T2573 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33786. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 10237 T2536 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 10237 T2573 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33786, initiating session
[junit4:junit4] 2> 10237 T2555 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48637
[junit4:junit4] 2> 10238 T2555 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48637
[junit4:junit4] 2> 10239 T2557 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9d43449b0006 with negotiated timeout 10000 for client /127.0.0.1:48637
[junit4:junit4] 2> 10239 T2573 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33786, sessionid = 0x13d9d43449b0006, negotiated timeout = 10000
[junit4:junit4] 2> 10239 T2574 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@158bca name:ZooKeeperConnection Watcher:127.0.0.1:33786/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 10240 T2536 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 10242 T2536 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 10246 T2536 oascc.SolrZkClient.makePath makePath: /live_nodes/node2
[junit4:junit4] 2> 10250 T2572 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 10250 T2564 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 10250 T2570 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 10251 T2574 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 10251 T2536 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33786/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1b3adb1
[junit4:junit4] 2> 10252 T2575 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33786. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 10252 T2536 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 10252 T2575 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33786, initiating session
[junit4:junit4] 2> 10253 T2555 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48638
[junit4:junit4] 2> 10253 T2555 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48638
[junit4:junit4] 2> 10254 T2557 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9d43449b0007 with negotiated timeout 10000 for client /127.0.0.1:48638
[junit4:junit4] 2> 10254 T2575 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33786, sessionid = 0x13d9d43449b0007, negotiated timeout = 10000
[junit4:junit4] 2> 10255 T2576 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b3adb1 name:ZooKeeperConnection Watcher:127.0.0.1:33786/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 10255 T2536 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 10258 T2536 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 10262 T2536 oascc.SolrZkClient.makePath makePath: /live_nodes/node3
[junit4:junit4] 2> 10267 T2576 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 10267 T2564 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 10267 T2572 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 10267 T2574 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 10267 T2570 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 10267 T2536 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33786/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@d05471
[junit4:junit4] 2> 10269 T2577 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33786. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 10269 T2536 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 10269 T2577 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33786, initiating session
[junit4:junit4] 2> 10270 T2555 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48639
[junit4:junit4] 2> 10270 T2555 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48639
[junit4:junit4] 2> 10271 T2557 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9d43449b0008 with negotiated timeout 10000 for client /127.0.0.1:48639
[junit4:junit4] 2> 10271 T2577 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33786, sessionid = 0x13d9d43449b0008, negotiated timeout = 10000
[junit4:junit4] 2> 10272 T2578 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d05471 name:ZooKeeperConnection Watcher:127.0.0.1:33786/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 10272 T2536 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 10275 T2536 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 10279 T2536 oascc.SolrZkClient.makePath makePath: /live_nodes/node4
[junit4:junit4] 2> 10283 T2576 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 10283 T2564 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 10283 T2570 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 10283 T2578 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 10283 T2574 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 10283 T2572 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 10284 T2536 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33786/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@ae34b8
[junit4:junit4] 2> 10286 T2579 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33786. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 10285 T2536 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 10286 T2579 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33786, initiating session
[junit4:junit4] 2> 10286 T2555 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48640
[junit4:junit4] 2> 10287 T2555 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48640
[junit4:junit4] 2> 10288 T2557 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9d43449b0009 with negotiated timeout 10000 for client /127.0.0.1:48640
[junit4:junit4] 2> 10288 T2579 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33786, sessionid = 0x13d9d43449b0009, negotiated timeout = 10000
[junit4:junit4] 2> 10288 T2580 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ae34b8 name:ZooKeeperConnection Watcher:127.0.0.1:33786/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 10289 T2536 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 10292 T2536 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 10296 T2536 oascc.SolrZkClient.makePath makePath: /live_nodes/node5
[junit4:junit4] 2> 10300 T2576 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 10300 T2564 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 10300 T2578 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 10300 T2572 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 10301 T2574 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 10301 T2580 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 10301 T2570 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 10301 T2536 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33786/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1d9e15e
[junit4:junit4] 2> 10302 T2581 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33786. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 10302 T2536 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 10303 T2581 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33786, initiating session
[junit4:junit4] 2> 10303 T2555 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48641
[junit4:junit4] 2> 10303 T2555 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48641
[junit4:junit4] 2> 10304 T2557 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9d43449b000a with negotiated timeout 10000 for client /127.0.0.1:48641
[junit4:junit4] 2> 10305 T2581 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33786, sessionid = 0x13d9d43449b000a, negotiated timeout = 10000
[junit4:junit4] 2> 10305 T2582 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d9e15e name:ZooKeeperConnection Watcher:127.0.0.1:33786/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 10305 T2536 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 10308 T2536 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 10312 T2536 oascc.SolrZkClient.makePath makePath: /live_nodes/node6
[junit4:junit4] 2> 10317 T2576 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 10317 T2574 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 10317 T2578 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 10317 T2564 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 10317 T2580 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 10317 T2572 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 10317 T2570 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 10318 T2536 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33786/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@169998a
[junit4:junit4] 2> 10318 T2582 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 10319 T2583 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33786. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 10319 T2536 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 10320 T2583 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33786, initiating session
[junit4:junit4] 2> 10320 T2555 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48642
[junit4:junit4] 2> 10320 T2555 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48642
[junit4:junit4] 2> 10322 T2557 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9d43449b000b with negotiated timeout 10000 for client /127.0.0.1:48642
[junit4:junit4] 2> 10322 T2583 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33786, sessionid = 0x13d9d43449b000b, negotiated timeout = 10000
[junit4:junit4] 2> 10322 T2584 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@169998a name:ZooKeeperConnection Watcher:127.0.0.1:33786/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 10323 T2536 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 10325 T2536 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 10329 T2536 oascc.SolrZkClient.makePath makePath: /live_nodes/node7
[junit4:junit4] 2> 10334 T2570 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 10334 T2582 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 10334 T2574 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 10335 T2576 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 10335 T2578 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 10334 T2564 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 10335 T2584 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 10335 T2572 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 10335 T2580 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 10335 T2536 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33786/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@70e3b3
[junit4:junit4] 2> 10337 T2585 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33786. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 10337 T2536 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 10348 T2585 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33786, initiating session
[junit4:junit4] 2> 10348 T2555 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48643
[junit4:junit4] 2> 10349 T2555 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48643
[junit4:junit4] 2> 10350 T2557 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9d43449b000c with negotiated timeout 10000 for client /127.0.0.1:48643
[junit4:junit4] 2> 10350 T2585 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33786, sessionid = 0x13d9d43449b000c, negotiated timeout = 10000
[junit4:junit4] 2> 10351 T2586 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@70e3b3 name:ZooKeeperConnection Watcher:127.0.0.1:33786/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 10351 T2536 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 10354 T2536 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 10357 T2536 oascc.SolrZkClient.makePath makePath: /live_nodes/node8
[junit4:junit4] 2> 10362 T2576 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4] 2> 10362 T2564 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4] 2> 10362 T2574 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4] 2> 10363 T2584 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4] 2> 10363 T2580 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4] 2> 10363 T2572 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4] 2> 10363 T2582 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4] 2> 10363 T2586 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4] 2> 10364 T2578 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4] 2> 10364 T2570 oascc.ZkStateReader$3.process Updating live nodes... (9)
[junit4:junit4] 2> 10364 T2536 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33786/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1b997aa
[junit4:junit4] 2> 10366 T2536 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 10366 T2587 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33786. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 10367 T2587 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33786, initiating session
[junit4:junit4] 2> 10367 T2555 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48644
[junit4:junit4] 2> 10368 T2555 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48644
[junit4:junit4] 2> 10369 T2557 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9d43449b000d with negotiated timeout 10000 for client /127.0.0.1:48644
[junit4:junit4] 2> 10369 T2587 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33786, sessionid = 0x13d9d43449b000d, negotiated timeout = 10000
[junit4:junit4] 2> 10369 T2588 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b997aa name:ZooKeeperConnection Watcher:127.0.0.1:33786/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 10369 T2536 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 10372 T2536 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 10376 T2536 oascc.SolrZkClient.makePath makePath: /live_nodes/node9
[junit4:junit4] 2> 10380 T2582 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4] 2> 10381 T2574 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4] 2> 10381 T2578 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4] 2> 10381 T2586 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4] 2> 10381 T2564 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4] 2> 10381 T2572 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4] 2> 10381 T2570 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4] 2> 10382 T2588 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4] 2> 10381 T2580 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4] 2> 10381 T2576 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4] 2> 10381 T2584 oascc.ZkStateReader$3.process Updating live nodes... (10)
[junit4:junit4] 2> 10382 T2536 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33786/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@96a91c
[junit4:junit4] 2> 10384 T2589 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33786. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 10384 T2536 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 10384 T2589 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33786, initiating session
[junit4:junit4] 2> 10385 T2555 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48645
[junit4:junit4] 2> 10385 T2555 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48645
[junit4:junit4] 2> 10386 T2557 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9d43449b000e with negotiated timeout 10000 for client /127.0.0.1:48645
[junit4:junit4] 2> 10386 T2589 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33786, sessionid = 0x13d9d43449b000e, negotiated timeout = 10000
[junit4:junit4] 2> 10387 T2590 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@96a91c name:ZooKeeperConnection Watcher:127.0.0.1:33786/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 10387 T2536 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 10390 T2536 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 10393 T2536 oascc.SolrZkClient.makePath makePath: /live_nodes/node10
[junit4:junit4] 2> 10398 T2564 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4] 2> 10398 T2576 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4] 2> 10398 T2570 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4] 2> 10398 T2572 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4] 2> 10398 T2582 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4] 2> 10399 T2586 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4] 2> 10399 T2574 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4] 2> 10399 T2590 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4] 2> 10399 T2584 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4] 2> 10399 T2588 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4] 2> 10399 T2580 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4] 2> 10399 T2536 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33786/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1debe32
[junit4:junit4] 2> 10399 T2578 oascc.ZkStateReader$3.process Updating live nodes... (11)
[junit4:junit4] 2> 10401 T2591 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33786. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 10401 T2536 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 10401 T2591 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33786, initiating session
[junit4:junit4] 2> 10402 T2555 oazs.NIOServerCnxnFactory.run Accepted socket connection from /127.0.0.1:48646
[junit4:junit4] 2> 10402 T2555 oazs.ZooKeeperServer.processConnectRequest Client attempting to establish new session at /127.0.0.1:48646
[junit4:junit4] 2> 10403 T2557 oazs.ZooKeeperServer.finishSessionInit Established session 0x13d9d43449b000f with negotiated timeout 10000 for client /127.0.0.1:48646
[junit4:junit4] 2> 10403 T2591 oaz.ClientCnxn$SendThread.onConnected Session establishment complete on server localhost.localdomain/127.0.0.1:33786, sessionid = 0x13d9d43449b000f, negotiated timeout = 10000
[junit4:junit4] 2> 10404 T2592 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1debe32 name:ZooKeeperConnection Watcher:127.0.0.1:33786/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 10404 T2536 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 10407 T2536 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 10410 T2536 oascc.SolrZkClient.makePath makePath: /live_nodes/node11
[junit4:junit4] 2> 10415 T2574 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4] 2> 10415 T2586 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4] 2> 10415 T2564 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4] 2> 10416 T2570 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4] 2> 10416 T2584 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4] 2> 10415 T2592 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4] 2> 10416 T2588 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4] 2> 10416 T2578 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4] 2> 10416 T2572 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4] 2> 10416 T2590 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4] 2> 10416 T2576 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4] 2> 10417 T2536 oaz.ZooKeeper.<init> Initiating client connection, connectString=127.0.0.1:33786/solr sessionTimeout=10000 watcher=org.apache.solr.common.cloud.ConnectionManager@1bf4f32
[junit4:junit4] 2> 10416 T2582 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4] 2> 10416 T2580 oascc.ZkStateReader$3.process Updating live nodes... (12)
[junit4:junit4] 2> 10419 T2593 oaz.ClientCnxn$SendThread.logStartConnect Opening socket connection to server localhost.localdomain/127.0.0.1:33786. Will not attempt to authenticate using SASL (access denied ("javax.security.auth.AuthPermission" "getLoginConfiguration"))
[junit4:junit4] 2> 10419 T2536 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 10419 T2593 oaz.ClientCnxn$SendThread.primeConnection Socket connection established to localhost.localdomain/127.0.0.1:33786, initiating session
[junit4:junit4] 2> 10419 T2555 oazs.NIOServerCnxnFactory.run Accepted socket co
[...truncated too long message...]
ntCnxn.java:984)
[junit4:junit4] > 15) Thread[id=2663, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4] > at java.lang.Thread.sleep(Native Method)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
[junit4:junit4] > 16) Thread[id=2667, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4] > at java.lang.Thread.sleep(Native Method)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
[junit4:junit4] > 17) Thread[id=2679, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4] > at java.lang.Thread.sleep(Native Method)
[junit4:junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4:junit4] > 18) Thread[id=2691, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4] > at java.lang.Thread.sleep(Native Method)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
[junit4:junit4] > 19) Thread[id=2651, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4] > at java.lang.Thread.sleep(Native Method)
[junit4:junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4:junit4] > 20) Thread[id=2695, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4] > at java.lang.Thread.sleep(Native Method)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
[junit4:junit4] > 21) Thread[id=2677, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4] > at java.lang.Thread.sleep(Native Method)
[junit4:junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4:junit4] > 22) Thread[id=2659, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4] > at java.lang.Thread.sleep(Native Method)
[junit4:junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4:junit4] > 23) Thread[id=2671, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4] > at java.lang.Thread.sleep(Native Method)
[junit4:junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4:junit4] > 24) Thread[id=2641, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4] > at java.lang.Thread.sleep(Native Method)
[junit4:junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4:junit4] > 25) Thread[id=2655, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4] > at java.lang.Thread.sleep(Native Method)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
[junit4:junit4] > 26) Thread[id=2669, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4] > at java.lang.Thread.sleep(Native Method)
[junit4:junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4:junit4] > 27) Thread[id=2685, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4] > at java.lang.Thread.sleep(Native Method)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
[junit4:junit4] > 28) Thread[id=2649, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4] > at java.lang.Thread.sleep(Native Method)
[junit4:junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4:junit4] > 29) Thread[id=2683, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4] > at java.lang.Thread.sleep(Native Method)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
[junit4:junit4] > 30) Thread[id=2639, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4] > at java.lang.Thread.sleep(Native Method)
[junit4:junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4:junit4] > 31) Thread[id=2637, name=TEST-OverseerTest.testShardAssignmentBigger-seed#[9105F4BCCBADB5BB]-SendThread(localhost.localdomain:33786), state=TIMED_WAITING, group=TGRP-OverseerTest]
[junit4:junit4] > at java.lang.Thread.sleep(Native Method)
[junit4:junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4:junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([9105F4BCCBADB5BB]:0)
[junit4:junit4] Completed on J1 in 93.25s, 8 tests, 2 failures, 2 errors <<< FAILURES!
[...truncated 407 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:375: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:355: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:183: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:449: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1209: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:873: There were test failures: 272 suites, 1146 tests, 3 suite-level errors, 1 failure, 440 ignored (5 assumptions)
Total time: 33 minutes 22 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Description set: Java: 32bit/jdk1.7.0_15 -server -XX:+UseConcMarkSweepGC
Email was triggered for: Failure
Sending email for trigger: Failure