You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2015/04/20 03:48:26 UTC
[JENKINS] Lucene-Solr-5.x-MacOSX (64bit/jdk1.8.0) - Build # 2153 -
Still Failing!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-MacOSX/2153/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseParallelGC
4 tests failed.
FAILED: org.apache.solr.cloud.TestMiniSolrCloudCluster.testBasics
Error Message:
expected:<5> but was:<4>
Stack Trace:
java.lang.AssertionError: expected:<5> but was:<4>
at __randomizedtesting.SeedInfo.seed([C563256C83F18FB6:F8BB8B40BB1FD1C6]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.TestMiniSolrCloudCluster.testBasics(TestMiniSolrCloudCluster.java:84)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestMiniSolrCloudCluster
Error Message:
19 threads leaked from SUITE scope at org.apache.solr.cloud.TestMiniSolrCloudCluster: 1) Thread[id=9923, name=OverseerStateUpdate-93683341599768585-127.0.0.1:54749_solr-n_0000000001, state=TIMED_WAITING, group=Overseer state updater.] at java.lang.Object.wait(Native Method) at org.apache.solr.cloud.DistributedQueue$LatchWatcher.await(DistributedQueue.java:276) at org.apache.solr.cloud.DistributedQueue.getChildren(DistributedQueue.java:320) at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:594) at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:572) at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:191) at java.lang.Thread.run(Thread.java:745) 2) Thread[id=9841, name=qtp1365033291-9841 Acceptor0 SelectChannelConnector@127.0.0.1:54749, state=RUNNABLE, group=TGRP-TestMiniSolrCloudCluster] at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422) at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250) at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109) at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Thread.java:745) 3) Thread[id=9891, name=jetty-launcher-1611-thread-3-EventThread, state=WAITING, group=TGRP-TestMiniSolrCloudCluster] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494) 4) Thread[id=9926, name=zkCallback-1623-thread-3, state=TIMED_WAITING, group=TGRP-TestMiniSolrCloudCluster] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 5) Thread[id=9848, name=qtp1365033291-9848 Selector0, state=RUNNABLE, group=TGRP-TestMiniSolrCloudCluster] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:198) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569) at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Thread.java:745) 6) Thread[id=9924, name=OverseerCollectionProcessor-93683341599768585-127.0.0.1:54749_solr-n_0000000001, state=TIMED_WAITING, group=Overseer collection creation process.] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:342) at org.apache.solr.cloud.OverseerCollectionProcessor.amILeader(OverseerCollectionProcessor.java:510) at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:268) at java.lang.Thread.run(Thread.java:745) 7) Thread[id=9912, name=Thread-3507, state=WAITING, group=TGRP-TestMiniSolrCloudCluster] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.solr.core.CloserThread.run(CoreContainer.java:908) 8) Thread[id=9844, name=qtp1365033291-9844, state=TIMED_WAITING, group=TGRP-TestMiniSolrCloudCluster] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:342) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:526) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:44) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572) at java.lang.Thread.run(Thread.java:745) 9) Thread[id=9847, name=qtp1365033291-9847, state=TIMED_WAITING, group=TGRP-TestMiniSolrCloudCluster] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:342) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:526) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:44) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572) at java.lang.Thread.run(Thread.java:745) 10) Thread[id=9925, name=OverseerHdfsCoreFailoverThread-93683341599768585-127.0.0.1:54749_solr-n_0000000001, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76) at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:308) at org.apache.solr.common.cloud.ZkStateReader.getClusterProps(ZkStateReader.java:758) at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.doWork(OverseerAutoReplicaFailoverThread.java:152) at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:131) at java.lang.Thread.run(Thread.java:745) 11) Thread[id=9849, name=qtp1365033291-9849, state=TIMED_WAITING, group=TGRP-TestMiniSolrCloudCluster] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:342) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:526) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:44) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572) at java.lang.Thread.run(Thread.java:745) 12) Thread[id=9927, name=zkCallback-1623-thread-4, state=TIMED_WAITING, group=TGRP-TestMiniSolrCloudCluster] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 13) Thread[id=9842, name=qtp1365033291-9842, state=TIMED_WAITING, group=TGRP-TestMiniSolrCloudCluster] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:342) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:526) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:44) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572) at java.lang.Thread.run(Thread.java:745) 14) Thread[id=9922, name=zkCallback-1623-thread-2, state=TIMED_WAITING, group=TGRP-TestMiniSolrCloudCluster] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 15) Thread[id=9843, name=qtp1365033291-9843, state=TIMED_WAITING, group=TGRP-TestMiniSolrCloudCluster] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:342) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:526) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:44) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572) at java.lang.Thread.run(Thread.java:745) 16) Thread[id=9846, name=qtp1365033291-9846, state=TIMED_WAITING, group=TGRP-TestMiniSolrCloudCluster] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:342) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:526) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:44) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572) at java.lang.Thread.run(Thread.java:745) 17) Thread[id=9892, name=zkCallback-1623-thread-1, state=TIMED_WAITING, group=TGRP-TestMiniSolrCloudCluster] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 18) Thread[id=9821, name=HashSessionScavenger-277, state=TIMED_WAITING, group=TGRP-TestMiniSolrCloudCluster] at java.lang.Object.wait(Native Method) at java.util.TimerThread.mainLoop(Timer.java:552) at java.util.TimerThread.run(Timer.java:505) 19) Thread[id=9890, name=jetty-launcher-1611-thread-3-SendThread(127.0.0.1:54741), state=TIMED_WAITING, group=TGRP-TestMiniSolrCloudCluster] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:230) at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1185) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1110)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 19 threads leaked from SUITE scope at org.apache.solr.cloud.TestMiniSolrCloudCluster:
1) Thread[id=9923, name=OverseerStateUpdate-93683341599768585-127.0.0.1:54749_solr-n_0000000001, state=TIMED_WAITING, group=Overseer state updater.]
at java.lang.Object.wait(Native Method)
at org.apache.solr.cloud.DistributedQueue$LatchWatcher.await(DistributedQueue.java:276)
at org.apache.solr.cloud.DistributedQueue.getChildren(DistributedQueue.java:320)
at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:594)
at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:572)
at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:191)
at java.lang.Thread.run(Thread.java:745)
2) Thread[id=9841, name=qtp1365033291-9841 Acceptor0 SelectChannelConnector@127.0.0.1:54749, state=RUNNABLE, group=TGRP-TestMiniSolrCloudCluster]
at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422)
at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250)
at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
at java.lang.Thread.run(Thread.java:745)
3) Thread[id=9891, name=jetty-launcher-1611-thread-3-EventThread, state=WAITING, group=TGRP-TestMiniSolrCloudCluster]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
4) Thread[id=9926, name=zkCallback-1623-thread-3, state=TIMED_WAITING, group=TGRP-TestMiniSolrCloudCluster]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
5) Thread[id=9848, name=qtp1365033291-9848 Selector0, state=RUNNABLE, group=TGRP-TestMiniSolrCloudCluster]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:198)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:103)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
at java.lang.Thread.run(Thread.java:745)
6) Thread[id=9924, name=OverseerCollectionProcessor-93683341599768585-127.0.0.1:54749_solr-n_0000000001, state=TIMED_WAITING, group=Overseer collection creation process.]
at java.lang.Thread.sleep(Native Method)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:342)
at org.apache.solr.cloud.OverseerCollectionProcessor.amILeader(OverseerCollectionProcessor.java:510)
at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:268)
at java.lang.Thread.run(Thread.java:745)
7) Thread[id=9912, name=Thread-3507, state=WAITING, group=TGRP-TestMiniSolrCloudCluster]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at org.apache.solr.core.CloserThread.run(CoreContainer.java:908)
8) Thread[id=9844, name=qtp1365033291-9844, state=TIMED_WAITING, group=TGRP-TestMiniSolrCloudCluster]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:342)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:526)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:44)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
at java.lang.Thread.run(Thread.java:745)
9) Thread[id=9847, name=qtp1365033291-9847, state=TIMED_WAITING, group=TGRP-TestMiniSolrCloudCluster]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:342)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:526)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:44)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
at java.lang.Thread.run(Thread.java:745)
10) Thread[id=9925, name=OverseerHdfsCoreFailoverThread-93683341599768585-127.0.0.1:54749_solr-n_0000000001, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
at java.lang.Thread.sleep(Native Method)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:108)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:76)
at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:308)
at org.apache.solr.common.cloud.ZkStateReader.getClusterProps(ZkStateReader.java:758)
at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.doWork(OverseerAutoReplicaFailoverThread.java:152)
at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:131)
at java.lang.Thread.run(Thread.java:745)
11) Thread[id=9849, name=qtp1365033291-9849, state=TIMED_WAITING, group=TGRP-TestMiniSolrCloudCluster]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:342)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:526)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:44)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
at java.lang.Thread.run(Thread.java:745)
12) Thread[id=9927, name=zkCallback-1623-thread-4, state=TIMED_WAITING, group=TGRP-TestMiniSolrCloudCluster]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
13) Thread[id=9842, name=qtp1365033291-9842, state=TIMED_WAITING, group=TGRP-TestMiniSolrCloudCluster]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:342)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:526)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:44)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
at java.lang.Thread.run(Thread.java:745)
14) Thread[id=9922, name=zkCallback-1623-thread-2, state=TIMED_WAITING, group=TGRP-TestMiniSolrCloudCluster]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
15) Thread[id=9843, name=qtp1365033291-9843, state=TIMED_WAITING, group=TGRP-TestMiniSolrCloudCluster]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:342)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:526)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:44)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
at java.lang.Thread.run(Thread.java:745)
16) Thread[id=9846, name=qtp1365033291-9846, state=TIMED_WAITING, group=TGRP-TestMiniSolrCloudCluster]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:342)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:526)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:44)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
at java.lang.Thread.run(Thread.java:745)
17) Thread[id=9892, name=zkCallback-1623-thread-1, state=TIMED_WAITING, group=TGRP-TestMiniSolrCloudCluster]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
18) Thread[id=9821, name=HashSessionScavenger-277, state=TIMED_WAITING, group=TGRP-TestMiniSolrCloudCluster]
at java.lang.Object.wait(Native Method)
at java.util.TimerThread.mainLoop(Timer.java:552)
at java.util.TimerThread.run(Timer.java:505)
19) Thread[id=9890, name=jetty-launcher-1611-thread-3-SendThread(127.0.0.1:54741), state=TIMED_WAITING, group=TGRP-TestMiniSolrCloudCluster]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:230)
at org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1185)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1110)
at __randomizedtesting.SeedInfo.seed([C563256C83F18FB6]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestMiniSolrCloudCluster
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=9925, name=OverseerHdfsCoreFailoverThread-93683341599768585-127.0.0.1:54749_solr-n_0000000001, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139) at java.lang.Thread.run(Thread.java:745) 2) Thread[id=9841, name=qtp1365033291-9841 Acceptor0 SelectChannelConnector@127.0.0.1:54749, state=RUNNABLE, group=TGRP-TestMiniSolrCloudCluster] at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Thread.java:745) 3) Thread[id=9927, name=zkCallback-1623-thread-4, state=TIMED_WAITING, group=TGRP-TestMiniSolrCloudCluster] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 4) Thread[id=9926, name=zkCallback-1623-thread-3, state=TIMED_WAITING, group=TGRP-TestMiniSolrCloudCluster] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 5) Thread[id=9922, name=zkCallback-1623-thread-2, state=TIMED_WAITING, group=TGRP-TestMiniSolrCloudCluster] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 6) Thread[id=9848, name=qtp1365033291-9848 Selector0, state=RUNNABLE, group=TGRP-TestMiniSolrCloudCluster] at sun.nio.ch.IOUtil.drain(Native Method) at sun.nio.ch.KQueueSelectorImpl.updateSelectedKeys(KQueueSelectorImpl.java:167) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:108) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.selectNow(SelectorImpl.java:105) at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:536) at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Thread.java:745) 7) Thread[id=9892, name=zkCallback-1623-thread-1, state=TIMED_WAITING, group=TGRP-TestMiniSolrCloudCluster] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) 8) Thread[id=9821, name=HashSessionScavenger-277, state=TIMED_WAITING, group=TGRP-TestMiniSolrCloudCluster] at java.lang.Object.wait(Native Method) at java.util.TimerThread.mainLoop(Timer.java:552) at java.util.TimerThread.run(Timer.java:505) 9) Thread[id=9912, name=Thread-3507, state=WAITING, group=TGRP-TestMiniSolrCloudCluster] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.solr.core.CloserThread.run(CoreContainer.java:908) 10) Thread[id=9890, name=jetty-launcher-1611-thread-3-SendThread(127.0.0.1:54741), state=TIMED_WAITING, group=TGRP-TestMiniSolrCloudCluster] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=9925, name=OverseerHdfsCoreFailoverThread-93683341599768585-127.0.0.1:54749_solr-n_0000000001, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
at java.lang.Thread.sleep(Native Method)
at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139)
at java.lang.Thread.run(Thread.java:745)
2) Thread[id=9841, name=qtp1365033291-9841 Acceptor0 SelectChannelConnector@127.0.0.1:54749, state=RUNNABLE, group=TGRP-TestMiniSolrCloudCluster]
at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
at java.lang.Thread.run(Thread.java:745)
3) Thread[id=9927, name=zkCallback-1623-thread-4, state=TIMED_WAITING, group=TGRP-TestMiniSolrCloudCluster]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
4) Thread[id=9926, name=zkCallback-1623-thread-3, state=TIMED_WAITING, group=TGRP-TestMiniSolrCloudCluster]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
5) Thread[id=9922, name=zkCallback-1623-thread-2, state=TIMED_WAITING, group=TGRP-TestMiniSolrCloudCluster]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
6) Thread[id=9848, name=qtp1365033291-9848 Selector0, state=RUNNABLE, group=TGRP-TestMiniSolrCloudCluster]
at sun.nio.ch.IOUtil.drain(Native Method)
at sun.nio.ch.KQueueSelectorImpl.updateSelectedKeys(KQueueSelectorImpl.java:167)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:108)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
at sun.nio.ch.SelectorImpl.selectNow(SelectorImpl.java:105)
at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:536)
at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
at java.lang.Thread.run(Thread.java:745)
7) Thread[id=9892, name=zkCallback-1623-thread-1, state=TIMED_WAITING, group=TGRP-TestMiniSolrCloudCluster]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
8) Thread[id=9821, name=HashSessionScavenger-277, state=TIMED_WAITING, group=TGRP-TestMiniSolrCloudCluster]
at java.lang.Object.wait(Native Method)
at java.util.TimerThread.mainLoop(Timer.java:552)
at java.util.TimerThread.run(Timer.java:505)
9) Thread[id=9912, name=Thread-3507, state=WAITING, group=TGRP-TestMiniSolrCloudCluster]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:502)
at org.apache.solr.core.CloserThread.run(CoreContainer.java:908)
10) Thread[id=9890, name=jetty-launcher-1611-thread-3-SendThread(127.0.0.1:54741), state=TIMED_WAITING, group=TGRP-TestMiniSolrCloudCluster]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994)
at __randomizedtesting.SeedInfo.seed([C563256C83F18FB6]:0)
FAILED: org.apache.solr.cloud.TestRebalanceLeaders.test
Error Message:
No live SolrServers available to handle this request:[http://127.0.0.1:54840, http://127.0.0.1:54826, http://127.0.0.1:54835, http://127.0.0.1:54844, http://127.0.0.1:54831]
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:54840, http://127.0.0.1:54826, http://127.0.0.1:54835, http://127.0.0.1:54844, http://127.0.0.1:54831]
at __randomizedtesting.SeedInfo.seed([C563256C83F18FB6:4D371AB62D0DE24E]:0)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:355)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1074)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:846)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:789)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.TestRebalanceLeaders.issueCommands(TestRebalanceLeaders.java:281)
at org.apache.solr.cloud.TestRebalanceLeaders.rebalanceLeaderTest(TestRebalanceLeaders.java:108)
at org.apache.solr.cloud.TestRebalanceLeaders.test(TestRebalanceLeaders.java:74)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:54844: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 500 {trace=java.lang.AssertionError
at org.apache.solr.common.util.ByteUtils.UTF8toUTF16(ByteUtils.java:36)
at org.apache.solr.common.util.ByteUtils.UTF8toUTF16(ByteUtils.java:64)
at org.apache.solr.common.cloud.ZkStateReader.fromJSON(ZkStateReader.java:137)
at org.apache.solr.common.cloud.ZkNodeProps.load(ZkNodeProps.java:92)
at org.apache.solr.cloud.DistributedQueue.containsTaskWithRequestId(DistributedQueue.java:127)
at org.apache.solr.handler.admin.CollectionsHandler.overseerCollectionQueueContains(CollectionsHandler.java:647)
at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:672)
at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:652)
at org.apache.solr.handler.admin.CollectionsHandler.rejoinElection(CollectionsHandler.java:447)
at org.apache.solr.handler.admin.CollectionsHandler.insurePreferredIsLeader(CollectionsHandler.java:362)
at org.apache.solr.handler.admin.CollectionsHandler.handleBalanceLeaders(CollectionsHandler.java:269)
at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:235)
at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:143)
at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:795)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:289)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:223)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:104)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
at org.eclipse.jetty.server.Server.handle(Server.java:368)
at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942)
at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004)
at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640)
at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
at java.lang.Thread.run(Thread.java:745)
,code=500}</title>
</head>
<body>
<h2>HTTP ERROR: 500</h2>
<p>Problem accessing /admin/collections. Reason:
<pre> {trace=java.lang.AssertionError
at org.apache.solr.common.util.ByteUtils.UTF8toUTF16(ByteUtils.java:36)
at org.apache.solr.common.util.ByteUtils.UTF8toUTF16(ByteUtils.java:64)
at org.apache.solr.common.cloud.ZkStateReader.fromJSON(ZkStateReader.java:137)
at org.apache.solr.common.cloud.ZkNodeProps.load(ZkNodeProps.java:92)
at org.apache.solr.cloud.DistributedQueue.containsTaskWithRequestId(DistributedQueue.java:127)
at org.apache.solr.handler.admin.CollectionsHandler.overseerCollectionQueueContains(CollectionsHandler.java:647)
at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:672)
at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:652)
at org.apache.solr.handler.admin.CollectionsHandler.rejoinElection(CollectionsHandler.java:447)
at org.apache.solr.handler.admin.CollectionsHandler.insurePreferredIsLeader(CollectionsHandler.java:362)
at org.apache.solr.handler.admin.CollectionsHandler.handleBalanceLeaders(CollectionsHandler.java:269)
at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:235)
at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:143)
at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:795)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:289)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:223)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:104)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
at org.eclipse.jetty.server.Server.handle(Server.java:368)
at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942)
at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004)
at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640)
at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
at java.lang.Thread.run(Thread.java:745)
,code=500}</pre></p>
<hr /><i><small>Powered by Jetty://</small></i>
</body>
</html>
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:529)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:344)
... 48 more
Build Log:
[...truncated 10542 lines...]
[junit4] Suite: org.apache.solr.cloud.TestMiniSolrCloudCluster
[junit4] 2> 2071859 T9735 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 2071860 T9736 oasc.ZkTestServer$2$1.setClientPort client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2071860 T9736 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 2071961 T9735 oasc.ZkTestServer.run start zk server on port:54726
[junit4] 2> 2071987 T9744 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2071987 T9745 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2071987 T9746 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2071995 T9744 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54729
[junit4] 2> 2071996 T9744 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostContext=/solr, hostPort=54729}
[junit4] 2> 2071996 T9744 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@74a14482
[junit4] 2> 2071997 T9744 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-001/'
[junit4] 2> 2071997 T9745 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54730
[junit4] 2> 2071998 T9745 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostContext=/solr, hostPort=54730}
[junit4] 2> 2071998 T9745 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@74a14482
[junit4] 2> 2071998 T9745 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-001/'
[junit4] 2> 2071999 T9746 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54728
[junit4] 2> 2071999 T9746 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostContext=/solr, hostPort=54728}
[junit4] 2> 2071999 T9746 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@74a14482
[junit4] 2> 2072000 T9746 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-001/'
[junit4] 2> 2072041 T9744 oass.SolrDispatchFilter.loadNodeConfig Trying to read solr.xml from 127.0.0.1:54726/solr
[junit4] 2> 2072047 T9745 oass.SolrDispatchFilter.loadNodeConfig Trying to read solr.xml from 127.0.0.1:54726/solr
[junit4] 2> 2072056 T9746 oass.SolrDispatchFilter.loadNodeConfig Trying to read solr.xml from 127.0.0.1:54726/solr
[junit4] 2> 2072063 T9745 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-001/.
[junit4] 2> 2072063 T9744 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-001/.
[junit4] 2> 2072063 T9745 oasc.CoreContainer.<init> New CoreContainer 2010002790
[junit4] 2> 2072064 T9745 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-001/]
[junit4] 2> 2072065 T9745 oasc.CoreContainer.load loading shared library: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-001/lib
[junit4] 2> 2072064 T9744 oasc.CoreContainer.<init> New CoreContainer 1779929489
[junit4] 2> 2072066 T9744 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-001/]
[junit4] 2> 2072066 T9744 oasc.CoreContainer.load loading shared library: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-001/lib
[junit4] 2> 2072065 T9745 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-001/lib).
[junit4] 2> 2072066 T9744 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-001/lib).
[junit4] 2> 2072073 T9746 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-001/.
[junit4] 2> 2072073 T9746 oasc.CoreContainer.<init> New CoreContainer 1696044911
[junit4] 2> 2072074 T9746 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-001/]
[junit4] 2> 2072074 T9746 oasc.CoreContainer.load loading shared library: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-001/lib
[junit4] 2> 2072074 T9746 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-001/lib).
[junit4] 2> 2072082 T9745 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 2072084 T9744 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 2072086 T9746 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 2072087 T9744 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 2072087 T9745 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 2072088 T9746 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 2072088 T9744 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2072089 T9744 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2072089 T9744 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 2072089 T9744 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54726/solr
[junit4] 2> 2072090 T9744 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2072090 T9746 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2072091 T9745 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2072091 T9745 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2072091 T9746 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2072092 T9745 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 2072092 T9746 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 2072094 T9746 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54726/solr
[junit4] 2> 2072094 T9745 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54726/solr
[junit4] 2> 2072094 T9746 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2072094 T9745 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2072167 T9744 N:127.0.0.1:54729_solr oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54729_solr
[junit4] 2> 2072167 T9746 N:127.0.0.1:54728_solr oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54728_solr
[junit4] 2> 2072167 T9745 N:127.0.0.1:54730_solr oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54730_solr
[junit4] 2> 2072180 T9744 N:127.0.0.1:54729_solr oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 2072181 T9746 N:127.0.0.1:54728_solr oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 2072181 T9745 N:127.0.0.1:54730_solr oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 2072185 T9744 N:127.0.0.1:54729_solr oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:54729_solr
[junit4] 2> 2072191 T9744 N:127.0.0.1:54729_solr oasc.Overseer.start Overseer (id=93683341475774471-127.0.0.1:54729_solr-n_0000000000) starting
[junit4] 2> 2072199 T9746 N:127.0.0.1:54728_solr oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-001/.
[junit4] 2> 2072200 T9745 N:127.0.0.1:54730_solr oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-001/.
[junit4] 2> 2072204 T9745 N:127.0.0.1:54730_solr oasc.CorePropertiesLocator.discover Found 0 core definitions
[junit4] 2> 2072204 T9746 N:127.0.0.1:54728_solr oasc.CorePropertiesLocator.discover Found 0 core definitions
[junit4] 2> 2072206 T9745 N:127.0.0.1:54730_solr oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 2072206 T9745 N:127.0.0.1:54730_solr oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2072206 T9746 N:127.0.0.1:54728_solr oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 2072206 T9746 N:127.0.0.1:54728_solr oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2072232 T9744 N:127.0.0.1:54729_solr oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 2072233 T9804 N:127.0.0.1:54729_solr oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2072235 T9803 N:127.0.0.1:54729_solr oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2072245 T9744 N:127.0.0.1:54729_solr oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-001/.
[junit4] 2> 2072247 T9744 N:127.0.0.1:54729_solr oasc.CorePropertiesLocator.discover Found 0 core definitions
[junit4] 2> 2072248 T9744 N:127.0.0.1:54729_solr oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 2072248 T9744 N:127.0.0.1:54729_solr oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2072264 T9746 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1696044911
[junit4] 2> 2072266 T9745 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1779929489
[junit4] 2> 2072266 T9744 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=2010002790
[junit4] 2> 2072271 T9745 oasc.Overseer.close Overseer (id=93683341475774471-127.0.0.1:54729_solr-n_0000000000) closing
[junit4] 2> 2072274 T9803 N:127.0.0.1:54729_solr oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:54729_solr
[junit4] 2> 2072275 T9795 N:127.0.0.1:54728_solr oaz.ClientCnxn$EventThread.processEvent ERROR Error while calling watcher java.util.concurrent.RejectedExecutionException: Task org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1@31c8a686 rejected from org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@35f72467[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 1]
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:134)
[junit4] 2> at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:261)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 2072276 T9746 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4] 2> 2072276 T9793 N:127.0.0.1:54729_solr oaz.ClientCnxn$EventThread.processEvent ERROR Error while calling watcher java.util.concurrent.RejectedExecutionException: Task org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1@263dbaca rejected from org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@22023ad5[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 1]
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:134)
[junit4] 2> at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:261)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 2072282 T9798 N:127.0.0.1:54730_solr oaz.ClientCnxn$EventThread.processEvent ERROR Error while calling watcher java.util.concurrent.RejectedExecutionException: Task org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1@3a157983 rejected from org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@3e2aea19[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 1]
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:134)
[junit4] 2> at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:261)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 2072283 T9798 N:127.0.0.1:54730_solr oaz.ClientCnxn$EventThread.processEvent ERROR Error while calling watcher java.util.concurrent.RejectedExecutionException: Task org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1@5b517c7d rejected from org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@3e2aea19[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 1]
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:134)
[junit4] 2> at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:261)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 2072281 T9745 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4] 2> 2072286 T9744 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
[junit4] 2> 2072457 T9735 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:54726 54726
[junit4] 2> 2072547 T9736 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:54726 54726
[junit4] 2> 2073746 T9736 oasc.ZkTestServer$ZKServerMain.runFromConfig WARN Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 3 /solr/aliases.json
[junit4] 2> 3 /solr/clusterstate.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 3 /solr/live_nodes
[junit4] 2>
[junit4] 2> 2073751 T9735 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 2073753 T9808 oasc.ZkTestServer$2$1.setClientPort client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2073753 T9808 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 2073853 T9735 oasc.ZkTestServer.run start zk server on port:54741
[junit4] 2> 2074032 T9816 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2074032 T9817 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2074034 T9819 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2074034 T9818 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2074036 T9820 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2074049 T9817 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54748
[junit4] 2> 2074049 T9817 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostContext=/solr, hostPort=54748}
[junit4] 2> 2074049 T9819 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54747
[junit4] 2> 2074050 T9819 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostContext=/solr, hostPort=54747}
[junit4] 2> 2074049 T9817 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@74a14482
[junit4] 2> 2074051 T9817 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-002/'
[junit4] 2> 2074050 T9819 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@74a14482
[junit4] 2> 2074052 T9819 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-002/'
[junit4] 2> 2074076 T9818 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54749
[junit4] 2> 2074076 T9818 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostContext=/solr, hostPort=54749}
[junit4] 2> 2074077 T9818 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@74a14482
[junit4] 2> 2074077 T9818 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-002/'
[junit4] 2> 2074078 T9817 oass.SolrDispatchFilter.loadNodeConfig Trying to read solr.xml from 127.0.0.1:54741/solr
[junit4] 2> 2074089 T9819 oass.SolrDispatchFilter.loadNodeConfig Trying to read solr.xml from 127.0.0.1:54741/solr
[junit4] 2> 2074107 T9816 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54751
[junit4] 2> 2074108 T9816 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostContext=/solr, hostPort=54751}
[junit4] 2> 2074108 T9816 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@74a14482
[junit4] 2> 2074108 T9816 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-002/'
[junit4] 2> 2074113 T9818 oass.SolrDispatchFilter.loadNodeConfig Trying to read solr.xml from 127.0.0.1:54741/solr
[junit4] 2> 2074122 T9820 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54753
[junit4] 2> 2074123 T9820 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostContext=/solr, hostPort=54753}
[junit4] 2> 2074123 T9820 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@74a14482
[junit4] 2> 2074123 T9820 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-002/'
[junit4] 2> 2074151 T9818 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-002/.
[junit4] 2> 2074151 T9818 oasc.CoreContainer.<init> New CoreContainer 1392062137
[junit4] 2> 2074151 T9818 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-002/]
[junit4] 2> 2074151 T9817 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-002/.
[junit4] 2> 2074151 T9818 oasc.CoreContainer.load loading shared library: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-002/lib
[junit4] 2> 2074152 T9817 oasc.CoreContainer.<init> New CoreContainer 113940602
[junit4] 2> 2074153 T9818 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-002/lib).
[junit4] 2> 2074153 T9817 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-002/]
[junit4] 2> 2074153 T9817 oasc.CoreContainer.load loading shared library: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-002/lib
[junit4] 2> 2074153 T9817 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-002/lib).
[junit4] 2> 2074168 T9816 oass.SolrDispatchFilter.loadNodeConfig Trying to read solr.xml from 127.0.0.1:54741/solr
[junit4] 2> 2074172 T9820 oass.SolrDispatchFilter.loadNodeConfig Trying to read solr.xml from 127.0.0.1:54741/solr
[junit4] 2> 2074177 T9817 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 2074178 T9817 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 2074178 T9817 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2074179 T9817 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2074179 T9817 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 2074179 T9817 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54741/solr
[junit4] 2> 2074179 T9817 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2074180 T9818 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 2074181 T9818 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 2074182 T9818 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2074185 T9818 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2074186 T9818 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 2074186 T9818 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54741/solr
[junit4] 2> 2074186 T9818 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2074185 T9819 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-002/.
[junit4] 2> 2074187 T9819 oasc.CoreContainer.<init> New CoreContainer 774340529
[junit4] 2> 2074187 T9819 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-002/]
[junit4] 2> 2074187 T9819 oasc.CoreContainer.load loading shared library: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-002/lib
[junit4] 2> 2074187 T9819 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-002/lib).
[junit4] 2> 2074197 T9816 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-002/.
[junit4] 2> 2074200 T9816 oasc.CoreContainer.<init> New CoreContainer 1182275667
[junit4] 2> 2074206 T9816 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-002/]
[junit4] 2> 2074206 T9816 oasc.CoreContainer.load loading shared library: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-002/lib
[junit4] 2> 2074207 T9816 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-002/lib).
[junit4] 2> 2074210 T9820 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-002/.
[junit4] 2> 2074211 T9820 oasc.CoreContainer.<init> New CoreContainer 2311559
[junit4] 2> 2074211 T9820 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestMiniSolrCloudCluster C563256C83F18FB6-001/tempDir-002/]
[junit4] 2> 2074217 T9820 oasc.CoreContainer.load loading shared library: /Users/jenkins/workspace/
[...truncated too long message...]
ty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] > at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] > at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] > at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942)
[junit4] > at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004)
[junit4] > at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640)
[junit4] > at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
[junit4] > at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] > at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] > at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > ,code=500}</pre></p>
[junit4] > <hr /><i><small>Powered by Jetty://</small></i>
[junit4] >
[junit4] >
[junit4] >
[junit4] >
[junit4] >
[junit4] >
[junit4] >
[junit4] >
[junit4] >
[junit4] >
[junit4] >
[junit4] >
[junit4] >
[junit4] >
[junit4] >
[junit4] >
[junit4] >
[junit4] >
[junit4] >
[junit4] >
[junit4] > </body>
[junit4] > </html>
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:529)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:344)
[junit4] > ... 48 more
[junit4] 2> 2217628 T10876 C:control_collection S:shard1 c:collection1 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.TestRebalanceLeaders C563256C83F18FB6-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene50): {}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=es_CR, timezone=Asia/Kuala_Lumpur
[junit4] 2> NOTE: Mac OS X 10.8.5 x86_64/Oracle Corporation 1.8.0_40 (64-bit)/cpus=3,threads=1,free=68026432,total=383778816
[junit4] 2> NOTE: All tests run in this JVM: [DistributedMLTComponentTest, CopyFieldTest, LeaderInitiatedRecoveryOnCommitTest, TestLeaderElectionZkExpiry, TestDocSet, TestFastWriter, DistributedQueryComponentCustomSortTest, MBeansHandlerTest, ResourceLoaderTest, TestClassNameShortening, TestSchemaVersionResource, TestSearcherReuse, SegmentsInfoRequestHandlerTest, TestFieldTypeCollectionResource, TestTolerantSearch, OverseerCollectionProcessorTest, TestReplicationHandlerBackup, SSLMigrationTest, BasicFunctionalityTest, DistributedFacetPivotSmallAdvancedTest, CollectionReloadTest, TestObjectReleaseTracker, TestSolrDeletionPolicy1, DateRangeFieldTest, CollectionsAPIDistributedZkTest, QueryParsingTest, TestChildDocTransformer, DateFieldTest, TestSolrQueryParserDefaultOperatorResource, TestRangeQuery, TestPseudoReturnFields, FileBasedSpellCheckerTest, IndexBasedSpellCheckerTest, DisMaxRequestHandlerTest, TestQuerySenderNoQuery, OutOfBoxZkACLAndCredentialsProvidersTest, SignatureUpdateProcessorFactoryTest, SpellingQueryConverterTest, TestRandomMergePolicy, TestBlobHandler, ConvertedLegacyTest, SpellCheckCollatorTest, QueryResultKeyTest, UpdateRequestProcessorFactoryTest, BinaryUpdateRequestHandlerTest, TestLMDirichletSimilarityFactory, TestSolrConfigHandlerCloud, ResponseHeaderTest, TestHighlightDedupGrouping, SearchHandlerTest, TestSolrQueryParser, HdfsDirectoryFactoryTest, OverseerRolesTest, TestCollapseQParserPlugin, AnalyticsMergeStrategyTest, DistributedQueryComponentOptimizationTest, OpenExchangeRatesOrgProviderTest, TestPivotHelperCode, TestCursorMarkWithoutUniqueKey, TestReversedWildcardFilterFactory, SpellPossibilityIteratorTest, TestInfoStreamLogging, TestRealTimeGet, SolrRequestParserTest, SpatialFilterTest, TestNonDefinedSimilarityFactory, SolrIndexConfigTest, TestZkChroot, RecoveryAfterSoftCommitTest, UpdateParamsTest, TestMergePolicyConfig, AutoCommitTest, SimpleMLTQParserTest, OpenCloseCoreStressTest, CoreAdminRequestStatusTest, CollectionsAPIAsyncDistributedZkTest, TestBulkSchemaAPI, ZkStateWriterTest, TestSerializedLuceneMatchVersion, TestSolr4Spatial, DistribCursorPagingTest, HdfsChaosMonkeySafeLeaderTest, TestFieldCollectionResource, PluginInfoTest, DateMathParserTest, PrimitiveFieldTypeTest, TestDistributedGrouping, TestJsonFacets, NotRequiredUniqueKeyTest, TestDocBasedVersionConstraints, TestCoreDiscovery, JsonLoaderTest, XsltUpdateRequestHandlerTest, DistributedFacetPivotLongTailTest, ChaosMonkeySafeLeaderTest, WordBreakSolrSpellCheckerTest, StatelessScriptUpdateProcessorFactoryTest, HttpPartitionTest, TestDefaultStatsCache, RAMDirectoryFactoryTest, ZkNodePropsTest, BasicZkTest, TestFiltering, TestRemoteStreaming, AsyncMigrateRouteKeyTest, DirectUpdateHandlerOptimizeTest, TestOverriddenPrefixQueryForCustomFieldType, TestSortingResponseWriter, TestCollectionAPI, TestRTGBase, SuggesterTSTTest, TestSuggestSpellingConverter, InfoHandlerTest, TestSchemaResource, BasicDistributedZk2Test, AliasIntegrationTest, BasicDistributedZkTest, LeaderElectionIntegrationTest, FullSolrCloudDistribCmdsTest, TestRandomDVFaceting, DistributedSpellCheckComponentTest, TestJoin, TestReload, TestCoreContainer, StatsComponentTest, SolrCmdDistributorTest, DirectUpdateHandlerTest, TestBadConfig, ShowFileRequestHandlerTest, CurrencyFieldXmlFileTest, SolrIndexSplitterTest, SimplePostToolTest, AnalysisAfterCoreReloadTest, CoreAdminHandlerTest, SuggesterTest, SchemaVersionSpecificBehaviorTest, TestWordDelimiterFilterFactory, DefaultValueUpdateProcessorTest, SolrInfoMBeanTest, TestQueryUtils, TestWriterPerf, TestOmitPositions, TermsComponentTest, DocumentBuilderTest, TermVectorComponentTest, FieldAnalysisRequestHandlerTest, FastVectorHighlighterTest, LoggingHandlerTest, SolrPluginUtilsTest, TestCollationField, TestAnalyzedSuggestions, PingRequestHandlerTest, TestBinaryResponseWriter, HighlighterConfigTest, ResponseLogComponentTest, TestSolrDeletionPolicy2, SampleTest, TestBinaryField, MinimalSchemaTest, TestConfig, TestSolrCoreProperties, TestLuceneMatchVersion, TestCodecSupport, TestSweetSpotSimilarityFactory, TestPerFieldSimilarity, TestIBSimilarityFactory, TestJmxMonitoredMap, PreAnalyzedFieldTest, TestSystemIdResolver, PrimUtilsTest, ClusterStateTest, TestSolrJ, TestUtils, FileUtilsTest, CursorPagingTest, DistributedIntervalFacetingTest, SolrTestCaseJ4Test, TestDistributedMissingSort, TestSimpleTrackingShardHandler, ConcurrentDeleteAndCreateCollectionTest, ConnectionManagerTest, CustomCollectionTest, DistribJoinFromCollectionTest, DistributedQueueTest, MigrateRouteKeyTest, OverseerStatusTest, ReplicationFactorTest, RollingRestartTest, ShardSplitTest, TestMiniSolrCloudClusterSSL, TestRebalanceLeaders]
[junit4] Completed [483/483] on J1 in 125.19s, 1 test, 1 error <<< FAILURES!
[...truncated 12 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/build.xml:536: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/build.xml:484: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/build.xml:61: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/extra-targets.xml:39: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build.xml:229: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/common-build.xml:511: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/lucene/common-build.xml:1434: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/lucene/common-build.xml:991: There were test failures: 483 suites, 1917 tests, 2 suite-level errors, 1 error, 1 failure, 384 ignored (22 assumptions)
Total time: 60 minutes 43 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-5.x-MacOSX (64bit/jdk1.7.0) - Build # 2154 -
Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-MacOSX/2154/
Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
1 tests failed.
FAILED: org.apache.solr.schema.TestCloudManagedSchemaConcurrent.test
Error Message:
QUERY FAILED: xpath=/response/lst[@name='responseHeader']/int[@name='status'][.='0'] request=/schema/dynamicfields/newdynamicfieldPut0_*?wt=xml&updateTimeoutSecs=15 response=<?xml version="1.0" encoding="UTF-8"?> <response> <lst name="responseHeader"> <int name="status">500</int> <int name="QTime">29608</int> </lst> <lst name="error"> <str name="msg">7 out of 8 replicas failed to update their schema to version 4 within 15 seconds! Failed cores: [https://127.0.0.1:50913/wb_/collection1/, https://127.0.0.1:50894/wb_/collection1/, https://127.0.0.1:50920/wb_/collection1/, https://127.0.0.1:50897/wb_/collection1/, https://127.0.0.1:50930/wb_/collection1/, https://127.0.0.1:50901/wb_/collection1/, https://127.0.0.1:50939/wb_/collection1/]</str> <str name="trace">org.apache.solr.common.SolrException: 7 out of 8 replicas failed to update their schema to version 4 within 15 seconds! Failed cores: [https://127.0.0.1:50913/wb_/collection1/, https://127.0.0.1:50894/wb_/collection1/, https://127.0.0.1:50920/wb_/collection1/, https://127.0.0.1:50897/wb_/collection1/, https://127.0.0.1:50930/wb_/collection1/, https://127.0.0.1:50901/wb_/collection1/, https://127.0.0.1:50939/wb_/collection1/] at org.apache.solr.schema.ManagedIndexSchema.waitForSchemaZkVersionAgreement(ManagedIndexSchema.java:260) at org.apache.solr.rest.schema.BaseFieldResource.waitForSchemaUpdateToPropagate(BaseFieldResource.java:120) at org.apache.solr.rest.schema.DynamicFieldResource.put(DynamicFieldResource.java:185) at org.restlet.resource.ServerResource.doHandle(ServerResource.java:432) at org.restlet.resource.ServerResource.doConditionalHandle(ServerResource.java:350) at org.restlet.resource.ServerResource.handle(ServerResource.java:952) at org.restlet.resource.Finder.handle(Finder.java:246) at org.restlet.routing.Filter.doHandle(Filter.java:159) at org.restlet.routing.Filter.handle(Filter.java:206) at org.restlet.routing.Router.doHandle(Router.java:431) at org.restlet.routing.Router.handle(Router.java:648) at org.restlet.routing.Filter.doHandle(Filter.java:159) at org.restlet.routing.Filter.handle(Filter.java:206) at org.restlet.routing.Filter.doHandle(Filter.java:159) at org.restlet.routing.Filter.handle(Filter.java:206) at org.restlet.routing.Filter.doHandle(Filter.java:159) at org.restlet.engine.application.StatusFilter.doHandle(StatusFilter.java:155) at org.restlet.routing.Filter.handle(Filter.java:206) at org.restlet.routing.Filter.doHandle(Filter.java:159) at org.restlet.routing.Filter.handle(Filter.java:206) at org.restlet.engine.CompositeHelper.handle(CompositeHelper.java:211) at org.restlet.engine.application.ApplicationHelper.handle(ApplicationHelper.java:84) at org.restlet.Application.handle(Application.java:381) at org.restlet.routing.Filter.doHandle(Filter.java:159) at org.restlet.routing.Filter.handle(Filter.java:206) at org.restlet.routing.Router.doHandle(Router.java:431) at org.restlet.routing.Router.handle(Router.java:648) at org.restlet.routing.Filter.doHandle(Filter.java:159) at org.restlet.routing.Filter.handle(Filter.java:206) at org.restlet.routing.Router.doHandle(Router.java:431) at org.restlet.routing.Router.handle(Router.java:648) at org.restlet.routing.Filter.doHandle(Filter.java:159) at org.restlet.routing.Filter.handle(Filter.java:206) at org.restlet.engine.CompositeHelper.handle(CompositeHelper.java:211) at org.restlet.Component.handle(Component.java:392) at org.restlet.Server.handle(Server.java:516) at org.restlet.engine.ServerHelper.handle(ServerHelper.java:72) at org.restlet.engine.adapter.HttpServerHelper.handle(HttpServerHelper.java:152) at org.restlet.ext.servlet.ServerServlet.service(ServerServlet.java:1089) at javax.servlet.http.HttpServlet.service(HttpServlet.java:848) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:669) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:457) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) at org.eclipse.jetty.server.Dispatcher.forward(Dispatcher.java:276) at org.eclipse.jetty.server.Dispatcher.forward(Dispatcher.java:103) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:402) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:223) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:104) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) at org.eclipse.jetty.server.Server.handle(Server.java:368) at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489) at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953) at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240) at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82) at org.eclipse.jetty.io.nio.SslConnection.handle(SslConnection.java:196) at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628) at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Thread.java:745) </str> <int name="code">500</int> </lst> </response>
Stack Trace:
java.lang.AssertionError: QUERY FAILED: xpath=/response/lst[@name='responseHeader']/int[@name='status'][.='0'] request=/schema/dynamicfields/newdynamicfieldPut0_*?wt=xml&updateTimeoutSecs=15 response=<?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader">
<int name="status">500</int>
<int name="QTime">29608</int>
</lst>
<lst name="error">
<str name="msg">7 out of 8 replicas failed to update their schema to version 4 within 15 seconds! Failed cores: [https://127.0.0.1:50913/wb_/collection1/, https://127.0.0.1:50894/wb_/collection1/, https://127.0.0.1:50920/wb_/collection1/, https://127.0.0.1:50897/wb_/collection1/, https://127.0.0.1:50930/wb_/collection1/, https://127.0.0.1:50901/wb_/collection1/, https://127.0.0.1:50939/wb_/collection1/]</str>
<str name="trace">org.apache.solr.common.SolrException: 7 out of 8 replicas failed to update their schema to version 4 within 15 seconds! Failed cores: [https://127.0.0.1:50913/wb_/collection1/, https://127.0.0.1:50894/wb_/collection1/, https://127.0.0.1:50920/wb_/collection1/, https://127.0.0.1:50897/wb_/collection1/, https://127.0.0.1:50930/wb_/collection1/, https://127.0.0.1:50901/wb_/collection1/, https://127.0.0.1:50939/wb_/collection1/]
at org.apache.solr.schema.ManagedIndexSchema.waitForSchemaZkVersionAgreement(ManagedIndexSchema.java:260)
at org.apache.solr.rest.schema.BaseFieldResource.waitForSchemaUpdateToPropagate(BaseFieldResource.java:120)
at org.apache.solr.rest.schema.DynamicFieldResource.put(DynamicFieldResource.java:185)
at org.restlet.resource.ServerResource.doHandle(ServerResource.java:432)
at org.restlet.resource.ServerResource.doConditionalHandle(ServerResource.java:350)
at org.restlet.resource.ServerResource.handle(ServerResource.java:952)
at org.restlet.resource.Finder.handle(Finder.java:246)
at org.restlet.routing.Filter.doHandle(Filter.java:159)
at org.restlet.routing.Filter.handle(Filter.java:206)
at org.restlet.routing.Router.doHandle(Router.java:431)
at org.restlet.routing.Router.handle(Router.java:648)
at org.restlet.routing.Filter.doHandle(Filter.java:159)
at org.restlet.routing.Filter.handle(Filter.java:206)
at org.restlet.routing.Filter.doHandle(Filter.java:159)
at org.restlet.routing.Filter.handle(Filter.java:206)
at org.restlet.routing.Filter.doHandle(Filter.java:159)
at org.restlet.engine.application.StatusFilter.doHandle(StatusFilter.java:155)
at org.restlet.routing.Filter.handle(Filter.java:206)
at org.restlet.routing.Filter.doHandle(Filter.java:159)
at org.restlet.routing.Filter.handle(Filter.java:206)
at org.restlet.engine.CompositeHelper.handle(CompositeHelper.java:211)
at org.restlet.engine.application.ApplicationHelper.handle(ApplicationHelper.java:84)
at org.restlet.Application.handle(Application.java:381)
at org.restlet.routing.Filter.doHandle(Filter.java:159)
at org.restlet.routing.Filter.handle(Filter.java:206)
at org.restlet.routing.Router.doHandle(Router.java:431)
at org.restlet.routing.Router.handle(Router.java:648)
at org.restlet.routing.Filter.doHandle(Filter.java:159)
at org.restlet.routing.Filter.handle(Filter.java:206)
at org.restlet.routing.Router.doHandle(Router.java:431)
at org.restlet.routing.Router.handle(Router.java:648)
at org.restlet.routing.Filter.doHandle(Filter.java:159)
at org.restlet.routing.Filter.handle(Filter.java:206)
at org.restlet.engine.CompositeHelper.handle(CompositeHelper.java:211)
at org.restlet.Component.handle(Component.java:392)
at org.restlet.Server.handle(Server.java:516)
at org.restlet.engine.ServerHelper.handle(ServerHelper.java:72)
at org.restlet.engine.adapter.HttpServerHelper.handle(HttpServerHelper.java:152)
at org.restlet.ext.servlet.ServerServlet.service(ServerServlet.java:1089)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:848)
at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:669)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:457)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
at org.eclipse.jetty.server.Dispatcher.forward(Dispatcher.java:276)
at org.eclipse.jetty.server.Dispatcher.forward(Dispatcher.java:103)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:402)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:223)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:104)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
at org.eclipse.jetty.server.Server.handle(Server.java:368)
at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
at org.eclipse.jetty.io.nio.SslConnection.handle(SslConnection.java:196)
at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
at java.lang.Thread.run(Thread.java:745)
</str>
<int name="code">500</int>
</lst>
</response>
at __randomizedtesting.SeedInfo.seed([2F52CE5B675B573E:A706F181C9A73AC6]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.schema.TestCloudManagedSchemaConcurrent.verifySuccess(TestCloudManagedSchemaConcurrent.java:107)
at org.apache.solr.schema.TestCloudManagedSchemaConcurrent.addDynamicFieldPut(TestCloudManagedSchemaConcurrent.java:135)
at org.apache.solr.schema.TestCloudManagedSchemaConcurrent.access$300(TestCloudManagedSchemaConcurrent.java:45)
at org.apache.solr.schema.TestCloudManagedSchemaConcurrent$Operation$3.execute(TestCloudManagedSchemaConcurrent.java:286)
at org.apache.solr.schema.TestCloudManagedSchemaConcurrent.concurrentOperationsTest(TestCloudManagedSchemaConcurrent.java:450)
at org.apache.solr.schema.TestCloudManagedSchemaConcurrent.test(TestCloudManagedSchemaConcurrent.java:252)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 10681 lines...]
[junit4] Suite: org.apache.solr.schema.TestCloudManagedSchemaConcurrent
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/init-core-data-001
[junit4] 2> 2963437 T16948 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
[junit4] 2> 2963437 T16948 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /wb_/
[junit4] 2> 2963451 T16948 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 2963452 T16949 oasc.ZkTestServer$2$1.setClientPort client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2963453 T16949 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 2963553 T16948 oasc.ZkTestServer.run start zk server on port:50882
[junit4] 2> 2963554 T16948 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2963556 T16948 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2963568 T16956 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@31b846dd name:ZooKeeperConnection Watcher:127.0.0.1:50882 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2963569 T16948 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2963570 T16948 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2963571 T16948 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 2963581 T16948 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2963584 T16948 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2963588 T16959 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11a44dfd name:ZooKeeperConnection Watcher:127.0.0.1:50882/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2963589 T16948 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2963589 T16948 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2963590 T16948 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 2963599 T16948 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 2963605 T16948 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 2963611 T16948 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 2963620 T16948 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-managed-schema.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 2963621 T16948 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 2963630 T16948 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 2963632 T16948 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 2963638 T16948 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2963640 T16948 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2963647 T16948 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 2963648 T16948 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 2963669 T16948 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 2963670 T16948 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 2963679 T16948 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 2963681 T16948 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 2963692 T16948 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 2963693 T16948 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 2963705 T16948 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 2963706 T16948 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 2963715 T16948 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2963715 T16948 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2963721 T16948 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 2963722 T16948 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 2963730 T16948 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 2963731 T16948 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 2963740 T16948 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2963742 T16948 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2963746 T16962 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@54e47eda name:ZooKeeperConnection Watcher:127.0.0.1:50882/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2963746 T16948 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2963746 T16948 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2964408 T16948 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/control-001/cores/collection1
[junit4] 2> 2964414 T16948 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2964425 T16948 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 2964430 T16948 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:50886
[junit4] 2> 2964430 T16948 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostPort=50886, hostContext=/wb_, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/control-001/cores, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/tempDir-001/control/data}
[junit4] 2> 2964433 T16948 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@8f8acd0
[junit4] 2> 2964433 T16948 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/control-001/'
[junit4] 2> 2964506 T16948 oasc.SolrXmlConfig.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/control-001/solr.xml
[junit4] 2> 2964642 T16948 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/control-001/cores
[junit4] 2> 2964643 T16948 oasc.CoreContainer.<init> New CoreContainer 1076077357
[junit4] 2> 2964643 T16948 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/control-001/]
[junit4] 2> 2964643 T16948 oasc.CoreContainer.load loading shared library: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/control-001/lib
[junit4] 2> 2964645 T16948 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/control-001/lib).
[junit4] 2> 2964667 T16948 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 2964677 T16948 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 2964681 T16948 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2964682 T16948 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2964682 T16948 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 2964682 T16948 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50882/solr
[junit4] 2> 2964683 T16948 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2964684 T16948 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2964686 T16948 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2964692 T16974 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1280fe5e name:ZooKeeperConnection Watcher:127.0.0.1:50882 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2964693 T16948 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2964694 T16948 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2964701 T16948 N:127.0.0.1:50886_wb_ oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2964706 T16977 N:127.0.0.1:50886_wb_ oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@77c6bd8e name:ZooKeeperConnection Watcher:127.0.0.1:50882/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2964706 T16948 N:127.0.0.1:50886_wb_ oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2964710 T16948 N:127.0.0.1:50886_wb_ oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 2964732 T16948 N:127.0.0.1:50886_wb_ oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 2964741 T16948 N:127.0.0.1:50886_wb_ oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 2964749 T16948 N:127.0.0.1:50886_wb_ oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 2964759 T16948 N:127.0.0.1:50886_wb_ oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 2964780 T16948 N:127.0.0.1:50886_wb_ oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 2964787 T16948 N:127.0.0.1:50886_wb_ oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 2964796 T16948 N:127.0.0.1:50886_wb_ oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 2964802 T16948 N:127.0.0.1:50886_wb_ oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50886_wb_
[junit4] 2> 2964805 T16948 N:127.0.0.1:50886_wb_ oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50886_wb_
[junit4] 2> 2964820 T16948 N:127.0.0.1:50886_wb_ oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 2964830 T16948 N:127.0.0.1:50886_wb_ oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 2964842 T16948 N:127.0.0.1:50886_wb_ oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 2964847 T16948 N:127.0.0.1:50886_wb_ oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:50886_wb_
[junit4] 2> 2964848 T16948 N:127.0.0.1:50886_wb_ oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2964855 T16948 N:127.0.0.1:50886_wb_ oasc.Overseer.start Overseer (id=93684670385422340-127.0.0.1:50886_wb_-n_0000000000) starting
[junit4] 2> 2964862 T16948 N:127.0.0.1:50886_wb_ oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 2964893 T16948 N:127.0.0.1:50886_wb_ oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 2964896 T16979 N:127.0.0.1:50886_wb_ oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2964896 T16948 N:127.0.0.1:50886_wb_ oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2964898 T16978 N:127.0.0.1:50886_wb_ oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2964915 T16948 N:127.0.0.1:50886_wb_ oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/control-001/cores
[junit4] 2> 2964917 T16948 N:127.0.0.1:50886_wb_ oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {config=solrconfig.xml, transient=false, absoluteInstDir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/control-001/cores/collection1/, coreNodeName=, schema=schema.xml, instanceDir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/control-001/cores/collection1, loadOnStartup=true, shard=, dataDir=data/, collection=control_collection, name=collection1}
[junit4] 2> 2964918 T16948 N:127.0.0.1:50886_wb_ oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/control-001/cores/collection1/
[junit4] 2> 2964918 T16948 N:127.0.0.1:50886_wb_ oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 2964925 T16981 N:127.0.0.1:50886_wb_ C:control_collection c:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 2964926 T16981 N:127.0.0.1:50886_wb_ C:control_collection c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2964928 T16981 N:127.0.0.1:50886_wb_ oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2964928 T16977 N:127.0.0.1:50886_wb_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2964931 T16978 N:127.0.0.1:50886_wb_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "shard":null,
[junit4] 2> "node_name":"127.0.0.1:50886_wb_",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"1",
[junit4] 2> "operation":"state",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "core":"collection1",
[junit4] 2> "base_url":"https://127.0.0.1:50886/wb_",
[junit4] 2> "state":"down"} current state version: 0
[junit4] 2> 2964934 T16978 N:127.0.0.1:50886_wb_ oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "shard":null,
[junit4] 2> "node_name":"127.0.0.1:50886_wb_",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"1",
[junit4] 2> "operation":"state",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "core":"collection1",
[junit4] 2> "base_url":"https://127.0.0.1:50886/wb_",
[junit4] 2> "state":"down"}
[junit4] 2> 2964934 T16978 N:127.0.0.1:50886_wb_ oasco.ClusterStateMutator.createCollection building a new cName: control_collection
[junit4] 2> 2964935 T16978 N:127.0.0.1:50886_wb_ oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
[junit4] 2> 2964939 T16977 N:127.0.0.1:50886_wb_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2965931 T16981 N:127.0.0.1:50886_wb_ oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 2965932 T16981 N:127.0.0.1:50886_wb_ oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 2965947 T16981 N:127.0.0.1:50886_wb_ oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2965947 T16981 N:127.0.0.1:50886_wb_ oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 2965949 T16981 N:127.0.0.1:50886_wb_ oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2965950 T16981 N:127.0.0.1:50886_wb_ oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/control-001/cores/collection1/'
[junit4] 2> 2966033 T16981 N:127.0.0.1:50886_wb_ oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
[junit4] 2> 2966042 T16981 N:127.0.0.1:50886_wb_ oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 2966082 T16981 N:127.0.0.1:50886_wb_ oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 2966110 T16981 N:127.0.0.1:50886_wb_ oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.2.0
[junit4] 2> 2966273 T16981 N:127.0.0.1:50886_wb_ oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2966276 T16981 N:127.0.0.1:50886_wb_ oass.ManagedIndexSchemaFactory.create The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
[junit4] 2> 2966279 T16981 N:127.0.0.1:50886_wb_ oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 2966294 T16981 N:127.0.0.1:50886_wb_ oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 2967709 T16981 N:127.0.0.1:50886_wb_ oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2967747 T16981 N:127.0.0.1:50886_wb_ oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2967753 T16981 N:127.0.0.1:50886_wb_ oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2967888 T16981 N:127.0.0.1:50886_wb_ oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2967908 T16981 N:127.0.0.1:50886_wb_ oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2967919 T16981 N:127.0.0.1:50886_wb_ oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2967931 T16981 N:127.0.0.1:50886_wb_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2967932 T16981 N:127.0.0.1:50886_wb_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2967932 T16981 N:127.0.0.1:50886_wb_ oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2967969 T16981 N:127.0.0.1:50886_wb_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2967970 T16981 N:127.0.0.1:50886_wb_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2967979 T16981 N:127.0.0.1:50886_wb_ oass.ManagedIndexSchema.persistManagedSchemaToZooKeeper Created and persisted managed schema znode at /configs/conf1/managed-schema
[junit4] 2> 2967992 T16981 N:127.0.0.1:50886_wb_ oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml.bak
[junit4] 2> 2968024 T16981 N:127.0.0.1:50886_wb_ oass.ManagedIndexSchemaFactory.zkUgradeToManagedSchema After upgrading to managed schema in ZooKeeper, renamed the non-managed schema /configs/conf1/schema.xml to /configs/conf1/schema.xml.bak
[junit4] 2> 2968024 T16981 N:127.0.0.1:50886_wb_ oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 2968025 T16981 N:127.0.0.1:50886_wb_ c:collection1 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4] 2> 2968025 T16981 N:127.0.0.1:50886_wb_ c:collection1 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/control-001/cores/collection1/, dataDir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/control-001/cores/collection1/data/
[junit4] 2> 2968025 T16981 N:127.0.0.1:50886_wb_ c:collection1 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 2968027 T16981 N:127.0.0.1:50886_wb_ c:collection1 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/control-001/cores/collection1/data
[junit4] 2> 2968028 T16981 N:127.0.0.1:50886_wb_ c:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/control-001/cores/collection1/data/index/
[junit4] 2> 2968030 T16981 N:127.0.0.1:50886_wb_ c:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 2968031 T16981 N:127.0.0.1:50886_wb_ c:collection1 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/control-001/cores/collection1/data/index
[junit4] 2> 2968031 T16981 N:127.0.0.1:50886_wb_ c:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=21, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7738269487131495]
[junit4] 2> 2968054 T16981 N:127.0.0.1:50886_wb_ c:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(MMapDirectory@/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/control-001/cores/collection1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@27749d47; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4] 2> 2968055 T16981 N:127.0.0.1:50886_wb_ c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2968090 T16981 N:127.0.0.1:50886_wb_ c:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2968090 T16981 N:127.0.0.1:50886_wb_ c:collection1 oasc.RequestHandlers.applyInitParams WARN INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
[junit4] 2> 2968127 T16981 N:127.0.0.1:50886_wb_ c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2968130 T16981 N:127.0.0.1:50886_wb_ c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2968134 T16981 N:127.0.0.1:50886_wb_ c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2968149 T16981 N:127.0.0.1:50886_wb_ c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2968183 T16981 N:127.0.0.1:50886_wb_ c:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /admin/threads,standard,/schema,/update/json,/admin/plugins,/update/json/docs,/admin/segments,/admin/luke,/config,/replication,/admin/mbeans,/admin/system,/admin/properties,/update,/admin/file,/admin/logging,/dump,/admin/ping,/update/csv,/get
[junit4] 2> 2968192 T16981 N:127.0.0.1:50886_wb_ c:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 2968194 T16981 N:127.0.0.1:50886_wb_ c:collection1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2968194 T16981 N:127.0.0.1:50886_wb_ c:collection1 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
[junit4] 2> 2968195 T16981 N:127.0.0.1:50886_wb_ c:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2968196 T16981 N:127.0.0.1:50886_wb_ c:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2968210 T16981 N:127.0.0.1:50886_wb_ c:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=29, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=45.359375, floorSegmentMB=1.892578125, forceMergeDeletesPctAllowed=0.14044700518084818, segmentsPerTier=4.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.518010615665878
[junit4] 2> 2968212 T16981 N:127.0.0.1:50886_wb_ c:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(MMapDirectory@/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/control-001/cores/collection1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@27749d47; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4] 2> 2968212 T16981 N:127.0.0.1:50886_wb_ c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2968213 T16981 N:127.0.0.1:50886_wb_ c:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@cdf3a5b[collection1] main
[junit4] 2> 2968213 T16981 N:127.0.0.1:50886_wb_ c:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 2968215 T16981 N:127.0.0.1:50886_wb_ c:collection1 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2968215 T16981 N:127.0.0.1:50886_wb_ c:collection1 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 2968216 T16981 N:127.0.0.1:50886_wb_ c:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2968217 T16981 N:127.0.0.1:50886_wb_ c:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 2968217 T16981 N:127.0.0.1:50886_wb_ c:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2968218 T16981 N:127.0.0.1:50886_wb_ c:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 2968219 T16981 N:127.0.0.1:50886_wb_ c:collection1 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2968219 T16981 N:127.0.0.1:50886_wb_ c:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 2968232 T16981 N:127.0.0.1:50886_wb_ c:collection1 oass.ZkIndexSchemaReader.createSchemaWatcher Creating ZooKeeper watch for the managed schema at /configs/conf1/managed-schema
[junit4] 2> 2968268 T16981 N:127.0.0.1:50886_wb_ c:collection1 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 2968269 T16983 N:127.0.0.1:50886_wb_ c:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@cdf3a5b[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2968269 T16981 N:127.0.0.1:50886_wb_ c:collection1 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 2968273 T16986 N:127.0.0.1:50886_wb_ C:control_collection S:shard1 c:collection1 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:50886/wb_ collection:control_collection shard:shard1
[junit4] 2> 2968281 T16948 N:127.0.0.1:50886_wb_ oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 2968282 T16948 N:127.0.0.1:50886_wb_ oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2968292 T16948 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2968302 T16986 N:127.0.0.1:50886_wb_ C:control_collection S:shard1 c:collection1 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 2968303 T16948 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2968308 T16989 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12ea83c5 name:ZooKeeperConnection Watcher:127.0.0.1:50882/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2968312 T16948 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2968314 T16948 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2968314 T16948 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2968345 T16986 N:127.0.0.1:50886_wb_ C:control_collection S:shard1 c:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 2968345 T16948 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 2968377 T16977 N:127.0.0.1:50886_wb_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2968387 T16986 N:127.0.0.1:50886_wb_ C:control_collection S:shard1 c:collection1 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 2968387 T16986 N:127.0.0.1:50886_wb_ C:control_collection S:shard1 c:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C8262 name=collection1 org.apache.solr.core.SolrCore@222f040e url=https://127.0.0.1:50886/wb_/collection1 node=127.0.0.1:50886_wb_ C8262_STATE=coll:control_collection core:collection1 props:{node_name=127.0.0.1:50886_wb_, core=collection1, base_url=https://127.0.0.1:50886/wb_, state=down}
[junit4] 2> 2968388 T16986 N:127.0.0.1:50886_wb_ C:control_collection S:shard1 c:collection1 C8262 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:50886/wb_/collection1/
[junit4] 2> 2968388 T16986 N:127.0.0.1:50886_wb_ C:control_collection S:shard1 c:collection1 C8262 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 2968388 T16986 N:127.0.0.1:50886_wb_ C:control_collection S:shard1 c:collection1 C8262 oasc.SyncStrategy.syncToMe https://127.0.0.1:50886/wb_/collection1/ has no replicas
[junit4] 2> 2968388 T16986 N:127.0.0.1:50886_wb_ C:control_collection S:shard1 c:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:50886/wb_/collection1/ shard1
[junit4] 2> 2968389 T16986 N:127.0.0.1:50886_wb_ C:control_collection S:shard1 c:collection1 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 2968390 T16978 N:127.0.0.1:50886_wb_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 2968395 T16989 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2968409 T16977 N:127.0.0.1:50886_wb_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2968452 T16977 N:127.0.0.1:50886_wb_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2968454 T16978 N:127.0.0.1:50886_wb_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"https://127.0.0.1:50886/wb_",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 2
[junit4] 2> 2968567 T16989 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2968570 T16977 N:127.0.0.1:50886_wb_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2968615 T16986 N:127.0.0.1:50886_wb_ C:control_collection S:shard1 c:collection1 oasc.ZkController.register We are https://127.0.0.1:50886/wb_/collection1/ and leader is https://127.0.0.1:50886/wb_/collection1/
[junit4] 2> 2968616 T16986 N:127.0.0.1:50886_wb_ C:control_collection S:shard1 c:collection1 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:50886/wb_
[junit4] 2> 2968616 T16986 N:127.0.0.1:50886_wb_ C:control_collection S:shard1 c:collection1 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 2968616 T16986 N:127.0.0.1:50886_wb_ C:control_collection S:shard1 c:collection1 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 2968617 T16986 N:127.0.0.1:50886_wb_ C:control_collection S:shard1 c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2968620 T16977 N:127.0.0.1:50886_wb_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2968625 T16978 N:127.0.0.1:50886_wb_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "shard":"shard1",
[junit4] 2> "node_name":"127.0.0.1:50886_wb_",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"4",
[junit4] 2> "operation":"state",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "base_url":"https://127.0.0.1:50886/wb_",
[junit4] 2> "state":"active"} current state version: 3
[junit4] 2> 2968631 T16978 N:127.0.0.1:50886_wb_ oasco.ReplicaMutator.updateState Update state numShards=4 message={
[junit4] 2> "shard":"shard1",
[junit4] 2> "node_name":"127.0.0.1:50886_wb_",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"4",
[junit4] 2> "operation":"state",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "base_url":"https://127.0.0.1:50886/wb_",
[junit4] 2> "state":"active"}
[junit4] 2> 2968754 T16989 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2968761 T16977 N:127.0.0.1:50886_wb_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2969466 T16948 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/shard-1-001/cores/collection1
[junit4] 2> 2969472 T16948 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1 in directory /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/shard-1-001
[junit4] 2> 2969473 T16948 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 2969480 T16948 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 2969483 T16948 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:50891
[junit4] 2> 2969485 T16948 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostContext=/wb_, hostPort=50891, solrconfig=solrconfig.xml, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/shard-1-001/cores, solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/tempDir-001/jetty1}
[junit4] 2> 2969488 T16948 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@8f8acd0
[junit4] 2> 2969489 T16948 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/shard-1-001/'
[junit4] 2> 2969559 T16948 oasc.SolrXmlConfig.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/shard-1-001/solr.xml
[junit4] 2> 2969621 T16948 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/shard-1-001/cores
[junit4] 2> 2969622 T16948 oasc.CoreContainer.<init> New CoreContainer 886086892
[junit4] 2> 2969623 T16948 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/shard-1-001/]
[junit4] 2> 2969623 T16948 oasc.CoreContainer.load loading shared library: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/shard-1-001/lib
[junit4] 2> 2969626 T16948 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/shard-1-001/lib).
[junit4] 2> 2969655 T16948 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 2969667 T16948 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 2969672 T16948 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 2969673 T16948 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 2969674 T16948 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 2969674 T16948 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50882/solr
[junit4] 2> 2969674 T16948 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 2969675 T16948 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 2969678 T16948 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2969694 T17001 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5b1b78df name:ZooKeeperConnection Watcher:127.0.0.1:50882 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2969694 T16948 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2969695 T16948 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 2969725 T16948 N:127.0.0.1:50891_wb_ oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 2969730 T17004 N:127.0.0.1:50891_wb_ oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6be1d154 name:ZooKeeperConnection Watcher:127.0.0.1:50882/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 2969731 T16948 N:127.0.0.1:50891_wb_ oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2969750 T16948 N:127.0.0.1:50891_wb_ oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 2970775 T16948 N:127.0.0.1:50891_wb_ oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50891_wb_
[junit4] 2> 2970788 T16948 N:127.0.0.1:50891_wb_ oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50891_wb_
[junit4] 2> 2970808 T16948 N:127.0.0.1:50891_wb_ oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 2970815 T16948 N:127.0.0.1:50891_wb_ oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/shard-1-001/cores
[junit4] 2> 2970819 T16948 N:127.0.0.1:50891_wb_ oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {loadOnStartup=true, config=solrconfig.xml, transient=false, dataDir=data/, schema=schema.xml, collection=collection1, shard=, name=collection1, coreNodeName=, instanceDir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/shard-1-001/cores/collection1, absoluteInstDir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/shard-1-001/cores/collection1/}
[junit4] 2> 2970820 T16948 N:127.0.0.1:50891_wb_ oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/shard-1-001/cores/collection1/
[junit4] 2> 2970821 T16948 N:127.0.0.1:50891_wb_ oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 2970823 T17005 N:127.0.0.1:50891_wb_ C:collection1 c:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 2970824 T17005 N:127.0.0.1:50891_wb_ C:collection1 c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2970827 T16977 N:127.0.0.1:50886_wb_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2970827 T17005 N:127.0.0.1:50891_wb_ oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 2970829 T16978 N:127.0.0.1:50886_wb_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "shard":null,
[junit4] 2> "node_name":"127.0.0.1:50891_wb_",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"4",
[junit4] 2> "operation":"state",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"collection1",
[junit4] 2> "base_url":"https://127.0.0.1:50891/wb_",
[junit4] 2> "state":"down"} current state version: 4
[junit4] 2> 2970832 T16978 N:127.0.0.1:50886_wb_ oasco.ReplicaMutator.updateState Update state numShards=4 message={
[junit4] 2> "shard":null,
[junit4] 2> "node_name":"127.0.0.1:50891_wb_",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"4",
[junit4] 2> "operation":"state",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"collection1",
[junit4] 2> "base_url":"https://127.0.0.1:50891/wb_",
[junit4] 2> "state":"down"}
[junit4] 2> 2970833 T16978 N:127.0.0.1:50886_wb_ oasco.ClusterStateMutator.createCollection building a new cName: collection1
[junit4] 2> 2970833 T16978 N:127.0.0.1:50886_wb_ oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard4
[junit4] 2> 2970837 T16989 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2970837 T16977 N:127.0.0.1:50886_wb_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2970838 T17004 N:127.0.0.1:50891_wb_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2971831 T17005 N:127.0.0.1:50891_wb_ oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 2971832 T17005 N:127.0.0.1:50891_wb_ oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 2971833 T17005 N:127.0.0.1:50891_wb_ oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 2971833 T17005 N:127.0.0.1:50891_wb_ oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 2971836 T17005 N:127.0.0.1:50891_wb_ oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2971836 T17005 N:127.0.0.1:50891_wb_ oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/shard-1-001/cores/collection1/'
[junit4] 2> 2971886 T17005 N:127.0.0.1:50891_wb_ oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
[junit4] 2> 2971892 T17005 N:127.0.0.1:50891_wb_ oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 2971912 T17005 N:127.0.0.1:50891_wb_ oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 2972039 T17005 N:127.0.0.1:50891_wb_ oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.2.0
[junit4] 2> 2972197 T17005 N:127.0.0.1:50891_wb_ oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 2972200 T17005 N:127.0.0.1:50891_wb_ oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/managed-schema
[junit4] 2> 2972215 T17005 N:127.0.0.1:50891_wb_ oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 2973414 T17005 N:127.0.0.1:50891_wb_ oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 2973436 T17005 N:127.0.0.1:50891_wb_ oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 2973441 T17005 N:127.0.0.1:50891_wb_ oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 2973472 T17005 N:127.0.0.1:50891_wb_ oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2973477 T17005 N:127.0.0.1:50891_wb_ oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 2973495 T17005 N:127.0.0.1:50891_wb_ oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2973497 T17005 N:127.0.0.1:50891_wb_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2973498 T17005 N:127.0.0.1:50891_wb_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2973498 T17005 N:127.0.0.1:50891_wb_ oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 2973501 T17005 N:127.0.0.1:50891_wb_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2973502 T17005 N:127.0.0.1:50891_wb_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2973583 T17005 N:127.0.0.1:50891_wb_ oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 2973584 T17005 N:127.0.0.1:50891_wb_ c:collection1 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4] 2> 2973586 T17005 N:127.0.0.1:50891_wb_ c:collection1 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/shard-1-001/cores/collection1/, dataDir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/shard-1-001/cores/collection1/data/
[junit4] 2> 2973586 T17005 N:127.0.0.1:50891_wb_ c:collection1 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
[junit4] 2> 2973587 T17005 N:127.0.0.1:50891_wb_ c:collection1 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/shard-1-001/cores/collection1/data
[junit4] 2> 2973588 T17005 N:127.0.0.1:50891_wb_ c:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/shard-1-001/cores/collection1/data/index/
[junit4] 2> 2973589 T17005 N:127.0.0.1:50891_wb_ c:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/shard-1-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 2973590 T17005 N:127.0.0.1:50891_wb_ c:collection1 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/shard-1-001/cores/collection1/data/index
[junit4] 2> 2973591 T17005 N:127.0.0.1:50891_wb_ c:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=21, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7738269487131495]
[junit4] 2> 2973604 T17005 N:127.0.0.1:50891_wb_ c:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(MMapDirectory@/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/shard-1-001/cores/collection1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1c681ccf; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4] 2> 2973604 T17005 N:127.0.0.1:50891_wb_ c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2973616 T17005 N:127.0.0.1:50891_wb_ c:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 2973616 T17005 N:127.0.0.1:50891_wb_ c:collection1 oasc.RequestHandlers.applyInitParams WARN INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
[junit4] 2> 2973638 T17005 N:127.0.0.1:50891_wb_ c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2973640 T17005 N:127.0.0.1:50891_wb_ c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2973643 T17005 N:127.0.0.1:50891_wb_ c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2973649 T17005 N:127.0.0.1:50891_wb_ c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 2973663 T17005 N:127.0.0.1:50891_wb_ c:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /admin/threads,standard,/schema,/update/json,/admin/plugins,/update/json/docs,/admin/segments,/admin/luke,/config,/replication,/admin/mbeans,/admin/system,/admin/properties,/update,/admin/file,/admin/logging,/dump,/admin/ping,/update/csv,/get
[junit4] 2> 2973667 T17005 N:127.0.0.1:50891_wb_ c:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 2973668 T17005 N:127.0.0.1:50891_wb_ c:collection1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2973668 T17005 N:127.0.0.1:50891_wb_ c:collection1 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
[junit4] 2> 2973670 T17005 N:127.0.0.1:50891_wb_ c:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 2973670 T17005 N:127.0.0.1:50891_wb_ c:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 2973671 T17005 N:127.0.0.1:50891_wb_ c:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=29, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=45.359375, floorSegmentMB=1.892578125, forceMergeDeletesPctAllowed=0.14044700518084818, segmentsPerTier=4.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.518010615665878
[junit4] 2> 2973672 T17005 N:127.0.0.1:50891_wb_ c:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=NRTCachingDirectory(MMapDirectory@/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001/shard-1-001/cores/collection1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1c681ccf; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4] 2> 2973673 T17005 N:127.0.0.1:50891_wb_ c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 2973673 T17005 N:127.0.0.1:50891_wb_ c:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@2e367428[collection1] main
[junit4] 2> 2973674 T17005 N:127.0.0.1:50891_wb_ c:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 2973676 T17005 N:127.0.0.1:50891_wb_ c:collection1 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 2973676 T17005 N:127.0.0.1:50891_wb_ c:collection1 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 2973678 T17005 N:127.0.0.1:50891_wb_ c:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2973678 T17005 N:127.0.0.1:50891_wb_ c:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 2973678 T17005 N:127.0.0.1:50891_wb_ c:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2973680 T17005 N:127.0.0.1:50891_wb_ c:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 2973680 T17005 N:127.0.0.1:50891_wb_ c:collection1 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2973680 T17005 N:127.0.0.1:50891_wb_ c:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 2973680 T17005 N:127.0.0.1:50891_wb_ c:collection1 oass.ZkIndexSchemaReader.createSchemaWatcher Creating ZooKeeper watch for the managed schema at /configs/conf1/managed-schema
[junit4] 2> 2973683 T17005 N:127.0.0.1:50891_wb_ c:collection1 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 2973684 T17005 N:127.0.0.1:50891_wb_ c:collection1 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 2973684 T17006 N:127.0.0.1:50891_wb_ c:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2e367428[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2973689 T17009 N:127.0.0.1:50891_wb_ C:collection1 S:shard4 c:collection1 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:50891/wb_ collection:collection1 shard:shard4
[junit4] 2> 2973690 T16948 N:127.0.0.1:50891_wb_ oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 2973691 T16948 N:127.0.0.1:50891_wb_ oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 2973699 T17009 N:127.0.0.1:50891_wb_ C:collection1 S:shard4 c:collection1 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard4/election
[junit4] 2> 2973736 T17009 N:127.0.0.1:50891_wb_ C:collection1 S:shard4 c:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard4
[junit4] 2> 2973742 T16977 N:127.0.0.1:50886_wb_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2973744 T17009 N:127.0.0.1:50891_wb_ C:collection1 S:shard4 c:collection1 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 2973745 T17009 N:127.0.0.1:50891_wb_ C:collection1 S:shard4 c:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C8263 name=collection1 org.apache.solr.core.SolrCore@3e9c446 url=https://127.0.0.1:50891/wb_/collection1 node=127.0.0.1:50891_wb_ C8263_STATE=coll:collection1 core:collection1 props:{node_name=127.0.0.1:50891_wb_, core=collection1, base_url=https://127.0.0.1:50891/wb_, state=down}
[junit4] 2> 2973745 T17009 N:127.0.0.1:50891_wb_ C:collection1 S:shard4 c:collection1 C8263 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:50891/wb_/collection1/
[junit4] 2> 2973745 T17009 N:127.0.0.1:50891_wb_ C:collection1 S:shard4 c:collection1 C8263 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 2973746 T17009 N:127.0.0.1:50891_wb_ C:collection1 S:shard4 c:collection1 C8263 oasc.SyncStrategy.syncToMe https://127.0.0.1:50891/wb_/collection1/ has no replicas
[junit4] 2> 2973746 T17009 N:127.0.0.1:50891_wb_ C:collection1 S:shard4 c:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:50891/wb_/collection1/ shard4
[junit4] 2> 2973747 T17009 N:127.0.0.1:50891_wb_ C:collection1 S:shard4 c:collection1 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard4
[junit4] 2> 2973749 T16978 N:127.0.0.1:50886_wb_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard4",
[junit4] 2> "collection":"collection1"} current state version: 5
[junit4] 2> 2973756 T17004 N:127.0.0.1:50891_wb_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2973757 T16977 N:127.0.0.1:50886_wb_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2973758 T16989 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2973784 T16978 N:127.0.0.1:50886_wb_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard4",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"https://127.0.0.1:50891/wb_",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 6
[junit4] 2> 2973792 T16977 N:127.0.0.1:50886_wb_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2973796 T17004 N:127.0.0.1:50891_wb_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2973797 T16989 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2973796 T16977 N:127.0.0.1:50886_wb_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 2973835 T17009 N:127.0.0.1:50891_wb_ C:collection1 S:shard4 c:collection1 oasc.ZkController.register We are https://127.0.0.1:50891/wb_/collection1/ and leader is https://127.0.0.1:50891/wb_/collection1/
[junit4] 2> 2973835 T17009 N:127.0.0.1:50891_wb_ C:collection1 S:shard4 c:collection1 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:50891/wb_
[junit4] 2> 2973835 T17009 N:127.0.0.1:50891_wb_ C:collection1 S:shard4 c:collection1 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 2973835 T17009 N:127.0.0.1:50891_wb_ C:collection1 S:shard4 c:collection1 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 2973836 T17009 N:127.0.0.1:50891_wb_ C:collection1 S:shard4 c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 2973840 T16977 N:127.0.0.1:50886_wb_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 2973846 T16978 N:127.0.0.1:50886_wb_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "shard":"shard4",
[junit4] 2> "node_name":"127.0.0.1:50891_wb_",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"4",
[junit4] 2> "operation":"state",
[junit4] 2> "collection":"collection1",
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "base_url":"https://127.0.0.1:50891/wb_",
[junit4] 2> "state":"active"} current state version: 7
[junit4] 2> 2973851 T16978 N:127.0.0.1:50886_wb_ oasco.ReplicaMutator.updateState Update state numShards=4 message={
[junit4] 2> "shard":"shard4",
[junit4] 2> "node_name":"127.0.0.1:50891_wb_",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"4",
[junit4] 2> "operation":"state",
[jun
[...truncated too long message...]
Handler.doScope(ContextHandler.java:1009)
[junit4] > at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
[junit4] > at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
[junit4] > at org.eclipse.jetty.server.Server.handle(Server.java:368)
[junit4] > at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
[junit4] > at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
[junit4] > at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
[junit4] > at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
[junit4] > at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
[junit4] > at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
[junit4] > at org.eclipse.jetty.io.nio.SslConnection.handle(SslConnection.java:196)
[junit4] > at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
[junit4] > at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > </str>
[junit4] > <int name="code">500</int>
[junit4] > </lst>
[junit4] > </response>
[junit4] > at __randomizedtesting.SeedInfo.seed([2F52CE5B675B573E:A706F181C9A73AC6]:0)
[junit4] > at org.apache.solr.schema.TestCloudManagedSchemaConcurrent.verifySuccess(TestCloudManagedSchemaConcurrent.java:107)
[junit4] > at org.apache.solr.schema.TestCloudManagedSchemaConcurrent.addDynamicFieldPut(TestCloudManagedSchemaConcurrent.java:135)
[junit4] > at org.apache.solr.schema.TestCloudManagedSchemaConcurrent.access$300(TestCloudManagedSchemaConcurrent.java:45)
[junit4] > at org.apache.solr.schema.TestCloudManagedSchemaConcurrent$Operation$3.execute(TestCloudManagedSchemaConcurrent.java:286)
[junit4] > at org.apache.solr.schema.TestCloudManagedSchemaConcurrent.concurrentOperationsTest(TestCloudManagedSchemaConcurrent.java:450)
[junit4] > at org.apache.solr.schema.TestCloudManagedSchemaConcurrent.test(TestCloudManagedSchemaConcurrent.java:252)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 3075690 T16948 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudManagedSchemaConcurrent 2F52CE5B675B573E-001
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=DefaultSimilarity, locale=sr_RS_#Latn, timezone=America/Merida
[junit4] 2> NOTE: Mac OS X 10.8.5 x86_64/Oracle Corporation 1.7.0_76 (64-bit)/cpus=3,threads=1,free=66945856,total=396505088
[junit4] 2> NOTE: All tests run in this JVM: [TestFieldCollectionResource, OutputWriterTest, AnalysisErrorHandlingTest, SolrPluginUtilsTest, HdfsRecoveryZkTest, AsyncMigrateRouteKeyTest, TestHighlightDedupGrouping, TestManagedResource, TestImplicitCoreProperties, DistributedIntervalFacetingTest, DocumentAnalysisRequestHandlerTest, TestPartialUpdateDeduplication, TestLazyCores, ConcurrentDeleteAndCreateCollectionTest, FieldAnalysisRequestHandlerTest, TestSolrIndexConfig, IndexSchemaRuntimeFieldTest, ConnectionManagerTest, TestHashQParserPlugin, DistributedQueueTest, DeleteReplicaTest, SynonymTokenizerTest, TestWriterPerf, TestLeaderElectionZkExpiry, TestIndexingPerformance, TestReplicaProperties, TestExpandComponent, TestCollapseQParserPlugin, CustomCollectionTest, RequiredFieldsTest, ParsingFieldUpdateProcessorsTest, RequestHandlersTest, TestLFUCache, DistributedSuggestComponentTest, DistributedDebugComponentTest, DistributedFacetPivotSmallAdvancedTest, TestExceedMaxTermLength, OverseerRolesTest, TestFieldResource, TestInfoStreamLogging, TestStressVersions, DocExpirationUpdateProcessorFactoryTest, TestComplexPhraseQParserPlugin, HdfsDirectoryFactoryTest, SystemInfoHandlerTest, XmlUpdateRequestHandlerTest, TestFreeTextSuggestions, TestCharFilters, TestRawResponseWriter, URLClassifyProcessorTest, TestManagedSynonymFilterFactory, ScriptEngineTest, TestUniqueKeyFieldResource, DirectSolrConnectionTest, TestPerFieldSimilarity, DistanceFunctionTest, TestCoreContainer, DocValuesTest, SharedFSAutoReplicaFailoverUtilsTest, TestSurroundQueryParser, TestSweetSpotSimilarityFactory, BadComponentTest, PreAnalyzedFieldTest, DistributedFacetPivotLongTailTest, NoCacheHeaderTest, TestInitQParser, TestStressReorder, SuggesterWFSTTest, TestShortCircuitedRequests, InfoHandlerTest, TestOverriddenPrefixQueryForCustomFieldType, TestFieldSortValues, TestNoOpRegenerator, DirectUpdateHandlerTest, TestArbitraryIndexDir, TestRestManager, PingRequestHandlerTest, ResponseLogComponentTest, DefaultValueUpdateProcessorTest, SyncSliceTest, TestBinaryField, TestSolrConfigHandler, TestRequestStatusCollectionAPI, SolrIndexSplitterTest, SolrCoreTest, FacetPivotSmallTest, TestPhraseSuggestions, TestStressLucene, TestJsonRequest, RecoveryZkTest, DOMUtilTest, SolrXmlInZkTest, TestMissingGroups, CoreAdminHandlerTest, TestSchemaResource, TestDynamicFieldCollectionResource, SoftAutoCommitTest, HdfsLockFactoryTest, TestSchemaVersionResource, RemoteQueryErrorTest, TestCryptoKeys, SolrTestCaseJ4Test, TestSearcherReuse, HardAutoCommitTest, TestNamedUpdateProcessors, TestBinaryResponseWriter, TestReqParamsAPI, LeaderInitiatedRecoveryOnCommitTest, TestUpdate, DistribDocExpirationUpdateProcessorTest, SliceStateTest, TestStressRecovery, ChangedSchemaMergeTest, CloudExitableDirectoryReaderTest, TestElisionMultitermQuery, TestChildDocTransformer, TestDistribDocBasedVersion, UnloadDistributedZkTest, ShardRoutingTest, TestReplicationHandler, TestDistributedSearch, TestReload, SimpleFacetsTest, TestGroupingSearch, PeerSyncTest, BadIndexSchemaTest, TestFiltering, BasicFunctionalityTest, OverseerCollectionProcessorTest, ShowFileRequestHandlerTest, CurrencyFieldOpenExchangeTest, TestCoreDiscovery, TestExtendedDismaxParser, SuggesterFSTTest, TestCSVLoader, SolrCoreCheckLockOnStartupTest, TestWordDelimiterFilterFactory, StatelessScriptUpdateProcessorFactoryTest, TestRemoteStreaming, SolrInfoMBeanTest, DebugComponentTest, IndexBasedSpellCheckerTest, TestQueryUtils, DirectSolrSpellCheckerTest, TermsComponentTest, PathHierarchyTokenizerFactoryTest, MoreLikeThisHandlerTest, TestJmxIntegration, JSONWriterTest, TestAnalyzedSuggestions, TestPHPSerializedResponseWriter, SearchHandlerTest, SOLR749Test, CopyFieldTest, MultiTermTest, SampleTest, NumericFieldsTest, TestPostingsSolrHighlighter, TestXIncludeConfig, TestIBSimilarityFactory, TestJmxMonitoredMap, DateMathParserTest, PrimUtilsTest, DateFieldTest, SpellingQueryConverterTest, ClusterStateTest, TestLRUCache, TestUtils, TestDocumentBuilder, UUIDFieldTest, FileUtilsTest, CircularListTest, TestRTGBase, CursorPagingTest, TestCursorMarkWithoutUniqueKey, TestSimpleTrackingShardHandler, DistribCursorPagingTest, ExternalCollectionsTest, LeaderFailoverAfterPartitionTest, MigrateRouteKeyTest, OverriddenZkACLAndCredentialsProvidersTest, OverseerStatusTest, ReplicationFactorTest, RollingRestartTest, ShardSplitTest, VMParamsZkACLAndCredentialsProvidersTest, HdfsBasicDistributedZk2Test, HdfsCollectionsAPIDistributedZkTest, HdfsThreadLeakTest, HdfsWriteToMultipleCollectionsTest, StressHdfsTest, TestClusterStateMutator, ZkStateWriterTest, CachingDirectoryFactoryTest, TestConfigOverlay, TestInitParams, TestNRTOpen, TestSolrDynamicMBean, RequestLoggingTest, TestReplicationHandlerBackup, TestSolrConfigHandlerCloud, TestMacros, TestManagedResourceStorage, TestDefaultSearchFieldResource, TestDynamicFieldResource, TestFieldTypeResource, TestManagedSchemaDynamicFieldResource, TestSchemaNameResource, TestSchemaSimilarityResource, TestSerializedLuceneMatchVersion, TestSolrQueryParserDefaultOperatorResource, BadCopyFieldTest, DocValuesMissingTest, EnumFieldTest, SpatialRPTFieldTypeTest, TestCloudManagedSchemaConcurrent]
[junit4] Completed [442/483] on J0 in 112.39s, 1 test, 1 failure <<< FAILURES!
[...truncated 129 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/build.xml:536: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/build.xml:484: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/build.xml:61: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/extra-targets.xml:39: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/build.xml:229: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/solr/common-build.xml:511: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/lucene/common-build.xml:1434: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-5.x-MacOSX/lucene/common-build.xml:991: There were test failures: 483 suites, 1917 tests, 1 failure, 55 ignored (21 assumptions)
Total time: 82 minutes 52 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any